Lead Data Engineer

3 days ago

Canberra, ACT, Australia Clearcompany Full time

Lead Data Engineer
Sydney, Australia
$230,000 (including Super) + Bonus
About the Role:
Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.
Key Responsibilities:
Lead the development and transformation of the regulatory reporting platform.
Collaborate across business and technical teams to deliver complex data solutions.
Implement and optimize data integration pipelines and data warehouse solutions.
Oversee the design and architecture of large-scale data solutions using AWS services.
Drive platform efficiency through automation and AI enhancements.
Ensure data governance and compliance with internal and external regulations.
Provide leadership and mentorship to data engineers, fostering a culture of innovation and excellence.
Required Skills and Experience:
Proficient in Spark, Hive, Presto, and big data storage formats (Parquet, ORC, Avro).
Experience with data pipeline orchestration tools such as Airflow.
Hands-on experience with data integration tools (Talend, DataStage, or Informatica).
Strong AWS experience, including EC2, S3, RDS, and EMR.
Expertise in data modeling techniques and data architecture best practices.
Knowledge of data lineage, technical metadata, data quality, and reconciliation processes.
Advanced skills in Spark SQL and Python for data automation.
Ability to tune and optimize data queries for performance.
Strong communication and negotiation skills.
Proven experience in leading cross-platform data solutions and complex projects.
Ability to mentor and lead technical teams.
If you feel you possess the relevant skills to the above, please respond with most updated CV
#J-18808-Ljbffr

  • Azure Data Factory Engineer

    4 days ago

    Canberra, ACT, Australia Babylon Data Full time

    Job Title: Azure Data Factory EngineerRate Guide: $100–$125 per hour (plus super @ 12%)Location of Work: Canberra, ACTContract Duration: ASAP – 30 June 2026Start Date: Tuesday, 23 September 2025Maximum Hours per Week: Up to 40 hoursSecurity Clearance Requirements: Must be an Australian Citizen and able to obtain NV1 clearanceJob DetailsBabylon Data is...

  • Azure Data Factory Engineer

    3 days ago

    Canberra, ACT, Australia Babylon Data Full time

    Job Title: Azure Data Factory EngineerRate Guide: $100–$125 per hour (plus super @ 12%)Location of Work: Canberra, ACTContract Duration: ASAP – 30 June 2026Start Date: Tuesday, 23 September 2025Maximum Hours per Week: Up to 40 hoursSecurity Clearance Requirements: Must be an Australian Citizen and able to obtain NV1 clearanceJob DetailsBabylon Data is...

  • Lead Data Engineer

    4 days ago

    Canberra, ACT, Australia ClearCompany Full time

    Lead Data EngineerSydney, Australia$230,000 (including Super) + BonusAbout the Role:Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.Key Responsibilities:Lead the development and transformation of the...

  • Lead Data Engineer

    3 weeks ago

    Canberra, ACT, Australia Pinaka Full time

    Lead Data Engineer (Multiple Roles)Australian citizenship required. No PR or Work Visa holders. Must be able to obtain Baseline security clearance.Those with an active clearance and based in Canberra highly preferred.What to submit?A tailored resume in docx formatIndividual responses to each criterion (max 3000 characters each)RFQ DetailsRFQ ID:...

  • Lead Data Engineer

    3 weeks ago

    Canberra, ACT, Australia Pinaka Full time

    Lead Data Engineer (Multiple Roles)Australian citizenship required. No PR or Work Visa holders. Must be able to obtain Baseline security clearance.Those with an active clearance and based in Canberra highly preferred.What to submit?A tailored resume in docx formatIndividual responses to each criterion (max 3000 characters each)RFQ DetailsRFQ ID:...

  • Lead Data Engineer

    3 weeks ago

    Canberra, ACT, Australia Pinaka Full time

    Pinaka Canberra, Australian Capital Territory, AustraliaJoin or sign in to find your next jobJoin to apply for the Lead Data Engineer role at PinakaPinaka Canberra, Australian Capital Territory, Australia4 days ago Be among the first 25 applicantsJoin to apply for the Lead Data Engineer role at PinakaLead Data Engineer (Multiple Roles)Australian citizenship...

  • Lead Data Engineer

    3 weeks ago

    Canberra, ACT, Australia Pinaka Full time

    Pinaka Canberra, Australian Capital Territory, AustraliaJoin or sign in to find your next jobJoin to apply for the Lead Data Engineer role at PinakaPinaka Canberra, Australian Capital Territory, Australia4 days ago Be among the first 25 applicantsJoin to apply for the Lead Data Engineer role at PinakaLead Data Engineer (Multiple Roles)Australian citizenship...

  • Lead Data Engineer

    3 weeks ago

    Canberra, ACT, Australia Ignite Full time

    Ignite Canberra, Australian Capital Territory, AustraliaIgnite Canberra, Australian Capital Territory, Australia1 day ago Be among the first 25 applicantsLead Data EngineerLocation: ACTContract: 12 months + 2 x 12-month extensionsClearance: NV2 requiredWe're looking for a high-impact Lead Data Engineer to join a large Federal Government agency and play a key...

  • Lead Data Engineer

    3 weeks ago

    Canberra, ACT, Australia Ignite Full time

    Ignite Canberra, Australian Capital Territory, AustraliaIgnite Canberra, Australian Capital Territory, Australia1 day ago Be among the first 25 applicantsLead Data EngineerLocation: ACTContract: 12 months + 2 x 12-month extensionsClearance: NV2 requiredWe're looking for a high-impact Lead Data Engineer to join a large Federal Government agency and play a key...

  • Lead Data Analyst

    3 weeks ago

    Canberra, ACT, Australia NTT DATA Full time

    Lead Data Analyst - Baseline Security ClearanceNTT DATA Canberra, Australian Capital Territory, AustraliaOur client is looking for a seasoned specialist in the Microsoft industry and international customer relations to aid in a contract review and discovery initiative. The ideal candidate will be responsible for identifying and analyzing existing...