Lead Data Engineer

1 week ago

Sydney, New South Wales, Australia Talenza Full time $230,000 - $240,000 per year

Lead Data Engineer

Sydney, Australia

$230,000 (including Super) + Bonus

About the Role:

Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.

Key Responsibilities:

  • Lead the development and transformation of the regulatory reporting platform.
  • Collaborate across business and technical teams to deliver complex data solutions.
  • Implement and optimize data integration pipelines and data warehouse solutions.
  • Oversee the design and architecture of large-scale data solutions using AWS services.
  • Drive platform efficiency through automation and AI enhancements.
  • Ensure data governance and compliance with internal and external regulations.
  • Provide leadership and mentorship to data engineers, fostering a culture of innovation and excellence.

Required Skills and Experience:

  • Proficient in Spark, Hive, Presto, and big data storage formats (Parquet, ORC, Avro).
  • Experience with data pipeline orchestration tools such as Airflow.
  • Hands-on experience with data integration tools (Talend, DataStage, or Informatica).
  • Strong AWS experience, including EC2, S3, RDS, and EMR.
  • Expertise in data modeling techniques and data architecture best practices.
  • Knowledge of data lineage, technical metadata, data quality, and reconciliation processes.
  • Advanced skills in Spark SQL and Python for data automation.
  • Ability to tune and optimize data queries for performance.
  • Strong communication and negotiation skills.
  • Proven experience in leading cross-platform data solutions and complex projects.
  • Ability to mentor and lead technical teams.

If you feel you possess the relevant skills to the above, please respond with most updated CV

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer

    6 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer Consultant

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...

  • Data Engineer Consultant

    4 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...

  • Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia Tribus Full time $125,000 - $175,000 per year

    Data Engineering Lead We're looking for a Data Engineering Lead to lead the build-out of scalable data infrastructure for real-time analytics and reporting. This is a leadership-first role (60%) with continued technical delivery (40%). In This Role, You Will:Lead a growing team of data engineers growing to 6. Build and manage streaming data pipelines...

  • Leading Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataLeader Full time $185,000 - $215,000

    Data Engineering LeaderRole OverviewThis role focuses on leading a team of data engineers to develop, maintain and support data pipelines using modern data engineering practices.The ideal candidate should have experience with cloud data warehouses, ETL tools, programming languages such as Python, and strong understanding of data warehousing concepts and data...

  • Solar Design Engineer

    7 days ago

    Sydney, New South Wales, Australia Electrical Engineer Full time

    OverviewHarvey Norman Commercial Division specialises in the supply of goods & services to project builders, developers, architects and the mining industry. Our clients depend upon Harvey Norman Commercial to supply the best range, the best service and the best prices.We have an exciting opportunity at our Taren Point office for a motivated and driven Full...

  • Solar Design Engineer

    7 days ago

    Sydney, New South Wales, Australia Electrical Engineer Full time

    OverviewHarvey Norman Commercial Division specialises in the supply of goods & services to project builders, developers, architects and the mining industry. Our clients depend upon Harvey Norman Commercial to supply the best range, the best service and the best prices.We have an exciting opportunity at our Taren Point office for a motivated and driven Full...