Lead Data Engineer

1 week ago

Sydney, New South Wales, Australia Talenza Full time $200,000 - $250,000 per year

Lead Data Engineer

Sydney, Australia

$230,000 (including Super) + Bonus

About the Role:

Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.

Key Responsibilities:

  • Lead the development and transformation of the regulatory reporting platform.
  • Collaborate across business and technical teams to deliver complex data solutions.
  • Implement and optimize data integration pipelines and data warehouse solutions.
  • Oversee the design and architecture of large-scale data solutions using AWS services.
  • Drive platform efficiency through automation and AI enhancements.
  • Ensure data governance and compliance with internal and external regulations.
  • Provide leadership and mentorship to data engineers, fostering a culture of innovation and excellence.

Required Skills and Experience:

  • Proficient in Spark, Hive, Presto, and big data storage formats (Parquet, ORC, Avro).
  • Experience with data pipeline orchestration tools such as Airflow.
  • Hands-on experience with data integration tools (Talend, DataStage, or Informatica).
  • Strong AWS experience, including EC2, S3, RDS, and EMR.
  • Expertise in data modeling techniques and data architecture best practices.
  • Knowledge of data lineage, technical metadata, data quality, and reconciliation processes.
  • Advanced skills in Spark SQL and Python for data automation.
  • Ability to tune and optimize data queries for performance.
  • Strong communication and negotiation skills.
  • Proven experience in leading cross-platform data solutions and complex projects.
  • Ability to mentor and lead technical teams.

If you feel you possess the relevant skills to the above, please respond with most updated CV

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time $120,000 - $150,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer Consultant

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Lead Data Engineer

    19 hours ago

    Sydney, New South Wales, Australia tekFinder Full time $180,000 - $200,000 per year

    Hiring; Lead Data Engineer - ETL - AWS - SQL*You must live in Sydney for this role as 3 days per week in office are needed.We need a strong Data Tech Lead who can work on solution design from end to end and has a background in Spark SQL, AWS, ETL.This is not a hands off manager role - this is from someone who was once a strong data engineer with ETL/SQL and...

  • Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia Lendi Group Full time $120,000 - $180,000 per year

    Company DescriptionLendi Group is a market-leading digital platform business that is focused on revolutionising the entire property journey. It operates Lendi - Australia's original and #1 digital mortgage brand - and the iconic Aussie franchise.Powered by an advanced AI proprietary platform, a national network of 1,300 brokers, 230 retail stores, a team of...

  • Lead Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Resmed Full time $180,000 - $250,000 per year

    Global Technology Solutions (GTS) at ResMed is a division dedicated to creating innovative, scalable, and secure platforms and services for patients, providers, and people across ResMed. The primary goal of GTS is to accelerate well-being and growth by transforming the core, enabling patient, people, and partner outcomes, and building future-ready...

  • Lead Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Macquarie Group Full time

    OverviewJoin to apply for the Lead Data Engineer role at Macquarie Group.Join our Commodities and Global Markets, Technology, Data Transformation team as we carry an exciting program of work to build an innovative and future-ready Data Platform, that will help Macquarie businesses meet customer needs.At Macquarie, our advantage is bringing together diverse...

  • Lead Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Macquarie Group Full time

    Overview Join to apply for the Lead Data Engineer role at Macquarie Group. Join our Commodities and Global Markets, Technology, Data Transformation team as we carry an exciting program of work to build an innovative and future-ready Data Platform, that will help Macquarie businesses meet customer needs. At Macquarie, our advantage is bringing...

  • Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia Resolution Life Full time $120,000 - $200,000 per year

    About Resolution LifeResolution Life Australasia is one of the leading life insurers in Australia and New Zealand, with ~ 1 million customers with superannuation, investments and life insurance policies, managing approximately A$30 billion in assets and have 1,000 employees across Australia and New Zealand.We value diverse backgrounds and perspectives,...

  • Data Engineering Lead

    15 hours ago

    Sydney, New South Wales, Australia Blackmores Group Full time $180,000 - $250,000 per year

    We are hiring aLead Data Engineerto join our Data & Analytics team.Purpose:Blackmores is on a journey to revamp their Data and Analytics (DNA) landscape to move from diagnostics analytics to predictive and prescriptive analytics. We are bringing in world class tools like Snowflake,Fivetran,Coalesceto build a platform which will enable us to change the DNA of...

  • Lead GCP Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Talent Insights Group Pty Ltd Full time $120,000 - $180,000 per year

    Senior / Lead Data Engineer ( GCP / BigQuery / SQL ) – 6-Month Contract Sydney / Hybrid (3 days in office) $ a day including super 6 Months (with potential for extension)About the Opportunity We are seeking two experienced Senior / Lead Data Engineers to join a greenfield data platform project for a boutique Data & AI consultancy who are working with a...