Lead Data Engineer

1 week ago

Sydney, New South Wales, Australia Talenza Full time $200,000 - $250,000 per year

Lead Data Engineer

Sydney, Australia

$230,000 (including Super) + Bonus

About the Role:

Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.

Key Responsibilities:

  • Lead the development and transformation of the regulatory reporting platform.
  • Collaborate across business and technical teams to deliver complex data solutions.
  • Implement and optimize data integration pipelines and data warehouse solutions.
  • Oversee the design and architecture of large-scale data solutions using AWS services.
  • Drive platform efficiency through automation and AI enhancements.
  • Ensure data governance and compliance with internal and external regulations.
  • Provide leadership and mentorship to data engineers, fostering a culture of innovation and excellence.

Required Skills and Experience:

  • Proficient in Spark, Hive, Presto, and big data storage formats (Parquet, ORC, Avro).
  • Experience with data pipeline orchestration tools such as Airflow.
  • Hands-on experience with data integration tools (Talend, DataStage, or Informatica).
  • Strong AWS experience, including EC2, S3, RDS, and EMR.
  • Expertise in data modeling techniques and data architecture best practices.
  • Knowledge of data lineage, technical metadata, data quality, and reconciliation processes.
  • Advanced skills in Spark SQL and Python for data automation.
  • Ability to tune and optimize data queries for performance.
  • Strong communication and negotiation skills.
  • Proven experience in leading cross-platform data solutions and complex projects.
  • Ability to mentor and lead technical teams.

If you feel you possess the relevant skills to the above, please respond with most updated CV

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time $120,000 - $150,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer Consultant

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Lead Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Kapital Consulting Full time $180,000 - $200,000 per year

    Permanent opportunitySydney CBD office | WFH 2 days$180k - $200k + Super + BonusAbout the Role:We are seeking a Lead Data Engineer to take ownership of a data platform supporting critical business functions across the enterprise. This role combines hands-on technical leadership with strategic platform development, ensuring the data ecosystem scales...

  • Data Engineering Lead

    2 weeks ago

    Sydney, New South Wales, Australia SEISMA GROUP Full time $180,000 - $300,000 per year

    We're looking for aData Engineering Leadto drive enterprise-scale data platform transformation and lead a team of ~15 data professionals including Engineers, DevOps specialists, Product Owners, and Scrum Masters. You'll be a strategic partner to the CDAO, shaping our clients data infrastructure, advanced analytics capabilities, and regulatory-compliant data...

  • Data Engineering Lead

    2 weeks ago

    Sydney, New South Wales, Australia Lendi Group Full time $180,000 - $208,000 per year

    Company Description Lendi Group is a market-leading digital platform business that is focused on revolutionising the entire property journey. It operates Lendi - Australia's original and #1 digital mortgage brand - and the iconic Aussie franchise.Powered by an advanced AI proprietary platform, a national network of 1,300 brokers, 230 retail stores, a team of...

  • Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia Lendi Group Full time $120,000 - $180,000 per year

    Company DescriptionLendi Group is a market-leading digital platform business that is focused on revolutionising the entire property journey. It operates Lendi - Australia's original and #1 digital mortgage brand - and the iconic Aussie franchise.Powered by an advanced AI proprietary platform, a national network of 1,300 brokers, 230 retail stores, a team of...

  • Lead Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Resmed Full time $180,000 - $250,000 per year

    Global Technology Solutions (GTS) at ResMed is a division dedicated to creating innovative, scalable, and secure platforms and services for patients, providers, and people across ResMed. The primary goal of GTS is to accelerate well-being and growth by transforming the core, enabling patient, people, and partner outcomes, and building future-ready...

  • Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia Resolution Life Full time $120,000 - $200,000 per year

    About Resolution LifeResolution Life Australasia is one of the leading life insurers in Australia and New Zealand, with ~ 1 million customers with superannuation, investments and life insurance policies, managing approximately A$30 billion in assets and have 1,000 employees across Australia and New Zealand.We value diverse backgrounds and perspectives,...

  • Lead GCP Data Engineer

    3 days ago

    Sydney, New South Wales, Australia Talent Insights Group Pty Ltd Full time $120,000 - $180,000 per year

    Senior / Lead Data Engineer ( GCP / BigQuery / SQL ) – 6-Month Contract Sydney / Hybrid (3 days in office) $ a day including super 6 Months (with potential for extension)About the Opportunity We are seeking two experienced Senior / Lead Data Engineers to join a greenfield data platform project for a boutique Data & AI consultancy who are working with a...