Lead Data Engineer

2 days ago


Sydney, New South Wales, Australia HCF (Australia) Full time $120,000 - $180,000 per year

This role exists to provide data engineering solutions with automated frameworks to the applications on data platform used by the organization to ensure a scalable and reliable solution

Responsibilities

  • Design, develop and implement complex data solutions to meet business, technical and user requirements.
  • Lead engineering best practices to uplift capability and delivery quality.
  • Design and implement data solutions, including data modeling such as Data Vault and different modelling techniques, in close collaboration with the data architect.
  • Strong and proven hands-on experience in implementing the business use cases using the data-platform (data warehouse and data lake) tool AWS, Talend, Databricks, Spark, Hive and Snowflake and ETL technologies.
  • Work closely with business and other teams for appropriate design and solution.
  • Build and optimize data warehouse and data marts ensuring high performance, security and data governance.
  • Technical ownership for data and data pipelines to ensure compliance with data and architectural standards.
  • Create and maintain documentation for data pipelines, architectures and processes.
  • Implement solutions to integrate Gen AI / LLM technologies into data pipelines enabling data enrichment.
  • Contribute to the growth of our data engineering practice through automation, and governance uplift.
  • Automate engineering solutions to create products to be used across the business.
  • Establish and maintain collaboration with research and business teams to converge on the best solutions.
  • Explore emerging tools and technologies and integrate to align optimal solutions with business goals.
  • Technical ownership for data and data pipelines to ensure compliance with data and architectural standards.
  • Responsible for solving problems related to Data Cleansing, Data Quality and Data Security (masking & encryption).

Essential Skills

  • Bachelor's or Master's degree in Computer Science / Engineering or a related discipline
  • 10 years + of commercial experience in a Data Engineering / ETL & Data Warehouse Development roles ideally in Insurance domain.
  • Experience of Talend, Snowflake, Azure, Databricks, AWS ecosystem- EC2, EMR, S3, Aurora, Hive/ Spark etc. is preferred.
  • Experience in Gen AI/LLM is preferred.
  • Advanced SQL experience, including fluency with PL/SQL procedures
  • Basic understanding of data modelling and concepts especially Data Vault and other modelling techniques.
  • Strong fundamental knowledge of ETL/ELT and data warehousing concepts.
  • Performance tuning and cost optimization in Snowflake and AWS.
  • Good understanding of Business Intelligence and Data Management concepts
  • Experience in Insurance Domain would be added advantage.

About HCF

At HCF, our purpose is to bring our human touch to healthcare. Since 1932 we've been putting our members and their health first. As Australia's largest not-for-profit health fund, we cover 2 million members with health, life, travel and pet insurance and our vision is to make healthcare understandable, affordable, high quality and member centric.

We want to be true health partners to our members, easily guiding the healthcare choices that are right for them. At HCF, our values are the way we do things and create the necessary culture to help us realise our purpose and deliver our Strategy. Living our values in action we step forward, walk in their shoes, stay human, make it better and get there together.

Culture & Benefits

Purpose-driven passion

We're united by a common purpose: to make healthcare affordable, understandable, high quality and member-focused.

Wellness and work-life balance

We'll empower you with the necessary skills and tools to support your personal wellbeing journey, ensuring you perform at your best. Our offerings include:

  • 50% subsidy on HCF hospital and/or extras cover
  • 18 weeks of parental leave for all new parents
  • Mental health and wellbeing programs, including workshops, fitness classes, flu vaccinations, skin checks and more
  • Discounts on HCF's products, including life, pet and travel Insurance, as well as discounts at Fitness First gyms and on our eyecare products.

Collaboration and inclusivity

We embrace diversity as our strength and are committed to maintaining an inclusive and collaborative work environment. Our workplace is welcoming and safe for all our employees, irrespective of their unique characteristics including age, ethnicity, cultural or spiritual background, gender identity, disability, education and socio-economic status.

Continuous learning and growth

We believe in lifelong learning. HCF provides opportunities for personal and professional development. From workshops to mentorship programs, we encourage your growth and curiosity.

Next steps

If you require any adjustments to assist you in making your application or during the recruitment or onboarding process, please reach out to Talent Acquisition –

to discuss.

We encourage applicants to submit their applications at their earliest convenience, as at HCF, we review applications as they are submitted, and may have filled the role prior to the job closing date.


  • Data Engineer

    2 days ago


    Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...


  • Sydney, New South Wales, Australia NTT DATA, Inc. Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Lead Data Engineer

    2 days ago


    Sydney, New South Wales, Australia Kapital Consulting Full time $180,000 - $200,000 per year

    Permanent opportunitySydney CBD office | WFH 2 days$180k - $200k + Super + BonusAbout the Role:We are seeking a Lead Data Engineer to take ownership of a data platform supporting critical business functions across the enterprise. This role combines hands-on technical leadership with strategic platform development, ensuring the data ecosystem scales...


  • Sydney, New South Wales, Australia SEISMA GROUP Full time $180,000 - $300,000 per year

    We're looking for aData Engineering Leadto drive enterprise-scale data platform transformation and lead a team of ~15 data professionals including Engineers, DevOps specialists, Product Owners, and Scrum Masters. You'll be a strategic partner to the CDAO, shaping our clients data infrastructure, advanced analytics capabilities, and regulatory-compliant data...

  • Lead Data Engineer

    1 week ago


    Sydney, New South Wales, Australia tekFinder Full time $180,000 - $200,000 per year

    Hiring; Lead Data Engineer - ETL - AWS - SQL*You must live in Sydney for this role as 3 days per week in office are needed.We need a strong Data Tech Lead who can work on solution design from end to end and has a background in Spark SQL, AWS, ETL.This is not a hands off manager role - this is from someone who was once a strong data engineer with ETL/SQL and...


  • Sydney, New South Wales, Australia Lendi Group Full time $180,000 - $208,000 per year

    Company Description Lendi Group is a market-leading digital platform business that is focused on revolutionising the entire property journey. It operates Lendi - Australia's original and #1 digital mortgage brand - and the iconic Aussie franchise.Powered by an advanced AI proprietary platform, a national network of 1,300 brokers, 230 retail stores, a team of...

  • Lead Data Engineer

    4 days ago


    Sydney, New South Wales, Australia APA Group Full time $120,000 - $180,000 per year

    The OpportunityAt APA, our purpose is to secure Australia's energy future. We're not doing it alone. We're doing it with our customers and communities as Australia's energy infrastructure partner, a role our unique experience and expertise positions us to play.We now have an exciting opportunity available for a Lead Data Engineer in Melbourne, Adelaide,...


  • Sydney, New South Wales, Australia Talent Insights Group Pty Ltd Full time $120,000 - $180,000 per year

    Senior / Lead Data Engineer ( GCP / BigQuery / SQL ) – 6-Month Contract Sydney / Hybrid (3 days in office) $ a day including super 6 Months (with potential for extension)About the Opportunity We are seeking two experienced Senior / Lead Data Engineers to join a greenfield data platform project for a boutique Data & AI consultancy who are working with a...


  • Sydney, New South Wales, Australia Blackmores Group Full time $180,000 - $250,000 per year

    We are hiring aLead Data Engineerto join our Data & Analytics team.Purpose:Blackmores is on a journey to revamp their Data and Analytics (DNA) landscape to move from diagnostics analytics to predictive and prescriptive analytics. We are bringing in world class tools like Snowflake,Fivetran,Coalesceto build a platform which will enable us to change the DNA of...

  • Lead Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Macquarie Group Full time $120,000 - $200,000 per year

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem solving and technical data professional to contribute and grow rapidly within the...