Senior Data Engineer

3 days ago


Greater Sydney Area, Australia HCF Australia Full time $120,000 - $180,000 per year

This role exists to lead the design, development, and implementation of scalable, secure, and high-performance data engineering solutions that underpin the organisation's data platform and business applications.

Responsibilities

  • Design, develop, and implement complex data pipelines and frameworks that meet business, technical, and user requirements across different initiatives and projects.
  • Deliver hands-on solutions using AWS, Talend, and Snowflake to support data warehouse and data lake implementations. Potentially Databricks in the future.
  • Translate business requirements into technical specifications and data workflows.
  • Develop high-performance data warehouses and data marts with a focus on query efficiency, data governance, and security.
  • Take ownership of data pipelines and assets, ensuring they comply with security, and architectural standards and are available, reliable and resilient.
  • Collaborate with other data engineers and internal teams to ensure data requirements are well understood and effectively delivered
  • Deliver and support data assets that enable advanced reporting, analytics, and machine learning models
  • Explore and implement AI and GEN AI/LLM capabilities within data pipelines to enhance data enrichment and automation.
  • Perform work in a manner that complies with relevant regulatory standards including Work Health & Safety (WHS) legislation

Essentials

  • Bachelor's or Master's degree in Computer Science, Engineering or a related discipline
  • 10 years + of commercial experience in a Data Engineering / ETL & Data Warehouse Development roles ideally in Insurance domain.
  • Experience of Talend, Snowflake, Azure, Databricks, AWS ecosystem- EC2, EMR, S3, Aurora, Hive/ Spark etc.
  • Strong fundamental knowledge of ETL/ELT and data warehousing concepts.
  • Advanced SQL experience, including fluency with PL/SQL procedures
  • Performance tuning and cost optimisation in Snowflake and AWS.
  • Good understanding of Business Intelligence and Data Management concepts
  • Advanced problem-solving skills and strong business acumen
  • Experience gathering and documenting data & reporting requirements, including data mapping
  • Experience working in Agile/Scrum teams
  • Excellent communication skills and working with business and IT stakeholders
  • Intermediate understanding of data modelling and concepts especially Data Vault and other modelling techniques.
  • Prior experience in the private health insurance or healthcare domain is highly desirable.

About HCF
At HCF, our purpose is to bring our human touch to healthcare. Since 1932 we've been putting our members and their health first. As Australia's largest not-for-profit health fund, we cover 2 million members with health, life, travel and pet insurance and our vision is to make healthcare understandable, affordable, high quality and member centric.

We want to be true health partners to our members, easily guiding the healthcare choices that are right for them. At HCF, our values are the way we do things and create the necessary culture to help us realise our purpose and deliver our Strategy. Living our values in action we step forward, walk in their shoes, stay human, make it better and get there together.

Culture & Benefits
Purpose-driven passion
We're united by a common purpose: to make healthcare affordable, understandable, high quality and member-focused.

Wellness and work-life balance
Skills
We'll empower you with the necessary skills and tools to support your personal wellbeing journey, ensuring you perform at your best. Our offerings include:

  • 50% subsidy on HCF hospital and/or extras cover
  • 18 weeks of parental leave for all new parents
  • Mental health and wellbeing programs, including workshops, fitness classes, flu vaccinations, skin checks and more
  • Discounts on HCF's products, including life, pet and travel Insurance, as well as discounts at Fitness First gyms and on our eyecare products.

Collaboration and inclusivity
We embrace diversity as our strength and are committed to maintaining an inclusive and collaborative work environment. Our workplace is welcoming and safe for all our employees, irrespective of their unique characteristics including age, ethnicity, cultural or spiritual background, gender identity, disability, education and socio-economic status.

Continuous learning and growth
We believe in lifelong learning. HCF provides opportunities for personal and professional development. From workshops to mentorship programs, we encourage your growth and curiosity.

Next steps
If you
require any adjustments
to assist you in making your application or during the recruitment or onboarding process, please reach out to
Talent Acquisition –
to discuss.

We encourage applicants to submit their applications at their earliest convenience, as at HCF, we review applications as they are submitted, and may have filled the role prior to the job closing date.


  • Senior Data Engineer

    19 hours ago


    Greater Sydney Area, Australia Adactin Full time $120,000 - $180,000 per year

    Adactin Group is a 100% Australian-owned global IT consulting company, headquartered in Sydney. We are a trusted technology partner helping organisations drive end-to-end digital transformation through our deep expertise in Microsoft and AWS ecosystems, AI-powered Digital Engineering, and future-ready Quality Assurance.Our managed delivery approach, backed...

  • Data Engineer

    3 weeks ago


    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    3 weeks ago


    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Lead Data Engineer

    1 week ago


    Greater Sydney Area, Australia Kapital Consulting - Fintech & Executive Search Full time $120,000 - $180,000 per year

    Lead the strategy, design, and delivery of a scalable enterprise data platform supporting critical business functions.Lead the design, build, and scaling of a modern enterprise data platformDrive best practices in data engineering and platform governanceWork with senior stakeholders to deliver critical data capabilitiesPermanent opportunitySydney CBD office...

  • Data Engineer

    1 week ago


    Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Data Engineer

    3 days ago


    Sydney, New South Wales, Australia Data#3 Full time $120,000 - $150,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...


  • Greater Sydney Area, Australia Excolo. Full time $120,000 - $180,000 per year

    Join a leading renewable energy business as we expand our data and integration capabilities.We are seeking a Senior Data Engineer to take ownership of our cloud-based data streaming, integration, and messaging platforms. This role will see you drive the design, development, and governance of our Azure-based data solutions, ensuring scalability, performance,...

  • Senior Data Scientist

    2 weeks ago


    Greater Sydney Area, Australia Excolo. Full time $150,000 - $200,000 per year

    Excolo is partnering with an established insurance leader that is transforming the industry with data. As a Senior Data Scientist you'll play a critical role in designing, building and deploying machine learning models that directly shape products, pricing and customer experiences. You'll work end-to-end from exploration and prototyping through production...


  • Greater Sydney Area, Australia Dipole Group Full time $120,000 - $180,000 per year

    Senior Network EngineerLocation: Sydney, AustraliaAbout the RoleWe are seeking a highly skilled Senior Network Engineer to design, implement, and deliver mission-critical, low-latency, and resilient network solutions. This role requires deep technical expertise, strong collaboration with cross-functional teams, and hands-on involvement in enterprise and data...

  • Lead Data Engineer

    1 week ago


    Greater Sydney Area, Australia HCF Australia Full time $120,000 - $180,000 per year

    This role exists to provide data engineering solutions with automated frameworks to the applications on data platform used by the organization to ensure a scalable and reliable solutionResponsibilitiesDesign, develop and implement complex data solutions to meet business, technical and user requirements.Lead engineering best practices to uplift capability and...