Head of Data Engineering

4 days ago

Brisbane, Queensland, Australia iSelect Full time $120,000 - $200,000 per year

Who We Are 

iSelect and Compare the Market are trusted, well-known brands dedicated to helping millions of Australians compare and buy personal finance and household products such as insurance, energy, and loans. Together, we provide a seamless, customer-focused experience that makes it easier for Australians to find the right products to suit their needs.

What You'll be doing

As Head of Data Engineering, you will lead the development, scalability, and operational excellence of our core data platforms. You'll drive best-in-class engineering practices, ensure data integrity and availability, and oversee automation, monitoring, and optimisation of data workflows. You will also shape modern data architectures, implement cloud-based big data solutions, and champion DataOps methodologies to deliver efficient, reliable, and innovative data capabilities.

  • Define and deliver the data engineering roadmap, ensuring governance, security, and data quality.
  • Architect, build and optimise scalable data solutions utilising Databricks as our Enterprise Date Platform. 
  • Implement DataOps practices for automation, CI/CD, and testing.
  • Build and lead high-performing teams while fostering collaboration and innovation.
  • Stay ahead of emerging trends and adopt tools to enhance automation and cost efficiency.

What's in it for you

At Compare the Market and iSelect we offer a dynamic and collaborative work environment where your talents will be recognised and rewarded. You'll have the opportunity to make a meaningful impact and contribute to our continued success, we also provide:

  • Vibrant and social community who have annual celebrations, family fun days and regular events.
  • Enjoy flexible work arrangements, including the option of one day working from home each week or a 9-day fortnight.
  • Enjoy additional "ME" leave days
  • Employee discounts on Car, Home, Travel insurance.
  • Income protection insurance provided to support you in the event of non-work-related illness or injury. 

What Sets You Apart

  • Demonstrated leadership and team-building skills, with experience managing high-performing engineering teams.
  • Ability to develop strategy, influence senior stakeholders, and align data solutions with business objectives.
  • Extensive experience with cloud-based data platforms (AWS, Azure, GCP) and data lake/lakehouse architectures.
  • Expertise in big data frameworks (Apache Spark, Hadoop, Snowflake, Redshift, BigQuery, Delta Lake) and strong skills in Python, PySpark, SQL.
  • Proven ability to design and optimise ETL/ELT pipelines for structured and unstructured data.
  • Hands-on experience with DataOps practices, including CI/CD (Terraform, dbt, GitHub Actions, Azure DevOps) and orchestration tools (Airflow, Dagster, Prefect).
  • Knowledge of real-time streaming technologies (Kafka, Kinesis, Delta Live Tables).
  • Strong understanding of data governance, security, and compliance (Unity Catalog, GDPR, CCPA, HIPAA), including RBAC, encryption, and data masking.

Sound like a good fit? Let's talk.

At Compare the Market and iSelect we're proud to be an Equal Opportunity Employer and we embrace diversity.  

This role is available to candidates with unlimited Australian working rights only. Sponsorship is not available.  

Compare the Market and iSelect are committed to protecting your privacy. All applications and personal information are kept confidential and securely stored in line with Australian privacy laws, used only for recruitment purposes, and not shared with third parties outside the Auto and General Holdings Group without your consent. 

  • Head of Data Engineering

    4 days ago

    Brisbane, Queensland, Australia iSelect Ltd Full time $120,000 - $180,000 per year

    Who We AreiSelect and Compare the Market are trusted, well-known brands dedicated to helping millions of Australians compare and buy personal finance and household products such as insurance, energy, and loans. Together, we provide a seamless, customer-focused experience that makes it easier for Australians to find the right products to suit their needs.What...

  • Data Engineer

    1 week ago

    Brisbane, Queensland, Australia Australian College of Rural and Remote Medicine Full time $80,000 - $120,000 per year

    Are you a skilled Data Engineer passionate about making a difference in Australian rural healthcare?The Australian College of Rural and Remote Medicine (ACRRM) is at the forefront of improving healthcare for rural, remote, and First Nations communities across Australia. We believe that robust data and insightful analysis are critical to understanding...

  • Data Engineer

    7 days ago

    Brisbane, Queensland, Australia Heritage Bank Full time $100,000 - $150,000 per year

    DescriptionAbout the role We are looking for a highly skilled and experienced data engineer to join our Data and Insights team. This role will play a pivotal role in for the ongoing administration and improvement of the Data and Insight platform, ensuring its stability, scalability, and security, building data pipelines for Analytics and Reporting use...

  • Data Engineer

    1 week ago

    Brisbane, Queensland, Australia Servco Australia Full time $90,000 - $120,000 per year

    Company DescriptionServco Australia is one of the largest automotive retail dealership groups in Australia, operating over 45 locations across QLD, NSW, VIC, and WA. Representing several top automotive brands, Servco employs over 2,000 team members. With core values of respect, service, teamwork, and innovation, we aim to transform the Australian automotive...

  • Cyber Security Engineer

    1 week ago

    Brisbane, Queensland, Australia NTT DATA Full time $120,000 - $180,000 per year

    Cyber Security Engineer (PAM + MFA – One Identity)Our client, a renowned technology provider in the rail industry, is seeking a Cyber Security Engineer to join their team at Eagle Farm, Queensland. This role is an exceptional opportunity to contribute your cyber security expertise within a forward-thinking environment supporting critical...

  • Data Engineer

    1 week ago

    Brisbane, Queensland, Australia Queensland Treasury Corporation Full time $80,000 - $150,000 per year

    Description Join QTC's Technology & Data team as a Data Engineer and play a pivotal role in delivering our Unified Data Program (UDP), a cornerstone of our data transformation strategy. This is a unique opportunity to help shape the future of data at QTC by consolidating our data lifecycle into a unified platform that supports trusted data assets, advanced...

  • Data Engineer

    1 week ago

    Brisbane, Queensland, Australia Queensland Treasury Corporation Full time $80,000 - $120,000 per year

    DescriptionJoin QTC's Technology & Data team as a Data Engineer and play a pivotal role in delivering our Unified Data Program (UDP), a cornerstone of our data transformation strategy. This is a unique opportunity to help shape the future of data at QTC by consolidating our data lifecycle into a unified platform that supports trusted data assets, advanced...

  • Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia KPMG Full time $80,000 - $120,000 per year

    We are seeking a skilled Data Engineer and Reporting Analyst with expertise in the Microsoft cloud technology stack to join our professional services team. This role involves building and delivering scalable, secure, and high-performing data platforms for our clients using Microsoft Fabric, Databricks, and other modern data technologies. The ideal candidate...

  • Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia KPMG Australia Full time $80,000 - $120,000 per year

    Company DescriptionWe reduce complexity and cost by delivering enterprise-grade data and AI platforms and solutions with minimal overhead – enabling smarter operations and insights without the cost and burden of fragmented systems.We help organisations understand, govern and protect their data through transparency on where it lives, how it's used. We help...

  • Windows Engineer

    2 weeks ago

    Brisbane, Queensland, Australia NTT DATA Full time $90,000 - $120,000 per year

    Is innovation part of your DNA? Do you want to enable a connected future for people, organizations, and society?Join our growing global NTT team and you'll be part of the world's largest ICT company (by revenue). We've combined the capabilities of 28 remarkable companies to become one, leading technology services provider. Together, we help our people,...