Senior Data Engineer

1 month ago

Toowong, Australia Compare the Market Full time

#S-DNI

About the Company

Compare the Market, yep, the one with the meerkats, is on an exciting growth trajectory and we are inviting talented Senior Data Engineers to join us in making a significant impact on the lives of people all over Australia.

At CTM, you won't just be an employee; you'll be a crucial part of our mission to empower our customers to make informed purchasing decisions across various insurance, finance, and household product categories; thereby improving and simplifying their lives, while saving them time, effort, and money.

We are all about Integrity, Growth, Excellent Customer Service, and being Peerless - without compromise.

About the Role

As CTM continues to enhance our modern data platform (Databricks/AWS), we want to ensure we can best service our analytical use-cases and drive value for the business. Reporting to the Head of Data Science, you will have the opportunity to establish foundational engineering principles and provide technical leadership to support our business intelligence, data science, and machine learning practices.

As a Senior Data Engineer, in addition to your strong hands-on development experience, you’ll be able to provide guidance around architecture and solution design. You will contribute to the data strategy from an engineering perspective and help the broader team in the development of the data platform and overall ecosystem. You will work within and be supported by a great team that includes data scientists, business intelligence developers, data engineers, data architects, data modellers, and business analysts, in addition to the broader IT and business teams.

What you’ll do

  • Work with data producers, data consumers, and other supporting roles to ensure data is well managed for consumption.
  • Build, maintain, and optimize high quality data pipelines for serving analytics use-cases, including business intelligence and machine learning.
  • Work with architects to develop architectural patterns for data pipelines, including for event based real-time processing.
  • Support the development and implementation of data engineering roadmap.
  • Champion best practices for data management and data governance. This includes data modelling; ETL and processing performance; data quality, observability, and discoverability; security and sensitive data handling; and codebase quality.

What you’ll bring

  • 5+ years of experience as a professional data engineer or analytics engineer, developing ETL pipelines for production environments.
  • Solid experience building analytical data pipelines in cloud systems.
  • Solid data management experience covering data modelling, data quality monitoring, maintaining data dictionaries, row/column level security, sensitive data masking or tokenization, and access controls.
  • Ability to write high quality code for data pipelines, preferably in Python.
  • Excellent SQL skills.
  • Experience with CI/CD and Infrastructure as Code builds.
  • Experience providing data engineering leadership and mentorship.
  • Solid written and verbal communication skills.
  • Highly Regarded:
    • Experience developing on Databricks and/or using Spark or PySpark.
    • Experience building robust feature stores with batch and streaming data for use by machine learning models.
    • Experience building highly automated metadata driven solutions.

What we enjoy at Compare the Market

Whether we're writing a single line of code or capturing requirements, our dedication to our customers is unwavering, and is at the very heart of all we do.

At CTM, our workplace is both diverse and inclusive, and we cultivate a culture that is collaborative and innovative within our close-knit teams. We are a “work from the office” company as we believe that performance, culture, innovation and collaboration are at their best when we’re working together in person.

If you are a high-performing individual, with a passion for problem-solving and a desire to make a positive difference, we encourage you to apply. Your expertise, combined with our supportive environment and exciting growth prospects, can create a successful and fulfilling career at Compare the Market, where you will enjoy:

  • City fringe location - close to public transport, street parking, and the riverwalk.
  • Compare the Market is launching a 9-day fortnight trial in January 2024. This program is designed to offer employees greater flexibility in their work schedules while maintaining business performance and ensuring a healthy work-life balance. In summary participants will work additional hours across the 9 working days to access every second Friday off. Your role will be eligible to participate in this trial if it suits your circumstances.
  • We have vibrant social and community activities including annual celebrations, family fun days and regular events across each of our sites.
  • Enjoy additional leave days - ‘ME’ leave and ‘Volunteer Day’ leave.
  • Employee discounts on Car, Home, Travel insurance plus discounts with a broad range of providers, including gym memberships, accommodation, dental care and more.
  • Income protection insurance provided to support you in the event of non-work related illness or injury.
  • Access to the Employee Assistance Program

Compare the Market is an Equal Opportunity Employer. We acknowledge that we are strengthened by diversity, and we encourage all applicants to apply who have the right to live and work in Australia.

Intrigued? Don't limit yourself. Apply now … it’s Simples

*Note to Recruiters: We politely ask that you avoid any approaches or sending unsolicited resumes to our recruitment team and hiring leaders across our business.

  • Senior Data Engineer

    6 days ago

    Toowong, Queensland, Australia Compare the Market Full time

    About The company This job ad is the universe's way of telling you that you're currently in the wrong job. Compare the Market – yes, the one with the meerkats – is a high-growth FinTech company on a transformational journey. We are focused on designing, building, and delivering the very best home loan, energy, insurance, and health comparison experience...

  • Senior Data Engineer

    6 days ago

    Toowong, Queensland, Australia Compare the Market Full time

    #S-DNI About the Company Compare the Market, yep, the one with the meerkats, is on an exciting growth trajectory and we are inviting talented Senior Data Engineers to join us in making a significant impact on the lives of people all over Australia. At CTM, you won't just be an employee; you'll be a crucial part of our mission to empower our customers to...

  • Senior Systems Engineer

    4 weeks ago

    Toowong, Australia Data#3 Ltd Full time

    Job Description Azure DevOps EngineerJoin Microsoft’s largest Australian PartnerHRD Employer of Choice and Great Place to WorkBrisbane, Sydney or Melbourne Based - Hybrid WorkingAs an Azure DevOps Engineer you will work across multiple organisations, managing the latest technologies. The work is interesting, challenging and you get to...

  • Senior Systems Engineer

    2 weeks ago

    Toowong, Australia Data#3 Ltd Full time

    Job Description Azure DevOps EngineerJoin Microsoft’s largest Australian PartnerHRD Employer of Choice and Great Place to WorkBrisbane, Sydney or Melbourne Based - Hybrid WorkingAs an Azure DevOps Engineer you will work across multiple organisations, managing the latest technologies. The work is interesting, challenging and you get to...

  • Senior Systems Engineer

    5 days ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    Job Description Azure DevOps EngineerJoin Microsoft's largest Australian PartnerHRD Employer of Choice and Great Place to WorkBrisbane, Sydney or Melbourne Based - Hybrid WorkingAs an Azure DevOps Engineer you will work across multiple organisations, managing the latest technologies. The work is interesting, challenging and you get to work with an...

  • Manager Engineering

    4 weeks ago

    Toowong, Australia Data#3 Limited Full time

    **Job Summary**: - Data#3 is seeking an experienced Engineering Manager to join our high performing National Managed Services team. Date Listed: Job Ref: **Job Type**: **Location**: 30/04/2024 KAWI111556 Permanent Toowong - **Join our high performing Managed Services Team**: - ** Become part of one of Australia fastest growing MSPs**: - ** Can be...

  • Manager Engineering

    11 hours ago

    Toowong, Australia Data#3 Limited Full time

    **Job Summary**: - Data#3 is seeking an experienced Engineering Manager to join our high performing National Managed Services team. Date Listed: Job Ref: **Job Type**: **Location**: 30/04/2024 KAWI111556 Permanent Toowong - **Join our high performing Managed Services Team**: - ** Become part of one of Australia fastest growing MSPs**: - ** Can be...

  • Manager Engineering

    4 weeks ago

    Toowong, Australia Data#3 Limited Full time

    **Job Summary**: - Data#3 is seeking an experienced leader to join us as an Engineering Manager within our high performing and expanding Managed Services team. Date Listed: Job Ref: **Job Type**: **Location**: 6/03/2023 KAWI109850 Permanent Toowong - **Join our high performing Managed Services Team**: - ** Become part of one of Australia fastest...

  • Manager Engineering

    6 days ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: Data#3 is seeking an experienced Engineering Manager to join our high performing National Managed Services team.Date Listed:Job Ref:Job Type:Location:30/04/2024KAWI111556PermanentToowong- Join our high performing Managed Services Team: Become part of one of Australia fastest growing MSPs:- Can be based in Brisbane/Sydney/Melbourne or Adelaide:...

  • Manager Engineering

    6 days ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: Data#3 is seeking an experienced leader to join us as an Engineering Manager within our high performing and expanding Managed Services team.Date Listed:Job Ref:Job Type:Location:6/03/2023KAWI109850PermanentToowong- Join our high performing Managed Services Team: Become part of one of Australia fastest growing MSPs:- Can be based in...

  • Senior Accountant

    6 days ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    Job DescriptionASX200 Listed IT Services and Solutions CompanyBrisbane HeadquartersHRD Employer of Choice, Accredited Family Inclusive WorkplaceAbout the jobThis is an exceptional opportunity to have impact, ensuring Data#3's accounting, financial and operating reporting accurately reflects the conditions of the business and generating reliable information...

  • Desktop Support Analyst

    6 days ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: Data#3 is seeking a proactive and experienced Desktop Support Analyst to join our high performing team on a 3 year full time contract.Date Listed:Job Ref:Job Type:Location:2/02/2023KAWI109688Limited TermToowongData#3 is seeking a proactive and experienced Desktop Support Analyst to join our high performing team on a 3 year full time contract, to...

  • Desktop Support Analyst

    6 days ago

    Toowong, Australia Data#3 Limited Full time

    **Job Summary**: - We are seeking a proactive and experienced Desktop Support Analyst to join our high performing team based with our client onsite in Chinchilla. Date Listed: Job Ref: **Job Type**: **Location**: 24/04/2024 KAWI111383 Limited Term Toowong - **Work for an HRD Employer of Choice winner for 9 years in a row!**: - ** 12 month fixed term...

  • Application Packager

    3 weeks ago

    Toowong, Australia Data#3 Limited Full time

    **Job Summary**: - Data#3 is currently seeking an experienced customer centric Patching & Compliance Engineer to work closely with our managed services team. Date Listed: Job Ref: **Job Type**: **Location**: 31/08/2023 LITO110607 Permanent Toowong - **Join our high performing, and expanding Managed Services Team**: - ** Can be based in...

  • Desktop Support Analyst

    6 days ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: We are seeking a proactive and experienced Desktop Support Analyst to join our high performing team based in Ormeau (Gold Coast).Date Listed:Job Ref:Job Type:Location:9/11/2023KAWI110910Limited TermToowong- Work for an HRD Employer of Choice winner for 8 years in a row: 12 month fixed term contract:- Ormeau office location (Gold Coast)Who is...

  • Desktop Support Analyst

    6 days ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: We are seeking a proactive and experienced Desktop Support Analyst to join our high performing team based with our client onsite in Chinchilla.Date Listed:Job Ref:Job Type:Location:24/04/2024KAWI111383Limited TermToowong- Work for an HRD Employer of Choice winner for 9 years in a row: 12 month fixed term contract:- Chinchilla location (work...

  • Consultant

    3 weeks ago

    Toowong, Australia Data#3 Limited Full time

    **Job Summary**: - This is an excellent opportunity to join the Transformation & Governance Practice at Business Aspect providing Business Analysis services to our clients. Date Listed: Job Ref: **Job Type**: **Location**: 22/11/2023 KEMI110973 Permanent Toowong - ** **Immediate Start**: - ** **HRD Employer of Choice**: - ** **WGEA Employer of Choice...

  • Application Packager

    5 days ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: Data#3 is currently seeking an experienced customer centric Patching & Compliance Engineer to work closely with our managed services team.Date Listed:Job Ref:Job Type:Location:31/08/2023LITO110607PermanentToowong- Join our high performing, and expanding Managed Services Team: Can be based in Brisbane/Sydney/Melbourne/Adelaide or Perth:- ...

  • Senior Software Engineer

    4 weeks ago

    Toowong, Australia Compare the Market Full time

    About the company This job ad is the universe’s way of telling you that you’re currently in the wrong job. Compare the Market, yep, the one with the meerkats, is a high-growth FinTech company on a transformational journey that is focused on designing, building, and delivering the very best home loan, energy, insurance and health comparison experience in...

  • Senior Software Engineer

    3 weeks ago

    Toowong, Australia Compare the Market Full time

    About the company This job ad is the universe’s way of telling you that you’re currently in the wrong job. Compare the Market, yep, the one with the meerkats, is a high-growth FinTech company on a transformational journey that is focused on designing, building, and delivering the very best home loan, energy, insurance and health comparison experience in...