Senior Data Engineer

1 week ago

Toowong, Queensland, Australia Compare the Market Full time

About The company

This job ad is the universe's way of telling you that you're currently in the wrong job.

Compare the Market – yes, the one with the meerkats – is a high-growth FinTech company on a transformational journey. We are focused on designing, building, and delivering the very best home loan, energy, insurance, and health comparison experience in Australia. Okay, in the world

We are all about Integrity, Growth, Excellent Customer Service, and being Peerless – without compromise. These values are critical to delivering on our purpose: 'We honestly strive to empower Australians to make the best decisions, saving time, money, and stress.'

About The role:

Are you ready to take your career to new heights? Compare the Market is searching for a Senior Data Engineer to join our innovative team in Toowong. As we continue to evolve our modern data platform on Databricks/AWS, we're dedicated to delivering exceptional value through analytics. Reporting to the Head of Data Science, you'll have the unique opportunity to establish foundational engineering principles and provide technical leadership across business intelligence, data science, and machine learning initiatives.

As a Senior Data Engineer, your expertise extends beyond hands-on development to include guiding architecture and solution design. You'll play a pivotal role in shaping our data strategy from an engineering perspective, contributing to the development of our data platform and ecosystem. Supported by a collaborative team including data scientists, business intelligence developers, data architects, and more, you'll collaborate closely with IT and business teams to drive innovation and excellence.

What You'll Do:

  • Collaborate with data producers, consumers, and support teams to ensure efficient data management for consumption purposes.
  • Design, maintain, and enhance top-tier data pipelines to cater to various analytics use-cases such as business intelligence and machine learning.
  • Partner with architects to devise architectural blueprints for data pipelines, emphasizing event-based real-time processing capabilities.
  • Assist in crafting and executing the data engineering roadmap, aligning it with organisational goals and objectives.
  • Advocate for best practices in data management and governance, encompassing data modelling, ETL efficiency, data quality assurance, observability, and discoverability, as well as security protocols for handling sensitive data and ensuring codebase quality.

What You'll Bring:

  • Extensive experience as a professional data engineer or analytics engineer, specialising in developing ETL pipelines for production environments.
  • Strong background in building analytical data pipelines within cloud systems.
  • Proficiency in data management practices including data modelling, data quality monitoring, maintaining data dictionaries, row/column level security, sensitive data masking or tokenization, and access controls.
  • Ability to write high-quality code for data pipelines, with a preference for Python.
  • Excellent SQL skills.
  • Experience with CI/CD and Infrastructure as Code builds.
  • Demonstrated ability to provide data engineering leadership and mentorship.
  • Experience developing on Databricks and/or using Spark or PySpark, building robust feature stores with batch and streaming data for machine learning models, and creating highly automated metadata-driven solutions will be highly regarded.

Our Benefits

At Compare the Market, we offer a dynamic and collaborative work environment where your talents will be recognised and rewarded. You'll have the opportunity to make a meaningful impact and contribute to our continued success. As well as ample opportunities for growth and development, we also provide:

  • Vibrant and social community who have annual celebrations, family fun days and regular events.
  • Enjoy flexible work arrangements, including the option of one day working from home each week or a 9-day fortnight.
  • Enjoy additional leave days - 'ME' leave and 'Volunteer Day' leave.
  • Study support (up to 50% of tuition fees for relevant courses) and professional membership reimbursement.
  • Employee discounts on Car, Home, Travel insurance.
  • Income protection insurance provided to support you in the event of non-work-related illness or injury.
  • Discounts with a broad range of providers, including gym memberships, accommodation, dental care and more.
  • Access to the Employee Assistance Program

Compare the Market is an Equal Opportunity Employer, and we encourage all applicants to apply. We acknowledge that we are strengthened by diversity.

Want to know more? Then apply now It's Simples

Please note that this role is only available to candidates with unlimited Australian working rights, as sponsorship is not available.

*Note to Recruiters: We politely ask that you avoid making any approaches or sending any unsolicited resumes to our Recruitment Team or Hiring Leaders across our business.

#LI-DNI

  • Senior Data Engineer

    1 week ago

    Toowong, Queensland, Australia Compare the Market Full time

    #S-DNI About the Company Compare the Market, yep, the one with the meerkats, is on an exciting growth trajectory and we are inviting talented Senior Data Engineers to join us in making a significant impact on the lives of people all over Australia. At CTM, you won't just be an employee; you'll be a crucial part of our mission to empower our customers to...

  • Senior Systems Engineer

    1 week ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    Job Description Azure DevOps EngineerJoin Microsoft's largest Australian PartnerHRD Employer of Choice and Great Place to WorkBrisbane, Sydney or Melbourne Based - Hybrid WorkingAs an Azure DevOps Engineer you will work across multiple organisations, managing the latest technologies. The work is interesting, challenging and you get to work with an...

  • Manager Engineering

    1 week ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: Data#3 is seeking an experienced Engineering Manager to join our high performing National Managed Services team.Date Listed:Job Ref:Job Type:Location:30/04/2024KAWI111556PermanentToowong- Join our high performing Managed Services Team: Become part of one of Australia fastest growing MSPs:- Can be based in Brisbane/Sydney/Melbourne or Adelaide:...

  • Manager Engineering

    1 week ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: Data#3 is seeking an experienced leader to join us as an Engineering Manager within our high performing and expanding Managed Services team.Date Listed:Job Ref:Job Type:Location:6/03/2023KAWI109850PermanentToowong- Join our high performing Managed Services Team: Become part of one of Australia fastest growing MSPs:- Can be based in...

  • Senior Accountant

    1 week ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    Job DescriptionASX200 Listed IT Services and Solutions CompanyBrisbane HeadquartersHRD Employer of Choice, Accredited Family Inclusive WorkplaceAbout the jobThis is an exceptional opportunity to have impact, ensuring Data#3's accounting, financial and operating reporting accurately reflects the conditions of the business and generating reliable information...

  • Desktop Support Analyst

    1 week ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: Data#3 is seeking a proactive and experienced Desktop Support Analyst to join our high performing team on a 3 year full time contract.Date Listed:Job Ref:Job Type:Location:2/02/2023KAWI109688Limited TermToowongData#3 is seeking a proactive and experienced Desktop Support Analyst to join our high performing team on a 3 year full time contract, to...

  • Senior Software Engineer

    1 week ago

    Toowong, Queensland, Australia Compare the Market Full time

    About the company This job ad is the universe's way of telling you that you're currently in the wrong job. Compare the Market, yep, the one with the meerkats, is a high-growth FinTech company on a transformational journey that is focused on designing, building, and delivering the very best home loan, energy, insurance and health comparison experience in...

  • Senior Software Engineer

    1 week ago

    Toowong, Queensland, Australia Compare the Market Full time

    About The Company This job ad is the universe's way of telling you that you're currently in the wrong job. Compare the Market – yes, the one with the meerkats – is a high-growth FinTech company on a transformational journey. We are focused on designing, building, and delivering the very best home loan, energy, insurance, and health comparison experience...

  • Desktop Support Analyst

    1 week ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: We are seeking a proactive and experienced Desktop Support Analyst to join our high performing team based in Ormeau (Gold Coast).Date Listed:Job Ref:Job Type:Location:9/11/2023KAWI110910Limited TermToowong- Work for an HRD Employer of Choice winner for 8 years in a row: 12 month fixed term contract:- Ormeau office location (Gold Coast)Who is...

  • Desktop Support Analyst

    1 week ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: We are seeking a proactive and experienced Desktop Support Analyst to join our high performing team based with our client onsite in Chinchilla.Date Listed:Job Ref:Job Type:Location:24/04/2024KAWI111383Limited TermToowong- Work for an HRD Employer of Choice winner for 9 years in a row: 12 month fixed term contract:- Chinchilla location (work...

  • Senior DevOps Engineer

    1 week ago

    Toowong, Queensland, Australia Compare the Market Full time

    About the company This job ad is the universe's way of telling you that you're currently in the wrong job. Compare the Market, yep, the one with the meerkats, is a high-growth FinTech company on a transformational journey that is focused on designing, building, and delivering the very best home loan, energy, insurance and health comparison experience in...

  • Application Packager

    1 week ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: Data#3 is currently seeking an experienced customer centric Patching & Compliance Engineer to work closely with our managed services team.Date Listed:Job Ref:Job Type:Location:31/08/2023LITO110607PermanentToowong- Join our high performing, and expanding Managed Services Team: Can be based in Brisbane/Sydney/Melbourne/Adelaide or Perth:- ...

  • Data Analyst

    1 week ago

    Toowong, Queensland, Australia Compare the Market Full time

    #S-DNI About the Company Compare the Market, yep, the one with the meerkats, is a high-growth FinTech company on a transformational journey that is focused on designing, building, and delivering the very best money, home loan, energy, insurance and health comparison and fulfilment product solutions in Australia. Okay, in the world So, do you love working...

  • Data Analyst

    1 week ago

    Toowong, Queensland, Australia Auto & General Insurance Full time

    **#S-DNIAbout the CompanyCompare the Market, yep, the one with the meerkats, is a high-growth FinTech company on a transformational journey that is focused on designing, building, and delivering the very best money, home loan, energy, insurance and health comparison and fulfilment product solutions in Australia. Okay, in the worldSo, do you love working with...

  • Senior Network Engineer

    1 week ago

    Toowong, Queensland, Australia Auto & General Full time

    purpose of the roleThe Senior Network Engineer is responsible for the support & ongoing maintenance of the Auto and General network. You will be responsible for maintaining & upkeep of the network systems, playing role in network transformation projects and supporting other team members in a complex enterprise environment. Qualifications & experience...

  • Consultant

    1 week ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: This is an excellent opportunity to join the Transformation & Governance Practice at Business Aspect providing Business Analysis services to our clients.Date Listed:Job Ref:Job Type:Location:22/11/2023KEMI110973PermanentToowong- Immediate Start**:- HRD Employer of Choice**: WGEA Employer of Choice for Gender Equality**This is an excellent...

  • Data Scientist

    1 week ago

    Toowong, Queensland, Australia Compare the Market Full time

    About The company This job ad is the universe's way of telling you that you're currently in the wrong job. Compare the Market – yes, the one with the meerkats – is a high-growth FinTech company on a transformational journey. We are focused on designing, building, and delivering the very best home loan, energy, insurance, and health comparison experience...

  • HR Business Advisor

    1 week ago

    Toowong, Queensland, Australia Data#3 Limited Full time

    Job Summary: We are looking for an experienced HR Adviser to join our people focussed team. Role can be based in Melbourne or BrisbaneDate Listed:Job Ref:Job Type:Location:3/08/2023LITO110499PermanentToowong- Work for HRD's Employer of Choice winner for 8 years in a row: Join a company with HEART -:- Flexible working with WFH optionsOur CultureData#3's...

  • Principal Consultant

    1 week ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    Job Description Elevate Your Career in a Pioneering ConsultancyJoin a leading Information Management and Analytics practice within an ASX200-listed company. An HRD Employer of Choice, one of Australia's Best Workplaces in Technology by Great Place To Work in 2024 and a WGEA Employer of Choice for Gender Equality. Seize this unparalleled opportunity to lead,...

  • Marketing Specialist

    1 week ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    Job DescriptionHRD Employer of Choice and Great Place to WorkWork with world-class vendor partnersLocation Brisbane, Melbourne or SydneyThe award-winning Data#3 Marketing Team has an exciting opportunity for a Marketing Specialist who has a genuine passion for tech to join our Business Marketing team. You'll design, develop and deliver a wide variety of...