Senior Data Engineer

1 day ago

Toowong, Queensland, Australia Compare the Market Full time
About Us

Compare the Market is a leading FinTech company on a transformational journey, focused on designing, building, and delivering innovative comparison experiences for home loans, energy, insurance, and health in Australia and beyond.

About the Role

We are seeking a Senior Data Engineer to join our innovative team in Toowong, driving the development of our modern data platform on Databricks/AWS. As a key member of our data engineering team, you will play a pivotal role in shaping our data strategy, contributing to the development of our data platform and ecosystem.

Key Responsibilities
  • Design and develop robust, scalable, and high-performance data pipelines to process large volumes of data from heterogeneous sources.
  • Optimise data pipelines for performance, reliability, and scalability using best practices in data engineering.
  • Implement data models and schemas for efficient storage and retrieval of structured and unstructured data.
  • Collaborate with commercial and other teams to understand data requirements and translate them into technical solutions.
  • Collaborate with cross-functional teams to support data-driven decision-making and deliver actionable insights.
  • Partner with architects to devise architectural blueprints for data pipelines, emphasising event-based real-time processing capabilities.
  • Advocate for best practices in data management and governance, encompassing data modelling, ETL efficiency, data quality assurance, observability, and discoverability, as well as security protocols for handling sensitive data and ensuring codebase quality.
  • Implement data governance processes and ensure data quality and integrity throughout the data lifecycle.
  • Provide operational support during the evaluation and integration of new tools and technologies to enhance data processing capabilities and improve workflow efficiency.
  • Mentor and provide technical guidance to junior members of the data engineering team.
What You'll Bring
  • 5 years plus proven experience as a senior data engineer.
  • Extensive expertise in designing and developing ETL/ELT processes, data pipelines, and data lakehouse platforms.
  • Extensive experience as a professional data engineer, specialising in developing ETL pipelines for production environments.
  • Strong understanding of data architecture principles, data modeling, and schema design.
  • Proficiency in programming languages such as Python, Java, or Scala, and experience with SQL and NoSQL databases.
  • Hands-on experience with cloud platforms (e.g., AWS, Azure, GCP) and data technologies in a cloud environment.
  • Excellent problem-solving skills and ability to work independently as well as part of a team.
  • Strong communication skills with the ability to collaborate effectively with stakeholders across different functions.
  • Experience in Agile methodologies and familiarity with DevOps practices is a plus.
  • Demonstrated ability to provide data engineering leadership and mentorship to junior data engineers.
Our Benefits

At Compare the Market, we offer a dynamic and collaborative work environment where your talents will be recognised and rewarded. You'll have the opportunity to make a meaningful impact and contribute to our continued success. As well as ample opportunities for growth and development, we also provide:

  • Vibrant and social community who have annual celebrations, family fun days and regular events.
  • Enjoy flexible work arrangements, including the option of one day working from home each week or a 9-day fortnight.
  • Enjoy additional leave days - 'ME' leave and 'Volunteer Day' leave.
  • Study support (up to 50% of tuition fees for relevant courses) and professional membership reimbursement.
  • Employee discounts on Car, Home, Travel insurance.
  • Income protection insurance provided to support you in the event of non-work-related illness or injury.
  • Discounts with a broad range of providers, including gym memberships, accommodation, dental care and more.
Equal Opportunity Employer

Compare the Market is an Equal Opportunity Employer, and we encourage all applicants to apply. We acknowledge that we are strengthened by diversity.

  • Senior Data Engineer

    7 days ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a leading FinTech company on a transformational journey, focused on delivering innovative solutions for Australians. Our mission is to simplify the process of making sound financial decisions.The RoleWe are seeking a Senior Data Engineer to join our team in Toowong. As a key member of our data engineering team, you will be...

  • Senior Data Engineer

    1 week ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a leading FinTech company on a transformational journey, focused on delivering innovative solutions for customers in Australia and beyond.The RoleWe are seeking a Senior Data Engineer to join our team in Toowong, who will play a pivotal role in shaping our data strategy and driving business growth through scalable data...

  • Senior Data Engineer

    4 days ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a high-growth FinTech company on a transformational journey, focused on designing, building, and delivering the best home loan, energy, insurance, and health comparison experience in Australia.About the RoleWe are seeking a Senior Data Engineer to join our innovative team in Toowong, reporting to the Head of Data Science. As a...

  • Senior Systems Engineer

    2 weeks ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    Job SummaryWe are seeking a highly skilled Senior Systems Engineer to join our Managed Services Team at Data#3 Ltd. As a key member of our team, you will be responsible for providing Level 3 operational support, installation, and configuration to our customer's systems, software, and infrastructure.Key ResponsibilitiesTechnical Support: Manage and resolve...

  • Senior Data Architect

    2 weeks ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a leading FinTech company that specializes in designing and delivering innovative solutions for the Australian market. Our mission is to simplify the process of making sound financial decisions for our customers.The RoleWe are seeking a highly skilled Senior Data Engineer to join our team in Toowong. As a Senior Data Engineer,...

  • Senior Data Architect

    2 weeks ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a leading FinTech company that specializes in designing and delivering innovative solutions for the Australian market. Our mission is to simplify the process of making sound financial decisions for our customers.The RoleWe are seeking a highly skilled Senior Data Engineer to join our team in Toowong. As a Senior Data Engineer,...

  • Senior Data Architect

    4 days ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a leading FinTech company on a transformational journey, focused on delivering exceptional customer experiences through innovative comparison services.The RoleWe are seeking an experienced Senior Data Modeller to join our dedicated team, responsible for establishing strong data foundations by collaborating with stakeholders to...

  • Senior Data Architect

    6 days ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a leading FinTech company on a transformational journey, dedicated to delivering exceptional customer experiences in Australia and beyond.The RoleWe are seeking an experienced Senior Data Modeller to join our team, responsible for establishing strong data foundations and collaborating with stakeholders to understand data...

  • Senior Data Architect

    1 week ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a leading FinTech company on a transformational journey, dedicated to delivering exceptional customer experiences in Australia and beyond.The RoleWe are seeking an experienced Senior Data Modeller to join our team, responsible for establishing strong data foundations and collaborating with stakeholders to understand data...

  • Lead Data Engineer

    1 week ago

    Toowong, Queensland, Australia Compare the Market Full time

    About the RoleWe are seeking a highly skilled Lead Data Engineer to join our Enterprise Data Team at Compare the Market. As a key member of our team, you will be responsible for leading the design, development, and maintenance of robust data pipelines and cloud-based data solutions.Key ResponsibilitiesDesign and implement scalable and high-performance data...

  • Senior MarTech Engineer

    1 week ago

    Toowong, Queensland, Australia Compare the Market Full time

    {"title": "Senior MarTech Engineer", "description": "About the RoleWe are seeking a highly skilled Senior MarTech Engineer to join our dynamic team at Compare the Market. As a key member of our MarTech team, you will be responsible for driving innovative solutions across our platforms, leveraging your expertise in digital analytics, marketing automation, and...

  • Senior Full Stack Developer

    1 week ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    About Data#3 LtdData#3 Ltd is a leading provider of digital transformation solutions, empowering businesses to succeed in a rapidly changing world.Job SummaryWe are seeking a highly skilled Senior Full Stack Developer to join our team. As a key member of our development team, you will be responsible for designing and developing innovative, scalable...

  • Senior Data Scientist

    4 days ago

    Toowong, Queensland, Australia Auto & General Full time

    Drive Innovation and Growth with Auto & GeneralAt Auto & General, we're committed to leveraging artificial intelligence and machine learning to drive innovation and growth in the insurance industry. As a Senior Data Scientist, you'll play a key role in developing and deploying AI solutions that enhance customer experiences and drive business outcomes.Key...

  • Senior Full Stack Developer

    2 weeks ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    About Data#3 LtdData#3 Ltd is a leading provider of digital transformation solutions, empowering businesses to thrive in the digital age. With a strong focus on innovation and collaboration, we're building the future of technology.Job SummaryWe're seeking a highly skilled Senior Full Stack Developer to join our team as a Technical Lead. As a key member of...

  • Senior Digital Transformation Engineer

    2 weeks ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a leading FinTech company on a mission to simplify the process of making sound financial decisions for Australians. We are a high-growth organisation focused on designing, building, and delivering innovative solutions for home loan, energy, insurance, and health comparison experiences.About the RoleWe are seeking a talented...

  • Data Analyst

    2 weeks ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a leading FinTech company that specializes in designing, building, and delivering innovative comparison experiences for home loans, energy, insurance, and health services in Australia and globally.About the RoleWe are seeking a highly skilled Data Scientist to join our team and drive business growth through advanced analytics....

  • Data Scientist

    5 days ago

    Toowong, Queensland, Australia Compare the Market Full time

    {"title": "Data Scientist Role", "description": "About UsCompare the Market is a high-growth FinTech company on a transformational journey. We are focused on designing, building, and delivering the very best home loan, energy, insurance, and health comparison experience in Australia. Okay, in the worldAbout the RoleWe are seeking a skilled Data Scientist to...

  • Senior DevOps Engineer

    1 week ago

    Toowong, Queensland, Australia Auto & General Full time

    About the RoleWe are seeking a highly skilled Senior DevOps Engineer to join our team at Auto & General. As a key member of our Cloud Services team, you will be responsible for designing, implementing, and enhancing tooling and processes to automate the deployment of software development and Infrastructure as Code across our organization.Key...

  • Data Scientist

    4 days ago

    Toowong, Queensland, Australia Compare the Market Full time

    {"title": "Data Scientist Role", "description": "About Compare the MarketWe are a high-growth FinTech company on a transformational journey, focused on designing, building, and delivering the best home loan, energy, insurance, and health comparison experience in Australia. Okay, in the world.We are all about Integrity, Growth, Excellent Customer Service, and...

  • Data Analyst

    2 weeks ago

    Toowong, Queensland, Australia Auto & General Full time

    About the RoleWe are seeking a highly skilled Data Scientist to join our team at Auto & General. As a key member of our Product division, you will play a critical role in driving innovation and growth through the application of artificial intelligence (AI) and machine learning techniques.Key ResponsibilitiesDesign and Develop AI Solutions: Contribute to the...