Senior Data Architect

4 days ago

Toowong, Queensland, Australia Compare the Market Full time
About Us

Compare the Market is a leading FinTech company that specializes in designing and delivering innovative solutions for the Australian market. Our mission is to simplify the process of making sound financial decisions for our customers.

The Role

We are seeking a highly skilled Senior Data Engineer to join our team in Toowong. As a Senior Data Engineer, you will play a pivotal role in shaping our data strategy and contributing to the development of our data platform and ecosystem.

Key Responsibilities
  • Design and develop robust, scalable, and high-performance data pipelines to process large volumes of data from heterogeneous sources.
  • Optimize data pipelines for performance, reliability, and scalability using best practices in data engineering.
  • Implement data models and schemas for efficient storage and retrieval of structured and unstructured data.
  • Collaborate with commercial and other teams to understand data requirements and translate them into technical solutions.
  • Collaborate with cross-functional teams to support data-driven decision-making and deliver actionable insights.
  • Partner with architects to devise architectural blueprints for data pipelines, emphasizing event-based real-time processing capabilities.
  • Advocate for best practices in data management and governance, encompassing data modelling, ETL efficiency, data quality assurance, observability, and discoverability, as well as security protocols for handling sensitive data and ensuring codebase quality.
  • Implement data governance processes and ensure data quality and integrity throughout the data lifecycle.
  • Provide operational support during the evaluation and integration of new tools and technologies to enhance data processing capabilities and improve workflow efficiency.
  • Mentor and provide technical guidance to junior members of the data engineering team.
Requirements
  • 5 years plus proven experience as a senior data engineer.
  • Extensive expertise in designing and developing ETL/ELT processes, data pipelines, and data lakehouse platforms.
  • Extensive experience as a professional data engineer, specializing in developing ETL pipelines for production environments.
  • Strong understanding of data architecture principles, data modeling, and schema design.
  • Proficiency in programming languages such as Python, Java, or Scala, and experience with SQL and NoSQL databases.
  • Hands-on experience with cloud platforms (e.g., AWS, Azure, GCP) and data technologies in a cloud environment.
  • Excellent problem-solving skills and ability to work independently as well as part of a team.
  • Strong communication skills with the ability to collaborate effectively with stakeholders across different functions.
  • Experience in Agile methodologies and familiarity with DevOps practices is a plus.
  • Demonstrated ability to provide data engineering leadership and mentorship to junior data engineers.
What We Offer

At Compare the Market, we offer a dynamic and collaborative work environment where your talents will be recognized and rewarded. You'll have the opportunity to make a meaningful impact and contribute to our continued success. As well as ample opportunities for growth and development, we also provide:

  • Vibrant and social community who have annual celebrations, family fun days and regular events.
  • Enjoy flexible work arrangements, including the option of one day working from home each week or a 9-day fortnight.
  • Enjoy additional leave days - 'ME' leave and 'Volunteer Day' leave.
  • Study support (up to 50% of tuition fees for relevant courses) and professional membership reimbursement.
  • Employee discounts on Car, Home, Travel insurance.
  • Income protection insurance provided to support you in the event of non-work-related illness or injury.
  • Discounts with a broad range of providers, including gym memberships, accommodation, dental care and more.
Equal Opportunity Employer

Compare the Market is an Equal Opportunity Employer, and we encourage all applicants to apply. We acknowledge that we are strengthened by diversity.

  • Senior Data Architect

    14 hours ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a leading FinTech company on a transformational journey, dedicated to delivering exceptional customer experiences in Australia and beyond.The RoleWe are seeking an experienced Senior Data Modeller to join our team, responsible for establishing strong data foundations and collaborating with stakeholders to understand data...

  • Enterprise Architect

    1 week ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    Job OpportunityAbout Data#3 LtdData#3 Ltd is a leading provider of digital and ICT solutions, with a strong presence in the Australian market. As a trusted advisor to our clients, we navigate complex business landscapes to architect and implement forward-thinking solutions in management and technology.Job SummaryWe are seeking an experienced Enterprise...

  • Enterprise Architect

    1 day ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    {"About Us": "At Data#3 Ltd, we navigate complex business landscapes to architect and implement forward-thinking solutions in management and technology. Our company has a formidable presence, marked by a $2.5 billion revenue in FY2023 and a robust team of over 1,400 professionals across Australia and Fiji, with a mission to deliver exceptional value and...

  • Senior Data Architect

    1 week ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a leading FinTech company that specializes in designing and delivering innovative solutions for the Australian market. Our mission is to simplify the process of making sound financial decisions for our customers.The RoleWe are seeking a highly skilled Senior Data Engineer to join our team in Toowong. As a Senior Data Engineer,...

  • Senior Data Engineer

    1 day ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a leading FinTech company on a transformational journey, focused on delivering innovative solutions for customers in Australia and beyond.The RoleWe are seeking a Senior Data Engineer to join our team in Toowong, who will play a pivotal role in shaping our data strategy and driving business growth through scalable data...

  • Senior Full Stack Developer

    1 day ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    About Data#3 LtdData#3 Ltd is a leading provider of digital transformation solutions, empowering businesses to succeed in a rapidly changing world.Job SummaryWe are seeking a highly skilled Senior Full Stack Developer to join our team. As a key member of our development team, you will be responsible for designing and developing innovative, scalable...

  • Senior Full Stack Developer

    1 week ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    About Data#3 LtdData#3 Ltd is a leading provider of digital transformation solutions, empowering businesses to thrive in the digital age. With a strong focus on innovation and collaboration, we're building the future of technology.Job SummaryWe're seeking a highly skilled Senior Full Stack Developer to join our team as a Technical Lead. As a key member of...

  • Cloud Architect

    2 months ago

    Toowong, Queensland, Australia Randstad Australia Full time

    Purpose of the Role:We are seeking a highly skilled and motivated Cloud Architect with a proven ability to transform technical requirements into detailed cloud infrastructure designs. This role demands both technical expertise and strong interpersonal skills to design effective solutions and communicate them clearly to all IT stakeholders.Position...

  • Senior Systems Engineer

    1 week ago

    Toowong, Queensland, Australia Data#3 Ltd Full time

    Job SummaryWe are seeking a highly skilled Senior Systems Engineer to join our Managed Services Team at Data#3 Ltd. As a key member of our team, you will be responsible for providing Level 3 operational support, installation, and configuration to our customer's systems, software, and infrastructure.Key ResponsibilitiesTechnical Support: Manage and resolve...

  • Lead Data Engineer

    14 hours ago

    Toowong, Queensland, Australia Compare the Market Full time

    About the RoleWe are seeking a highly skilled Lead Data Engineer to join our Enterprise Data Team at Compare the Market. As a key member of our team, you will be responsible for leading the design, development, and maintenance of robust data pipelines and cloud-based data solutions.Key ResponsibilitiesDesign and implement scalable and high-performance data...

  • Lead Business Solutions Architect

    1 week ago

    Toowong, Queensland, Australia Compare the Market Full time

    About the CompanyCompare the Market is a leading FinTech company that specializes in designing, building, and delivering innovative solutions for the Australian market. Our mission is to empower Australians to make informed decisions and save time, money, and stress.About the RoleWe are seeking a highly skilled and experienced Lead Business Solutions...

  • Senior Software Architect

    1 week ago

    Toowong, Queensland, Australia Compare the Market Full time

    About Our Company Compare the Market is a leading FinTech company on a transformational journey. We are focused on designing, building, and delivering the best home loan, energy, insurance, and health comparison experience in Australia. Our goal is to make a difference in the lives of Australians by simplifying the process of making sound financial...

  • Senior Software Architect

    4 days ago

    Toowong, Queensland, Australia Compare the Market Full time

    About Our Company Compare the Market is a leading FinTech company on a transformational journey. We are focused on designing, building, and delivering the very best home loan, energy, insurance, and health comparison experience in Australia. Our goal is to make a difference in the lives of Australians by simplifying the process of making sound financial...

  • Data Analyst

    4 days ago

    Toowong, Queensland, Australia Compare the Market Full time

    About UsCompare the Market is a leading FinTech company that specializes in designing, building, and delivering innovative comparison experiences for home loans, energy, insurance, and health services in Australia and globally.About the RoleWe are seeking a highly skilled Data Scientist to join our team and drive business growth through advanced analytics....

  • Senior Software Engineer

    1 day ago

    Toowong, Queensland, Australia Compare the Market Full time

    {"title": "Senior Software Engineer", "description": "About UsAt Compare the Market, we're on a mission to simplify the process of making sound financial decisions for Australians. We're a high-growth FinTech company that's transforming the way people compare and purchase home loans, energy, insurance, and health services.About the RoleWe're seeking an...

  • Senior Geospatial Pricing Analyst

    1 day ago

    Toowong, Queensland, Australia Auto & General Full time

    About the RoleThe Senior Geospatial Pricing Analyst will play a key role in supporting the Home pricing team and company by developing natural peril and geospatial pricing strategies using robust, accurate and timely data-driven analysis and insight.Key ResponsibilitiesDevelop and implement natural peril and geospatial pricing strategies using data analysis...

  • Senior Geospatial Pricing Analyst

    4 days ago

    Toowong, Queensland, Australia Auto & General Full time

    Job SummaryThe Senior Geospatial Pricing Analyst will support the Home pricing team and company by developing natural peril and geospatial pricing strategies using robust, accurate and timely data driven analysis and insight. This technical role supports the pricing and underwriting of our insurance products through data analysis, validation, and research of...

  • Senior Performance Media Manager

    1 day ago

    Toowong, Queensland, Australia Compare the Market Full time

    {"title": "Senior Performance Media Manager", "description": "About the RoleWe are seeking a skilled Senior Performance Media Manager to join our dynamic Digital Marketing team at Compare the Market. In this critical role, you will be responsible for the implementation, optimization, and reporting of all digital marketing activities, including SEM and...

  • Senior Data Scientist

    7 days ago

    Toowong, Queensland, Australia Auto & General Full time

    About the RoleWe are seeking a highly skilled Data Science Expert to join our team at Auto & General. As a key member of our Product division, you will be responsible for driving innovation and growth by leveraging artificial intelligence (AI) for insurance product development, pricing, and underwriting.Key ResponsibilitiesLead AI Solution Development:...

  • Senior MarTech Engineer

    1 day ago

    Toowong, Queensland, Australia Compare the Market Full time

    {"title": "Senior MarTech Engineer", "description": "About the RoleWe are seeking a highly skilled Senior MarTech Engineer to join our dynamic team at Compare the Market. As a key member of our MarTech team, you will be responsible for driving innovative solutions across our platforms, leveraging your expertise in digital analytics, marketing automation, and...