Data Engineering Lead

3 weeks ago

Sydney, New South Wales, Australia Qantas Full time

Senior Software Engineer

At Qantas, we're looking for an experienced Senior Software Engineer to join our Data and Streaming Analytics team. This is a permanent role based at our Mascot head office, with hybrid working options available.

As a Senior Software Engineer in our Data and Streaming Analytics team, you will be responsible for guiding the architecture, delivery, and development of software systems that power our business unit.

We're seeking a highly skilled software developer with experience in coding and mentoring technical team members to deliver high-quality, well-designed software. You'll be embedded in our Airline Technology team, supporting bespoke applications used daily by our digital customers and business operational teams.

Key responsibilities include ensuring scalability, reliability, and performance; deploying and configuring Kafka and Confluent components; implementing security best practices, and collaborating closely with development teams.

You'll have:

  • 8+ years of experience as a professional software engineer
  • 3+ years of experience in Kafka (Confluent certified Kafka Developer or Administrator)
  • Experience with Confluent Kafka components like Cloud Kafka, Schema Registry, Kafka Connect, and KSQLDB
  • Proficiency in Java for building Kafka producers and consumers
  • Strong skills in Bash scripting for automation and system tasks
  • Strong knowledge of Terraform for infrastructure provisioning
  • Familiarity with GitHub Actions for CI/CD pipelines
  • Experience deploying and managing Kafka, Kafka Connect, and KSQLDB
  • Strong knowledge of Kubernetes and AWS Infrastructure
  • Leadership qualities and an approachable attitude to educate, mentor, and lead engineering teams
  • Excellent communication skills for collaborating with stakeholders and communicating with various audiences
  • Proficiency in Linux system administration
  • Skills in optimizing Kafka performance, resource management, and troubleshooting
  • Experience with monitoring tools like Datadog
  • Understanding of Kafka security best practices, including encryption and authentication

Estimated salary range for this position is AU$140,000 - AU$180,000 per year, depending on your level of experience and qualifications.

We offer a range of benefits, including:

  • Discounted air travel within Australia and across the globe
  • Flexible leave options, including 18 weeks paid parental leave
  • Access to thousands of rewards through our partnerships
  • Support for your wellbeing, including mental health resources and nutrition planning

  • Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    Drive Business Value with Data Engineering at Domain GroupWe are seeking a skilled Data Engineer to join our Data Decision Science team in Sydney. As a key member of our data department, you will play a critical role in building scalable data pipelines that power Australia's property market.About the RoleThis is an exciting opportunity to work with...

  • Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    About UsWe shine a light on the property market, simplifying the journey for all involved. Our expertise and exclusive data drive change. At Domain Group, our data department leads the way in driving value across the organisation.The RoleAs a Senior Data Engineer, you'll play a key role in building data pipelines that power Australia's property market....

  • Data Property Solutions Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Data-Property Data Solns Shared Full time

    We are seeking a highly skilled Solutions Data Engineer to join our team at Data-Property Data Solns Shared. As a Senior member of our organization, you will play a critical role in shaping the future of property data solutions.About UsWe shine a light on all things property, aiming to simplify the property journey for all involved. Our business is motivated...

  • Senior Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data-Property Data Solns Shared Full time

    We are seeking a highly skilled Senior Data Engineer to join our team at Data-Property Data Solutions Shared. This is an exciting opportunity for a seasoned professional to lead the development of cutting-edge data solutions and drive business growth.About UsOur company specializes in simplifying the property journey for all stakeholders, leveraging our...

  • Data Engineer for Property Insights

    3 weeks ago

    Sydney, New South Wales, Australia Data-Property Data Solns Shared Full time

    We are seeking a highly skilled Senior Data Engineer to join our Single View Property (SVP) team at Domain. This role is perfect for someone who thrives in a dynamic environment and has a passion for working with data to drive business outcomes.

  • Data Centre Design Engineer Position

    3 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Established in 2007, our company has grown to become the largest provider of co-location, containerised and hyperscale compute environments with high-speed carrier-grade networks connecting all campuses.We are committed to creating an...

  • Data Engineering Lead

    1 month ago

    Sydney, New South Wales, Australia Correlate Resources Full time

    Correlate Resources is seeking a seasoned Data Engineering Lead to join their team in Australia. This is a high-profile opportunity to work with a reputable brand and contribute to building a 'best in class' data-driven operation.Key Responsibilities:Lead the design, development, and optimisation of back-end NoSQL and Python-related data platforms for...

  • Senior Data Engineer

    1 month ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    About CDC Data CentresWe are a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.Our mission is to attract, retain and grow the world's best data centre team by creating an inclusive workplace that promotes and values diversity.About the RoleWe are seeking a highly skilled Senior Data Engineer to design,...

  • Data Engineering Leader

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading provider of sovereign and secure data centre facilities in Australia.We are passionate about creating an inclusive workplace that promotes diversity and values individual experiences. Our mission is to attract, retain, and grow the world's best data centre team.Our team is dedicated to delivering meaningful benefits for...

  • Data Engineering Expert

    2 weeks ago

    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    About UsWe shine a light on all things property, simplifying the journey for everyone involved. Our expertise and exclusive data drive value across the organisation.Role OverviewThis is an exciting opportunity to make your mark in data engineering at Domain Group's Data Decision Science team. You'll play a key role in building data pipelines that power...

  • Data Engineering Lead

    2 weeks ago

    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time

    Transformative Opportunity at Commonwealth Bank of AustraliaWe are seeking an exceptional Data Engineering Lead to join our Financial Services Technology – Finance domain, driving the delivery of digital era-experiences that are simple, smart and secure. As part of our 3 Lines of Assurance (3LOA) Crew, you will play a pivotal role in expanding and...

  • Data Engineering Lead

    2 weeks ago

    Sydney, New South Wales, Australia Quantexa Full time

    At Quantexa, we're innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, tackling serious criminal activity, and now its potential is virtually limitless. This role offers a unique opportunity to drive innovation and growth in our Delivery team.As a Technical Lead, you'll play a key part in bringing context to...

  • Data Engineering Team Lead

    2 weeks ago

    Sydney, New South Wales, Australia Pathway Search Full time

    **Job Title:** Data Engineering Team Lead**Company Overview:Pathway Search is a leading provider of innovative solutions, seeking an experienced Data Engineering Team Lead to drive our data engineering team.We're looking for a strategic leader who can develop and execute a data roadmap, overseeing the design of our data team and leveraging AWS Redshift to...

  • Data Engineering Lead

    3 weeks ago

    Sydney, New South Wales, Australia Lendi Group Full time

    Company OverviewLendi Group is a leading Australian retail mortgage broker with a loan book exceeding $70 billion. The company has experienced record growth while adapting to the changing world and has bold ambitions to revolutionize the way Australians experience property buying.We are committed to fostering an environment where our team members feel valued...

  • Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia. Established in 2007, we provide diversified operations with secure data centre configurations that support co-location, containerised and hyperscale compute environments.Job DescriptionWe are seeking a highly skilled Senior Data Engineer to...

  • Data Platform Engineering Lead

    4 weeks ago

    Sydney, New South Wales, Australia The Iconic Full time

    Unlock Your Potential as a Data Platform EngineerWe are seeking an exceptional Data Platform Engineering Lead to join our dynamic team at THE ICONIC. As a key member of our data engineering group, you will play a vital role in shaping the future of our data platforms.About UsTHE ICONIC is a leading fashion e-commerce destination in Australia and New Zealand....

  • Data Engineering Team Lead

    4 weeks ago

    Sydney, New South Wales, Australia Firesoft People Full time

    Firesoft People is heavily investing in its Product and Technology data team to make data a competitive advantage. This has led to the creation of two new roles for Data Engineering Team Leads who will lead separate Data Engineering teams.This position involves leading, coaching, and mentoring Data Engineers, driving data product strategy with peers in...

  • Data Engineering Team Lead

    2 weeks ago

    Sydney, New South Wales, Australia Firesoft People Full time

    Firesoft People is investing heavily in its Product and Technology data team to maintain a competitive advantage. As an Engineering Manager at Firesoft People, you will lead, coach, and mentor Data Engineers, help drive data product strategy with peers in product management and business stakeholders to build great data products, and reduce the complexity of...

  • Data Engineering Lead

    3 weeks ago

    Sydney, New South Wales, Australia NCS Australia Full time

    About NCS AustraliaNCS Australia is a technology services company that believes in doing things better. We are committed to quality, people-focused, and willing to challenge traditional thinking. Our team brings this belief to life by partnering with our clients and communities to create a better tomorrow.We prioritize innovation, collaboration, and...

  • Lead Data Engineering Specialist

    2 weeks ago

    Sydney, New South Wales, Australia Correlate Resources Full time

    Drive business growth by leading a high-performing data engineering team. This exciting opportunity is with Correlate Resources, an industry-leading brand in the Insurance sector.Detailed Job DescriptionWe are seeking an experienced Head of Data Engineering to develop and implement scalable cloud-based data pipelines.About the RoleAs a key member of our...