Data Engineer | Cloud, Databricks

3 weeks ago


Council of the City of Sydney, Australia DyFlex Pty Ltd Full time

About the Role

As a Data Engineer, you will design, build, and optimise enterprise-scale data solutions, helping our clients unlock the value of their data and accelerate performance. This role blends hands-on technical delivery with client-facing consulting, giving you the opportunity to shape scalable solutions using Databricks, cloud platforms, and modern data engineering practices. You’ll play a key role in building DyFlex’s emerging Data and AI capability, ensuring our clients achieve meaningful business outcomes through innovative data solutions.

Your tasks and responsibilities

- Build and maintain scalable data pipelines for ingesting, transforming, and delivering data
- Manage and optimise databases, warehouses, and cloud storage solutions
- Implement data quality frameworks and testing processes to ensure reliable systems
- Design and deliver cloud-based solutions (AWS, Azure, or GCP)
- Take technical ownership of project components and lead small development teams
- Engage directly with clients, translating business requirements into technical solutions
- Champion best practices including version control, CI/CD, and infrastructure as code

Your qualifications and experience

- Hands-on data engineering experience in production environments
- Strong proficiency in Python and SQL; experience with at least one additional language (e.g. Java, Typescript/Javascript)
- Experience with modern frameworks such as Apache Spark, Airflow, dbt, Kafka, or Flink
- Background in building ML pipelines, MLOps practices, or feature stores is highly valued
- Proven expertise in relational databases, data modelling, and query optimisation
- Demonstrated ability to solve complex technical problems independently
- Excellent communication skills with ability to engage clients and stakeholders
- Degree in Computer Science, Engineering, Data Science, Mathematics, or a related field

What we offer

- Work with SAP’s latest technologies on cloud as S/4HANA, BTP and Joule, plus Databricks, ML/AI tools and cloud platforms
- A flexible and supportive work environment including work from home
- Competitive remuneration and benefits including novated lease, birthday leave, remote working, additional purchased leave, and company-provided laptop
- Comprehensive training budget and paid certifications (Databricks, SAP, cloud platforms)
- Structured career advancement pathways with mentoring from senior engineers
- Exposure to diverse industries and client environments

Join a renowned organisation delivering projects to some of Australia’s leading enterprises

DyFlex is committed to providing a safe, flexible and respectful environment for staff free from all forms of discrimination, bullying and harassment. We are proud of our diverse and inclusive team as only together we can continually improve ourselves and achieve best outcomes for our customers– we are the region's leading SAP Platinum Partner

Please note that we can’t offer sponsorship for this role and we expect a clear statement about your legal rights in Australia, especially if you are applying from overseas.

#J-18808-Ljbffr



  • City of Brisbane, Australia Databricks Inc. Full time

    Manager, Field Engineering As a Manager, Field Engineering (Solutions Architects), you will build and lead a team of pre‑sales Solutions Architects focusing on your assigned accounts. Your experience partnering with the sales organisation will help close revenue with the right approach whilst coaching new sales and pre‑sales team members to work...


  • Council of the City of Sydney, Australia Databricks Inc. Full time

    Overview Culture Benefits Diversity Engineering Research Students & new grads Back to search results Sr. Resident Solutions Architect, ML & GenAI Sydney, Australia While candidates in Sydney are encouraged for this role, candidates in Melbourne, Brisbane and Perth will be considered. As a Machine Learning / GenAI Resident Solutions Architect (RSA) in our...


  • City of Melbourne, Australia ClearCompany Full time

    About the company A global consulting and technology partner delivering complex data and cloud programs for enterprise and public sector clients. Teams combine engineering depth with practical delivery, and operate in a culture that values clear thinking, collaboration, and continuous learning. What you’ll do - Design and implement a modern Azure...


  • City of Melbourne, Australia ClearCompany Full time

    We are seeking an experienced Data & Analytics Delivery Lead / Technical Project Manager to drive the successful delivery of Databricks programs. The ideal candidate will bring a strong track record of leading large-scale data platform initiatives—particularly migrations from SQL Server and CRM systems into Databricks—and possess both technical expertise...

  • Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Data#3 Full time $120,000 - $150,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...


  • City of Melbourne, Australia Databricks Inc. Full time

    As a Machine Learning / GenAI Resident Solutions Architect (RSA) in our Professional Services team you will work with clients on short to medium term customer engagements on their ML & AI challenges using the Databricks Data Intelligent platform. You will provide data science, and cloud technology projects which require integrating with client systems,...


  • Sydney, New South Wales, Australia UCentric Full time $120,000 - $200,000 per year

    Databricks ArchitectLocation: Flexible / Hybrid (Sydney preferred)Client: Global Technology ConsultancyOur clientOur client is a rapidly growing global technology consultancy specialising in cloud, data, and digital transformation. They partner with leading enterprises to deliver high-impact, scalable data solutions that drive business outcomes. With a...


  • Sydney, Australia Novon Full time

    **Permanent competitive salary**: - **Hybrid**: - **Great opportunity for upskilling and growth** Join Novon, a dynamic data consultancy dedicated to the growth and development of our team members through engaging experiences with renowned clients and collaborative teamwork. This is an exciting opportunity for a Databricks Administrator to enhance our...


  • Council of the City of Sydney, Australia Deputy Full time

    Deputy is a global SaaS remote‑first workforce management company with hubs in Sydney, Melbourne, San Francisco and London, plus team members working remotely across the United States. Our platform serves over 1.5 million workers and 375,000 workplaces across 100+ countries. We are backed by top global investors and recently achieved Unicorn status. At...


  • City of Melbourne, Australia Databricks Inc. Full time

    At Databricks, our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a user-friendly...