data engineer - databricks

Halo Labs in Australia is seeking a hands-on Data Engineer to design, develop, and maintain reusable PySpark pipelines and standardised data engineering patterns across the SaaS platform. You will architect and implement scalable ETL/ELT processes on Azure and AWS, build data models, ensure data security and quality, and collaborate with software engineers...

University of New South Wales in Sydney, NSW is seeking a Data Engineer to design, build, and optimize enterprise data pipelines and data models. You will work within the Enterprise Data Office to deliver secure, scalable solutions and guide stakeholders on data platform capabilities.The role requires expertise in SQL, Python/PySpark, Azure Data Factory,...

Transport for NSW is seeking a hands-on Data Engineer to build and maintain a cloud-based data platform that underpins reporting, analytics, and decision-making for NSW infrastructure programs.You will design and implement data pipelines and models, ensure data quality and security, and contribute to DevOps and CI/CD practices while collaborating across...

Halo Labs in Australia is seeking a hands-on Data Engineer to design, develop, and maintain reusable PySpark pipelines and standardised data engineering patterns across the SaaS platform. You will architect and implement scalable ETL/ELT processes on Azure and AWS, build data models, ensure data security and quality, and collaborate with software engineers...

Halo Labs in Australia is seeking a hands-on Data Engineer to design, develop, and maintain reusable PySpark pipelines and standardised data engineering patterns across the SaaS platform. You will architect and implement scalable ETL/ELT processes on Azure and AWS, build data models, ensure data security and quality, and collaborate with software engineers...

Halo Labs in Australia is seeking a hands-on Data Engineer to design, develop, and maintain reusable PySpark pipelines and standardised data engineering patterns across the SaaS platform. You will architect and implement scalable ETL/ELT processes on Azure and AWS, build data models, ensure data security and quality, and collaborate with software engineers...

About UsAdaptiv is a Kiwi success story with a growing presence across Australia and New Zealand. We specialise in integration, data and analytics, AI consulting and cloud solutions, helping organisations modernise their technology environments and unlock greater value from their data.Our teams work with leading technologies including Databricks, Microsoft...

IT Alliance is seeking a Lead Data Engineer in Canberra, Australia, for a long-term contract. The role focuses on hands-on ETL/ELT development, Azure-based data engineering (ADF, Databricks, Data Lake), Spark optimization, and robust data delivery pipelines.The candidate will source data from Oracle/Ingres/Azure/SQL Server, prepare data using Parquet/Delta,...

Senior Data Engineer - Enterprise Data PlatformsWho We AreSimple Machines is a global, independent technology consultancy operating across Sydney, New Zealand, London, Poland and San Francisco. We design and build modern data platforms, intelligent systems, and bespoke software at the intersection of Data Engineering, Software Engineering and AI.We work with...

Accenture is seeking a Data Engineer to design, develop, and maintain data solutions across generation, collection, and processing. You will build data pipelines, ensure data quality, and lead ETL processes to migrate data across systems. You will act as an SME, collaborate with multiple teams, and guide junior engineers.The role emphasizes independent work,...

We're looking for a hands-on Data Engineer with strong experience building reliable, real-time data pipelines using Amazon Kinesis and Databricks . You'll work with modern AWS data technologies to develop and optimise streaming pipelines, moving high-volume data from Kinesis into the Databricks Lakehouse using Spark Structured Streaming and Delta tables....

We’re looking for a hands-on Data Engineer with strong experience building reliable, real-time data pipelines using Amazon Kinesis and Databricks.You’ll work with modern AWS data technologies to develop and optimise streaming pipelines, moving high-volume data from Kinesis into the Databricks Lakehouse using Spark Structured Streaming and Delta...

Accenture is seeking a hands-on Data Engineer in Melbourne to build reliable, real-time data pipelines using Amazon Kinesis and Databricks. You will move data from Kinesis to the Databricks Lakehouse via Spark Structured Streaming and Delta tables, optimizing for performance, latency, and cost.You will ingest streaming data into Delta tables, develop Python...

Jenny Barbour IT And Project Recruitment in Mulgrave VIC is seeking a Senior Data Engineer to design and deliver an enterprise data platform using Azure Databricks, SQL, DBT and Azure Data Factory. You will lead data architecture, build scalable pipelines and support analytics, reporting and AI initiatives across the business.The role requires strong...

Indigitise is seeking a Data Engineer to join our federal client’s Enterprise Analytics and Technology Services. The role focuses on ETL/ELT development, data products, and complex data visualisation across cloud data platforms. You will work in a hybrid Canberra setup with three in-office days weekly, promoting agile ceremonies and essential team...

XPT Software in Melbourne is seeking a Data Professional with 5+ years of hands-on experience in Power BI and Databricks. The role requires expert SQL development for data analysis, and familiarity with PL/SQL, UNIX shell scripting, Git, and Jenkins.A strong data warehousing background and AWS Databricks knowledge are highly valued. The ideal candidate will...

Whizdom is partnering with a leading global technology and consulting organisation delivering a major data and analytics transformation programme for a large Australian infrastructure client. They seek an experienced Data Engineer to join a modern data environment supporting enterprise analytics, forecasting and data science.The role involves designing and...

Job Description /n We’re looking for a hands-on Data Engineer with strong experience building reliable, real-time data pipelines using Amazon Kinesis and Databricks. /n You’ll work with modern AWS data technologies to develop and optimise streaming pipelines, moving high-volume data from Kinesis into the Databricks Lakehouse using Spark Structured...

Strata Community Insurance (SCI) is seeking a hands-on Data Engineer to design, build, and operate scalable data pipelines into its intelligence platform. You will shape data governance, lineage, and API integrations while supporting analytics, reporting, and ML initiatives.The role emphasizes delivering reliable, well-governed data solutions in a 12-month...

Whizdom is partnering with a leading global technology and consulting organisation delivering a major data and analytics transformation programme for a large Australian infrastructure client. They seek an experienced Data Engineer to join a modern data environment supporting enterprise analytics, forecasting and data science.The role involves designing and...