scala

Data Engineer with using Apache Spark, Python, Scala.Location: MelbournePosition Type: Contract Data Engineer As a Data Engineer, you will be responsible for designing, developing, and maintaining robust data infrastructure and pipelines. You will work closely with cross-functional teams to understand business requirements, optimize data workflows, and...

Job Description for Big Data Engineer: Primary Skills- Bigdata Hadoop, Hive, Spark, scala, SQL Secondary Skills- DW/ETL, Unix, Git, Bitbucket, ControlM - 3-5 years of experience in developing end to end bigdata pipeline - Must have experience in developing at least 1 bigdata project using hive, spark, scala - Thorough understanding of Hadoop and spark...

Detailed Job description (Role & Responsibility, Skill and Experience range) - We are looking for a hands-on Developer Programmer to design, build, and optimize high throughput data pipelines on Azure Databricks using Spark (Scala) and SQL - Design & develop scalable ETL/ELT pipelines in Azure Databricks using Spark (Scala) and SQL, following medallion...

Build scalable data pipelines using Azure Databricks, Spark, Scala, SQL and Python within a large enterprise data environment. 16th October, 2026 Company Description Showtime Consulting is a leading provider of Shielded Cloud and Digital Solutions across Australia and New Zealand. We specialise in delivering secure, enterprise-scale technology solutions...

Databricks, SQL, Python, Data warehousing conceptsDetailed Job description (Role & Responsibility, Skill and Experience range)We‿re looking for a hands on Developer Programmer to design, build, and optimize high throughput data pipelines on Azure Databricks using Spark (Scala) and SQLDesign & develop scalable ETL/ELT pipelines in Azure Databricks using...

If Azure Data Factory, Databricks and PySpark are part of your daily toolkit, I think you'll be interested in this one. I'm hiring an Azure Data Engineer in Sydney for a permanent role, building and maintaining scalable data pipelines and integration solutions on the Microsoft Azure data platform. Location: Sydney [hybrid/onsite] Type: Permanent,...

B.S. or M.S. in Computer Science with at least 4-6 years relevant experiencesExperience with a variety of scripting languages, especially PythonExperience with SQL and NoSQL databases, especially CassandraExperience on UNIX operating systems, especially LinuxDemonstrated experience building RESTful APIsStrong coding practices, including conducting peer code...

DFP Recruitment seeks experienced Quantexa Engineers in Melbourne or Sydney to deliver ETL and Scoring solutions within an Agile/DevOps environment. Flexible hybrid work arrangements will be reviewed case by case.Responsibilities include developing Quantexa ETL and Scoring, supporting delivery with Scala, Spark, CI/CD and Kubernetes, and collaborating with...

Job Description Required Qualifications: B.S. or M.S. in Computer Science with at least 4-6 years relevant experiences Experience with a variety of scripting languages, especially Python Experience with SQL and NoSQL databases, especially Cassandra Experience on UNIX operating systems, especially Linux Demonstrated experience building RESTful APIs ...

DFP Recruitment is seeking experienced Quantexa Engineers in Melbourne or Sydney to deliver ETL and Scoring solutions within an Agile/DevOps environment. Flexible hybrid working arrangements may be available and will be reviewed case by case.You will develop, configure and enhance Quantexa ETL and Scoring, support delivery with Scala, Spark, CI/CD and...

Pyramid Global Technologies in Australia seeks a DIO - Topology Based Service candidate to join Services Australia. The role focuses on converting business requirements into technical specs and designing data solutions across platforms, with a strong emphasis on documentation and Feasibility assessments.You'll work with Spark/Scala, Splunk, Docker,...

Job Description Roles and Responsibilities : /n /n /n - Quantexa ETL and Scoring Development, configuration, and enhancements. /n - Technical delivery of Quantexa implementation utilizing the below support tools and methods. /n /n - Agile / DevOps delivery mode. /n - CI/CD pipelines. /n - Work with Kubernetes. /n - Basic understanding of MS Azure...

Rabobank Australia is seeking a Data Engineer to design, build and operate enterprise-scale data platforms on Microsoft Azure. The role combines hands-on data engineering with governance, security, and collaboration across analysts, architects and BI teams.You will deliver scalable data pipelines using ADF, Databricks, Synapse and ADLS, with strong SQL,...

A leading recruitment firm in Sydney is seeking a Full Stack Developer for a 12-month contract with extensions possible. The ideal candidate will have extensive experience in Java and Scala, with responsibilities including end-to-end software development in collaboration with a Federal Government department. Candidates must ideally have a baseline or NV1...

We are looking for experienced Quantexa Engineers in Melbourne or Sydney to deliver Quantexa ETL and Scoring solutions within an Agile/DevOps environment. Flexible hybrid working arrangements may be available and will be reviewed case by case. Key responsibilities Develop, configure and enhance Quantexa ETL and Scoring solutions. Support technical delivery...

We are looking for experienced Quantexa Engineers in Melbourne or Sydney to deliver Quantexa ETL and Scoring solutions within an Agile/DevOps environment. Flexible hybrid working arrangements may be available and will be reviewed case by case. Key responsibilities Develop, configure and enhance Quantexa ETL and Scoring solutions. Support technical delivery...

A leading data and AI company in Queensland is seeking a professional to drive customer engagement and provide technical support for their Data Intelligence Platform. You will build relationships with clients, advise on architectural solutions, and leverage your expertise to enhance customer satisfaction. Ideal candidates will have strong Big Data skills,...

Macquarie Group is seeking a skilled software engineer to join the Engineering Services team in Melbourne. You will help architect and deliver a scalable analytics and rapid delivery platform powering Commodities and Global Markets, collaborating with quantitative analysts and trading desks worldwide.You’ll leverage Python, Java or Scala, cloud-native...

Showtime Consulting is seeking an experienced Data Engineer to join a large-scale enterprise data environment in Sydney. You will design, build and optimise high-throughput data pipelines using Azure Databricks, Spark (Scala), SQL and Python.Responsibilities include delivering scalable ETL/ELT pipelines, supporting real-time integrations, and implementing...

A leading data and AI company in Queensland is seeking a professional to drive customer engagement and provide technical support for their Data Intelligence Platform. You will build relationships with clients, advise on architectural solutions, and leverage your expertise to enhance customer satisfaction. Ideal candidates will have strong Big Data skills,...