Senior Data Engineer

4 weeks ago


Sydney, Australia Allura Partners Full time
  • Data
  • Contract
  • Databricks

Senior Data Engineer – 12-Month Contract - Sydney - Databricks / PySpark / SQL / ETL

About the Company

This Sydney-based utilities company is a leader in its sector, delivering essential services to millions across Australia. Focused on innovation, they leverage advanced technologies and data-driven strategies to enhance efficiency, improve customer outcomes, and drive sustainability.

About the Role

As a Senior Data Engineer, you’ll play a key role in the company’s data transformation projects. Reporting to the Head of Data, you’ll design and implement cutting-edge data solutions, optimize system performance, and collaborate with stakeholders to deliver impactful outcomes.

Benefits

  • Competitive daily rates - open to market rates
  • Flexible work environment.
  • 12 Months contract - Start ASAP

Duties/Key Responsibilities

  • Optimise and troubleshoot Databricks DLT & Autoloader processes.
  • Manage ELT workloads for transforming JSON files.
  • Conduct Spark tuning and optimise big data performance.
  • Enhance metadata-driven frameworks using SQL Server, ADF, and Databricks.
  • Deploy solutions through Azure DevOps pipelines and engage directly with stakeholders.

Skills and Experience

  • Proficiency in Databricks, PySpark, and SQL, with a focus on ELT workloads.
  • Expertise in Spark tuning and big data performance optimisation.
  • Experience with Azure DevOps pipelines and metadata frameworks.
  • Knowledge of SAP and experience in the utilities industry (bonus).
  • Strong communication skills with the ability to work directly with business stakeholders.

If you’re interested in this opportunity and feel you’re the right fit, please click “apply” or contact me at kaio.desouza@allurapartners.com.au

About Allura Partners
Allura Partners was founded to support private equity firms by placing C-Suites to lead, transform, and scale portfolio companies. Today, in addition to our proven private equity specialisation, we’ve become a trusted partner for major ASX-listed and private enterprises in Australia, offering executive search, recruitment, and business transformation. Known for integrity, reliability, and results, our expertise spans Executive Search, Accounting & Finance, Transformation & Change, and Technology & Digital. We connect businesses and top-tier talent, exceeding expectations and driving lasting impact.

Senior Data Engineer – 12-Month Contract - Sydney - Databricks / PySpark / SQL / ETL



  • Sydney, New South Wales, Australia Senior Full time

    Job OverviewWe are seeking a highly skilled Senior Data Architect to join our team. This is a senior-level position responsible for designing and building scalable cloud-based systems and applications for our marketing analytics clients.The ideal candidate will have at least 4+ years of experience delivering data engineering solutions on Google Cloud...


  • Sydney, Australia Senior Full time

    Description Position at GroupM About us Acceleration is WPP’s specialist practice for data, analytics & technology consulting. We are a curious team of highly skilled data and technology practitioners, inspired by experimentation and new ideas. This is the lifeblood of the future-forward solutions we deliver, that...

  • Senior Data Engineer

    4 weeks ago


    Sydney, New South Wales, Australia Data-Property Data Solns Shared Full time

    We are seeking a highly skilled Senior Data Engineer to join our team at Data-Property Data Solutions Shared. This is an exciting opportunity for a seasoned professional to lead the development of cutting-edge data solutions and drive business growth.About UsOur company specializes in simplifying the property journey for all stakeholders, leveraging our...


  • North Sydney, Australia NTT DATA Full time

    NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...


  • Sydney, Australia Data - AI & Data Science Full time

    Who are weWe shine a light on all things property. Our business aims to simplify the property journey for all involved; motivated by expertise and our exclusive data. Changing the way people engage with property requires a team of diverse thinkers.At Domain Group, our data department is at the forefront of driving value across the organisation. We create...


  • Sydney, Australia Data-Property Data Solns Shared Full time

    Who are weWe shine a light on all things property. Our business aims to simplify the property journey for all involved; motivated by expertise and our exclusive data. Changing the way people engage with property requires a team of diverse thinkers.Our data department is at the forefront of driving value across the organisation. We create reusable data assets...

  • Senior Data Engineer

    9 months ago


    Sydney, Australia Pyramid Global Technologies Full time

    About the job Senior Data Engineer Job Description: Sr. Data Engineer *Power BI,*Tableau,*SQL advanced,*Data warehousing concepts, and everything related to data

  • Senior Data Engineer

    22 minutes ago


    Sydney, New South Wales, Australia Atlassian Full time

    This is an exciting opportunity to join Atlassian as a Senior Machine Learning Engineer in the Central AI team. You will be responsible for building and maintaining the core infrastructure to allow machine learning engineers and data scientists to develop, train, evaluate, deploy, and operate Machine Learning models and pipelines.The role involves designing...

  • Senior Data Engineer

    1 month ago


    North Sydney, Australia Bluefin Resources Full time

    Full TimeSydney: Hybrid workingSalary: up to $160k, plus super (depending on experience)We are seeking a Senior Data Engineer to join a dynamic team within a forward-thinking organisation leveraging cutting-edge data technologies. If you are passionate about data engineering, have strong mentoring skills, and excel in stakeholder engagement, this opportunity...

  • Senior Data Engineer

    4 weeks ago


    Sydney, Australia Talenza Full time

    Senior Data Engineer (GCP) Sydney $190,000 Inc Super + Bonus Senior GCP Data Engineer required to join a Data Platforms team within a leading FS institute. Key Responsibilities Play a pivotal role in designing, building, and enhancing enterprise-scale data solutions. Work in a DevOps environment, with end-to-end accountability for...


  • Sydney, Australia Simple Machines Full time

    Simple Machines ANZ – Job Ad – Principal / Senior Data EngineerPosition: Senior Data EngineerLocation: Darlinghurst, SydneySimple Machines. Data Engineered to Life™ Simple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating...

  • Senior Data Architect

    1 month ago


    Sydney, New South Wales, Australia Whizdom Recruitment Full time

    Enterprise Data Engineering OpportunityWe are seeking an experienced Senior Data Architect to lead our enterprise data engineering efforts in Sydney. This is a 2-3 year contract with a competitive salary package.About the RoleThe Senior Data Architect will be responsible for designing, developing, and implementing cutting-edge data solutions across diverse...


  • Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    About the role: We are seeking an experienced Data Engineer to join our team at Pyramid Global Technologies. As a Senior Data Engineering Specialist, you will be responsible for evaluating business needs and objectives, conducting data analysis, and resolving complex business queries.Job Responsibilities:Evaluate business requirements and develop strategies...

  • Senior Data Engineer

    7 months ago


    Sydney, Australia Tinybeans Full time

    Tinybeans is a leading private photo-sharing app that connects families and turns moments into memories. We’re loved and trusted by millions of parents and families around the world since our founding in 2012, which is why we’ve got more than 150,000 5-star reviews in the Apple App and Google Play stores and users in almost every country in the world....


  • Sydney, New South Wales, Australia The Recruitment Company Full time

    Job OverviewA highly esteemed financial services organization is seeking an exceptional Senior Data Engineer to spearhead the development and implementation of a distributed streaming application suite.This is a fantastic opportunity for a skilled professional to take ownership of the messaging and integration components, leveraging their expertise in Kafka,...

  • Senior Data Engineer

    2 months ago


    Sydney, Australia Eucalyptus Full time

    Healthcare is usually slow and boring. We believe in its potential to be exciting and entertaining. But changing the healthcare experience is hard – and we’re gonna need all the help we can get…!‍About EucalyptusEucalyptus (or 'Euc' for short) is an Australian founded digital healthcare company that is on a mission to solve the world’s biggest...

  • Data Engineering Lead

    2 months ago


    Sydney, New South Wales, Australia Quantexa Full time

    About the Role:We are seeking a Senior Data Engineer to join our team at Quantexa. As a key member of our Delivery team, you will be responsible for implementing our innovative technology in various domains, including banking, insurance, government, and healthcare.Key Responsibilities:Design and implement end-to-end data pipelines using our award-winning...

  • Azure Data Engineer

    2 months ago


    Sydney, Australia M&T Resources Full time

    SydneyIT & Telecomms DBA / Database DeveloperBig 4 banking experience highly beneficialAzure / Data Migration/ Pyspark / Data WarehousingHybrid working environment / Day Rate contractAre you an experienced Senior Data Engineer with a passion for driving large scale data migrations? Do you have a strong background in building data platforms and automated...


  • Sydney, New South Wales, Australia NTT DATA Full time

    About the RoleNTT DATA is seeking an experienced Senior Security Architect to join our team in Australia and New Zealand. This role offers a unique opportunity to work with leading-edge security solutions and make a significant impact on our clients' success.Job DescriptionWe are looking for a skilled Security Architect to provide technical leadership and...

  • Senior Data Engineer

    4 weeks ago


    Sydney, New South Wales, Australia Talent Insights Full time

    About the RoleTalent Insights is seeking a highly skilled Senior Data Engineer to join our team in Sydney CBD. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines using APIs, BigQuery, GCP, Docker, and Python.Key ResponsibilitiesDesign, develop, and deploy scalable data...