Senior Data Engineer

5 days ago

Canberra, ACT, Australia Ontrack Systems Aus Pty Ltd Full time $90,000 - $120,000 per year
About the job Senior Data Engineer Job details

The Department of Agriculture, Fisheries and Forestry (DAFF) is looking for a Data Engineer to join the Digital Transformation Program in theAustralian Bureau of Agricultural and Resource Economics and Sciences(ABARES) to work across several data and analytics platforms. The candidate will develop and optimise data pipelines in Azure Databricks, with a strong focus on Python and SQL. The candidate will have expertise in Azure Data Factory, Azure DevOps, CI/CD, and Git version control, as well as a deep understanding of Kimball dimensional modelling and Medallion architecture. This role requires strong collaboration skills to translate business requirements into effective technical solutions.

Key duties and responsibilities

Key Responsibilities:

  • Develop, optimise, and maintain data pipelines using Python and SQL within Azure Databricks Notebooks.
  • Design and implement ETL/ELT workflows in Azure Data Factory, ensuring efficient data transformation and loading.
  • Apply Kimball dimensional modelling and Medallion architecture best practices for scalable and structured data solutions.
  • Collaborate with team members and business stakeholders to understand data requirements and translate them into technical solutions.
  • Implement and maintain CI/CD pipelines using Azure DevOps, ensuring automated deployments and version control with Git.
  • Monitor, troubleshoot, and optimise Databricks jobs and queries for performance and efficiency.
  • Work closely with data analysts and business intelligence teams to provide well-structured, high-quality datasets for reporting and analytics.
  • Ensure compliance with data governance, security, and privacy best practices.
  • Contribute to code quality improvement through peer reviews, best practices, and knowledge sharing.

Preferred Skills & Experience:

  • Strong proficiency in Python for data transformation, automation, and pipeline development.
  • Advanced SQL skills for query optimisation and performance tuning in Databricks Notebooks.
  • Hands-on experience with Azure Databricks for large-scale data processing.
  • Expertise in Azure Data Factory for orchestrating and automating data workflows.
  • Experience with Azure DevOps, including setting up CI/CD pipelines and managing code repositories with Git.
  • Strong understanding of Kimball dimensional modelling (fact and dimension tables, star/snowflake schemas) for enterprise data warehousing.
  • Knowledge of Medallion architecture for structuring data lakes with bronze, silver, and gold layers.
  • Familiarity with data modelling best practices for analytics and business intelligence.
  • Strong analytical and problem-solving skills with a proactive approach to identifying and resolving issues.
  • Excellent collaboration and communication skills, with the ability to engage both technical and business stakeholders effectively.

  • Senior SAP Data Engineer

    5 days ago

    Canberra, ACT, Australia NTT DATA Full time US$90,000 - US$120,000 per year

    Is innovation part of your DNA? Do you want to enable a connected future for people, organizations, and society?Join our growing global NTT team and you'll be part of the world's largest ICT company (by revenue). We've combined the capabilities of 28 remarkable companies to become one, leading technology services provider. Together, we help our people,...

  • Azure Data Factory Engineer

    2 weeks ago

    Canberra, ACT, Australia Babylon Data Full time

    Job Title: Azure Data Factory EngineerRate Guide: $100–$125 per hour (plus super @ 12%)Location of Work: Canberra, ACTContract Duration: ASAP – 30 June 2026Start Date: Tuesday, 23 September 2025Maximum Hours per Week: Up to 40 hoursSecurity Clearance Requirements: Must be an Australian Citizen and able to obtain NV1 clearanceJob DetailsBabylon Data is...

  • Azure Data Factory Engineer

    2 weeks ago

    Canberra, ACT, Australia Babylon Data Full time

    Job Title: Azure Data Factory EngineerRate Guide: $100–$125 per hour (plus super @ 12%)Location of Work: Canberra, ACTContract Duration: ASAP – 30 June 2026Start Date: Tuesday, 23 September 2025Maximum Hours per Week: Up to 40 hoursSecurity Clearance Requirements: Must be an Australian Citizen and able to obtain NV1 clearanceJob DetailsBabylon Data is...

  • Senior Data Engineer

    1 week ago

    Canberra, ACT, Australia IT Alliance Australia Full time

    OverviewOne of our Federal Government clients is looking for Senior Data Engineer in Canberra and Brisbane.We are looking for the following Skills/Experience:A detailed understanding of SIEM infrastructure and the ability to manage the collection of log data from a wide range of technologies and systems.Extensive experience in supporting log acquisition,...

  • System Engineer

    4 weeks ago

    Canberra, ACT, Australia NTT DATA, Inc. Full time

    2 days ago Be among the first 25 applicantsDirect message the job poster from NTT DATA, Inc.Senior Acquisition Consultant with a passion for helping people find their dream job.NTT DATA is seeking a Cyber Range (DCR) System Engineer to support an RFQ for one of our premium clients in Canberra. This is a fantastic opportunity to work on cutting-edge projects...

  • System Engineer

    4 weeks ago

    Canberra, ACT, Australia NTT DATA, Inc. Full time

    2 days ago Be among the first 25 applicantsDirect message the job poster from NTT DATA, Inc.Senior Acquisition Consultant with a passion for helping people find their dream job.NTT DATA is seeking a Cyber Range (DCR) System Engineer to support an RFQ for one of our premium clients in Canberra. This is a fantastic opportunity to work on cutting-edge projects...

  • Senior Investment Data Engineer

    6 days ago

    Canberra, ACT, Australia ClearCompany Full time

    Overview- Based in Sydney CBD and is open to candidates looking at relocating.- Investment Management and Quantitative finance- Hybrid working – 3 days in officeAbout the roleJoin a leading investment management firm in driving technology and data uplift. This role will make a large impact on the business and how they operate from a technology standpoint....

  • Senior Investment Data Engineer

    6 days ago

    Canberra, ACT, Australia ClearCompany Full time

    OverviewBased in Sydney CBD and is open to candidates looking at relocating.Investment Management and Quantitative financeHybrid working – 3 days in officeAbout the roleJoin a leading investment management firm in driving technology and data uplift. This role will make a large impact on the business and how they operate from a technology standpoint. With...

  • Senior Investment Data Engineer

    3 days ago

    Canberra, ACT, Australia ClearCompany Full time

    OverviewBased in Sydney CBD and is open to candidates looking at relocating. Investment Management and Quantitative finance Hybrid working – 3 days in office About the role Join a leading investment management firm in driving technology and data uplift. This role will make a large impact on the business and how they operate from a...

  • Senior Data Engineer

    1 week ago

    Canberra, ACT, Australia Contractor Central Full time

    At Contractor Central, we're committed to matching exceptional ICT talent with critical roles across the public sector. We're currently seeking a highly capable Data Engineer ...Location :Jobtype :Full TimeCategory :At Contractor Central, we're committed to matching exceptional ICT talent with critical roles across the public sector. We're currently seeking...