Lead Data Engineer

13 hours ago

Sydney, New South Wales, Australia beBeeData Full time $120,000 - $180,000
About This Role

We are seeking a seasoned professional to lead our data engineering and solution architecture initiatives. This is a hands-on role requiring expertise in designing and implementing scalable, secure, and cost-effective data solutions across the cloud ecosystem.


Key responsibilities include:

  • Collaborating with clients to understand their requirements and translate complex needs into practical solutions
  • Designing end-to-end data pipelines, leveraging modern cloud-native technologies for efficient data ingestion, processing, and analytics
  • Solution estimation and project scoping, ensuring accurate planning and delivery of data engineering projects
  • Azure data stack and solutions implementation, utilizing Azure Data Factory, Azure Synapse Analytics, and other related services
  • Data modelling and optimisation, developing robust data models that underpin analytics, reporting, and business intelligence
  • Development of data pipelines and ETL/ELT frameworks, guaranteeing data quality and reliability
  • Integration workflow development, constructing workflows to ingest structured and semi-structured data from various sources
  • CI/CD pipeline setup and automation, establishing seamless continuous delivery and deployment
  • Stakeholder collaboration and architectural alignment, working with internal teams and external stakeholders to ensure solution adherence to recognised architectural standards
  • Technical leadership throughout the project lifecycle, encompassing design, development, testing, deployment, and post-production support

Required Skills and Qualifications
  • Proven 7+ years in data engineering and solution architecture within enterprise-scale environments, specialising in Azure technologies
  • Hands-on expertise with the Azure data platform, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure Data Lake Storage, and Azure SQL Database
  • Client-facing experience, effectively engaging with stakeholders to understand and address their needs
  • Strong skills in solutioning and project estimation, accurately scoping and planning data engineering projects
  • Practical knowledge of data modelling principles, including star and snowflake schemas, dimensional modelling, and Slowly Changing Dimensions
  • Expertise in SQL and Python, with production-ready code for both batch and real-time use cases; experience with R, Scala, or Java is a plus
  • Experience designing and implementing scalable ETL/ELT pipelines and data integration workflows
  • Demonstrated experience leading platform migrations, particularly from Azure Synapse or similar platforms
  • Experience in Microsoft Fabric is highly valued
  • Understanding of CI/CD practices, Git branching, automated testing, and infrastructure-as-code
  • Knowledge and implementation of cloud security best practices, including identity and access management, encryption, and compliance
  • Experience monitoring cloud services and optimising performance and costs using Azure Monitor, Log Analytics, or equivalent tools

Benefits

This role offers a unique opportunity to work with a leading organisation in the field of data engineering and solution architecture. The successful candidate will be part of a dynamic team that values innovation, collaboration, and technical excellence.


Seniority level
  • Mid-Senior level

Employment type
  • Full-time

Job function
  • Other

Industries
  • Software Development

  • Data Engineer Consultant

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...

  • Data Engineer Consultant

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...

  • Data Engineer Consultant

    2 days ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...

  • Practice Manager – Lead the Future of Data

    4 weeks ago

    Sydney, New South Wales, Australia Ignition Data Full time

    Practice Manager – Lead the Future of Data & AI at IgnitionPractice Manager – Lead the Future of Data & AI at IgnitionGet AI-powered advice on this job and more exclusive features.Direct message the job poster from Ignition DataLead the next era of data and AI enablement services across Australia. Join Ignition as we scale delivery, automation, and...

  • Leading Data Engineer

    8 hours ago

    Sydney, New South Wales, Australia beBeeDataLeader Full time $185,000 - $215,000

    Data Engineering LeaderRole OverviewThis role focuses on leading a team of data engineers to develop, maintain and support data pipelines using modern data engineering practices.The ideal candidate should have experience with cloud data warehouses, ETL tools, programming languages such as Python, and strong understanding of data warehousing concepts and data...

  • Lead Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    Job Description for Lead Data Engineer in SydneyExperience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities:Data Engineering and Data WarehousingSolution Design and Data AnalysisData Visualization and Data ModelingProgramming Languages: Python, Scala, SQLCloud Technologies: Azure and DatabricksBig Data...

  • Lead Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Deloitte Australia Full time

    Press Tab to Move to Skip to Content LinkSelect how often (in days) to receive an alert:Flexible work arrangements – work in a way that suits you best.Mentoring and development programs – receive support and coaching to progress your career.Access to discounts on technology purchases.We are seeking a highly skilled Lead Data Engineer with a focus on the...

  • Data Engineering Lead

    3 days ago

    Sydney, New South Wales, Australia Resolution Life Group Services Limited Full time

    Data Engineering Lead page is loaded## Data Engineering Leadlocations: Sydneytime type: Full timeposted on: Posted Yesterdaytime left to apply: End Date: September 20, days left to apply)job requisition id: JR690800**About Resolution Life**Resolution Life Australasia is one of the leading life insurers in Australia and New Zealand, with ~ 1 million...

  • Data Engineering Lead

    1 day ago

    Sydney, New South Wales, Australia Resolution Life Group Services Limited Full time

    Data Engineering Lead page is loaded Data Engineering Leadlocations: Sydneytime type: Full timeposted on: Posted Yesterdaytime left to apply: End Date: September 20, 2025 (22 days left to apply)job requisition id: JR690800 About Resolution Life Resolution Life Australasia is one of the leading life insurers in Australia and New Zealand, with 1 million...

  • Data Engineering Lead

    7 hours ago

    Sydney, New South Wales, Australia Resolution Life Group Services Limited Full time

    Data Engineering Lead page is loaded## Data Engineering Leadlocations: Sydneytime type: Full timeposted on: Posted Yesterdaytime left to apply: End Date: September 20, 2025 (22 days left to apply)job requisition id: JR690800**About Resolution Life**Resolution Life Australasia is one of the leading life insurers in Australia and New Zealand, with ~ 1 million...