Lead Data Engineer

1 week ago

Melbourne, Victoria, Australia ALOIS Solutions Full time $150,000 - $200,000 per year

Job role – Lead Data Engineer

Job Location – Melbourne

Job type - Contract

Technical Leadership & Delivery

  • Own end-to-end technical delivery of data solutions from design to deployment.
  • Architect and implement data pipelines using Azure Data Factory (ADF), Databricks, and PySpark, ensuring scalability, security, and compliance.
  • Leverage Azure Fabric and Azure Synapse for advanced analytics, data integration, and warehousing.
  • Review and approve code, ensuring adherence to engineering best practices and technical alignment across squads.
  • Conduct deep dives into complex problem areas where SMEs are unavailable, creating clear process models and identifying delivery gaps.
  • Assist with designing general architecture patterns or leverage architectural support to define required solutions that align with enterprise standards.
  • Make key technical decisions by researching options, gathering feedback, and securing approvals from architecture boards.
  • Estimate data volumes for performance tuning, cost optimization, and solution planning.
  • Create High-Level Designs (HLDs) and document solution architectures.
  • Design special solution components beyond core data architecture (e.g., Azure Functions for automated reporting).

Data Architecture & Modelling

  • Lead the creation of conceptual, logical, and physical data models to meet diverse business and technical requirements.
  • Apply data modelling best practices for relational, dimensional, and modern cloud-based data architectures.
  • Ensure solutions meet performance, compliance, and scalability requirements.
  • Shape fit-for-purpose solutions that align with the enterprise data strategy.

Agile Delivery & Collaboration

  • Partner with the Scrum Master to manage delivery in an Agile environment using Jira, Confluence, and Azure DevOps.
  • Work closely with Business & Technology leaders to align solutions with short- and long-term business and technology strategies.
  • Plan and prioritize backlogs of features, patterns, and data capabilities for both near-term and long-term execution.
  • Collaborate across multiple squads, ensuring consistent architecture, standards, and delivery quality.

Required Skills & Experience

  • 10+ years of experience in data engineering, data architecture, or solution architecture.
  • Proven track record delivering end-to-end data solutions in enterprise environments.
  • Extensive experience in data modelling, including conceptual, logical, and physical modelling for enterprise-scale systems.
  • Strong expertise in:
  • Azure (Data Factory, Data Lake, Functions, Synapse, Fabric)
  • Snowflake (data warehousing, performance tuning)
  • Databricks & PySpark
  • dbt (data transformation and modelling)
  • Python (data processing, scripting, automation)
  • Experience designing scalable data pipelines and implementing architecture patterns.
  • Hands-on experience with Agile delivery tools: Jira, Confluence, Azure DevOps.
  • Strong problem-solving and decision-making skills, with ability to operate in ambiguous environments.
  • Exceptional communication skills to work with both technical and non-technical stakeholders.

  • Data Engineer

    6 days ago

    Melbourne, Victoria, Australia Tech & Data People Full time $104,000 - $130,878 per year

    Are you the kind of engineer who loves solving tricky data problems, automating the boring stuff, and making things run faster and smarter? This role puts you right in the middle of a cloud-first data environment where you'll have the freedom to design, build and optimise pipelines, bring systems together, and use DevOps to keep everything running...

  • Data Engineering Lead

    4 days ago

    Melbourne, Victoria, Australia beBeeDataEngineering Full time $100,000 - $140,000

    Job Title: Data Engineering LeadWe are seeking a highly skilled Data Engineering Lead to join our team. As a key member of our data engineering group, you will be responsible for designing, implementing, and maintaining scalable data pipelines leveraging automated testing, continuous build, continuous integration, continuous delivery and deployment...

  • Leading Data Engineer

    7 days ago

    Melbourne, Victoria, Australia beBeeDataEngineer Full time $120,000 - $140,000

    Key Responsibilities:We are seeking a skilled professional to lead our data strategy and infrastructure. As a Data Engineer, you will guide the design, development, and optimization of data solutions that power business insights and innovation.Lead initiatives in data engineering, warehousing, and migrationDesign and implement robust ETL/ELT processesApply...

  • Data Engineering Lead

    5 days ago

    Melbourne, Victoria, Australia beBeeEngineering Full time $160,000 - $190,000

    **Job Description:**We are seeking a highly skilled Data Engineering Lead to join our team. The successful candidate will be responsible for designing, implementing, and maintaining scalable ETL/ELT pipelines using automated testing, continuous build, continuous integration, continuous delivery, and deployment practices.As a key member of our data...

  • Leading Data Engineer

    2 weeks ago

    Melbourne, Victoria, Australia beBeeDataEngineering Full time $120,000 - $140,000

    Data Engineering Lead">Job Description">We're seeking an experienced data engineer to lead our team in developing and implementing robust, scalable solutions. The successful candidate will work closely with business units to deliver timely, accurate, and secure data availability for decision-making.">Key Responsibilities:">">Design and deliver scalable data...

  • Lead Data Engineer

    1 week ago

    Melbourne, Victoria, Australia HireCloud Full time $80,000 - $90,000 per year

    **Lead Data Engineer - $800 - $900 pd - Work from home and CBD based office - Data Transformation Program The company:**My client is a multi-award winning Superannuation providers, with over $30 billion under management, and offering a range of products. With its friendly team, flexible environment and family friendly hours, this company is an employer of...

  • Lead Data Engineer

    2 weeks ago

    Melbourne, Victoria, Australia Buscojobs Full time

    Application closing date: Tuesday, 15 July 2025 • 11:59pm, Canberra timeEstimated start date: Tuesday, 12 August 2025Location of work: VICWorking arrangements: Hybrid working arrangements (i.e. a combination of onsite attendance at an AEC office and remote working) will be considered at the discretion of the Hiring Manager with a typical 3 days in the...

  • Data Engineering Lead

    2 days ago

    Melbourne, Victoria, Australia Ltimindtree Full time

    LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology expertise to help...

  • Data Engineering Lead

    3 days ago

    Melbourne, Victoria, Australia Ltimindtree Full time

    LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies.As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology expertise to help...

  • Lead Trainer Software Engineering

    1 week ago

    Melbourne, Victoria, Australia Institute of Data Full time $90,000 - $120,000 per year

    About the Institute of Data The Institute of Data is a Professional Network of Data Scientists, Cyber Security Analysts, Digital Marketers and Software Engineering. In partnership with leading universities in Australia, New Zealand & America, the government of Singapore and hundreds of employers, we transform careers for a data-driven world. About the role...