Data Engineering Lead

4 days ago

Sydney, New South Wales, Australia beBeeDataEngineering Full time $150,000 - $250,000
Job Title

A Data Engineering Lead is required to design, develop and maintain software components and automation frameworks to support scalable data engineering and validation solutions.

  • Design, develop and maintain software components and automation frameworks to support scalable data engineering and validation solutions.
  • Build and enhance Python-based automation tools to validate ETL workflows between databases, ensuring data accuracy and integrity.
  • Develop reusable code for data validation, transformation testing and reconciliation across large-scale data platforms.
  • Participate in the full software development lifecycle (SDLC) including requirements gathering, design, coding, testing, deployment and documentation.
  • Implement and manage CI/CD pipelines for continuous integration and deployment of automation assets and software utilities.
  • Work on data engineering projects deployed on cloud-based platforms, collaborating with teams to ensure testable, reliable and high-performing systems.
  • Collaborate with software engineers, architects and analysts to align development and automation goals with project requirements.
  • Lead and mentor team members, including offshore teams, to deliver high-quality software and automation solutions.
  • Engage in Agile delivery processes, including sprint planning, stand-ups and retrospectives, with a focus on iterative improvements.
  • Monitor, troubleshoot and enhance the performance of automation scripts and software tools in development and production environments.
  • Propose automation techniques and tools that can improve current practices in development and testing.

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer Consultant

    3 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...

  • Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia Tribus Full time $125,000 - $175,000 per year

    Data Engineering Lead We're looking for a Data Engineering Lead to lead the build-out of scalable data infrastructure for real-time analytics and reporting. This is a leadership-first role (60%) with continued technical delivery (40%). In This Role, You Will:Lead a growing team of data engineers growing to 6. Build and manage streaming data pipelines...

  • Lead Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Talenza Full time $230,000 - $240,000 per year

    Lead Data Engineer Sydney, Australia $230,000 (including Super) + Bonus About the Role: Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency. Key Responsibilities:Lead the development and...

  • Data Engineering Lead

    5 days ago

    Sydney, New South Wales, Australia beBeeEngineering Full time $123,456 - $234,567

    Lead Data Engineering Position This role is for a senior data engineer who can lead the design and delivery of robust data pipelines. The ideal candidate will have experience in leading cross-functional teams and guiding them through the full lifecycle of a project from discovery to production. They must also be able to translate technical complexity into...

  • Lead Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Fat Zebra Full time $90,000 - $120,000 per year

    Fat Zebrais an Australian technology company on a mission to uncomplicate commerce. We provide flexible, scalable payment processing solutions that power over 45,000 businesses across Australia—from growing startups to large enterprises.We're a dynamic team of payments pros, engineers, and product thinkers passionate about delivering frictionless, secure...

  • Data Engineering Lead

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataEngineering Full time $85,000 - $180,000

    Job Overview:We are seeking a seasoned Data Engineer to spearhead the design, development, and maintenance of scalable data pipelines and architectures. This role involves leading advanced analytics and machine learning initiatives.You will collaborate closely with architects, analysts, and stakeholders to deliver data-driven solutions that inform business...