Current jobs related to Leading Data Engineer - Sydney, New South Wales - beBeeDataEngineer

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer Consultant

    3 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...

  • Solar Design Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Electrical Engineer Full time

    OverviewHarvey Norman Commercial Division specialises in the supply of goods & services to project builders, developers, architects and the mining industry. Our clients depend upon Harvey Norman Commercial to supply the best range, the best service and the best prices.We have an exciting opportunity at our Taren Point office for a motivated and driven Full...

  • Solar Design Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Electrical Engineer Full time

    OverviewHarvey Norman Commercial Division specialises in the supply of goods & services to project builders, developers, architects and the mining industry. Our clients depend upon Harvey Norman Commercial to supply the best range, the best service and the best prices.We have an exciting opportunity at our Taren Point office for a motivated and driven Full...

  • Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia beBeeEngineering Full time $123,456 - $234,567

    Lead Data Engineering Position This role is for a senior data engineer who can lead the design and delivery of robust data pipelines. The ideal candidate will have experience in leading cross-functional teams and guiding them through the full lifecycle of a project from discovery to production. They must also be able to translate technical complexity into...

  • Lead Data Engineer

    5 days ago

    Sydney, New South Wales, Australia tekFinder Full time $120,000 - $180,000 per year

    Hiring; Lead Data Engineer - ETL - AWS - SQL*You must live in Sydney for this role as 3 days per week in office are needed.We need a strong Data Tech Lead who can work on solution design from end to end and has a background in Spark SQL, AWS, ETL.This is not a hands off manager role - this is from someone who was once a strong data engineer with ETL/SQL and...

  • Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia beBeeDataEngineering Full time $150,000 - $250,000

    Job TitleA Data Engineering Lead is required to design, develop and maintain software components and automation frameworks to support scalable data engineering and validation solutions.Design, develop and maintain software components and automation frameworks to support scalable data engineering and validation solutions.Build and enhance Python-based...

  • Lead Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia ResMed Inc Full time

    Lead Data Engineer page is loaded## Lead Data Engineerlocations: Sydney, NSW, Australiaposted on: Posted Todayjob requisition id: JR\_044233Global Technology Solutions (GTS) at ResMed is a division dedicated to creating innovative, scalable, and secure platforms and services for patients, providers, and people across ResMed. The primary goal of GTS is...

Leading Data Engineer

3 weeks ago

Sydney, New South Wales, Australia beBeeDataEngineer Full time $120,000 - $150,000
Job Description

Key Responsibilities:

  • Drive the execution of data engineering initiatives, collaborating with cross-functional teams to deliver high-quality results.
  • Provide technical leadership in the data space, identifying risks and solutions, and coordinating with engineers to ensure successful execution.
  • Lead technical solution design and troubleshooting, ensuring the team builds scalable and maintainable systems.
Technical Requirements

Key Skills and Qualifications:

  • Ensure adherence to data privacy, security, observability, and governance standards.
  • Collaborate with architects and senior engineers to design resilient, high-performance data solutions.
  • Build scalable data pipelines to ingest, process, and expose data using technologies like Snowflake, AWS Redshift, Kinesis, Lambda, Dynamo DB, S3, Glue, Apache Storm, and others.
  • Develop batch and streaming data solutions using Apache Kafka, Apache Spark, Airflow, and Delta Lake for real-time and scheduled data processing.
  • Design and implement event-driven data architectures with streaming frameworks such as Kafka Streams and Kinesis Data Firehose.
  • Implement Data Quality, Data Lineage, and Observability frameworks Build CI/CD pipelines using tools such as Git Hub Actions, Terraform, Collaborate with Site Reliability Engineers to ensure stability and uptime of production pipelines and services.
  • Continuously identify opportunities for performance improvement, cost optimisation, and process efficiency.
  • Work with Data Scientists to ensure high-quality data for Machine Learning models and integrate them into production-ready pipelines.
About You

Requirements:

  • Undergraduate degree focused on Computer Science, Engineering, Data Science or a related discipline.
  • 5+ years of hands-on experience in data profiling, source-to-target mapping, ETL development, SQL optimisation, testing, and implementation.
  • Proven experience delivering large-scale data ingestion, transformation, and processing using AWS technologies such as Kinesis, Athena, Redshift, Dynamo DB, Lambda, and S3.
  • Proficient with modern data platforms and tools including Snowflake, Databricks and Apache Storm.
  • Strong experience working with relational databases (SQL) as well as No SQL databases, particularly Mongo DB.
  • Proven ability to translate complex business requirements into technical solutions through effective cross-functional collaboration, strong communication skills, and adaptable problem-solving approach.
  • Exposure to CI/CD tools and practices, including Ansible, Cloud Formation, Jenkins, and related automation technologies.
  • Experience developing and deploying solutions on cloud platforms such as AWS, GCP, or Azure.