Senior Data Platform Engineer

1 week ago

Sydney, New South Wales, Australia beBeeDataEngineer Full time $100,000 - $200,000

Design and build scalable data pipelines using Python and PySpark for batch and streaming workloads in a hybrid environment. Key responsibilities include creating and managing Delta Lake layers, setting up Databricks workflows and jobs, optimizing performance with Databricks tools, and automating AWS tasks with Boto3.

Required skills and qualifications:

  • Strong coding skills in Python and PySpark
  • Experience with Databricks and Delta Lake
  • Experience in AWS services especially S3, Glue, Lambda, and Redshift
  • Experience using Terraform or CloudFormation
  • Comfortable automating AWS tasks with Boto3

Job benefits include working in cross-functional teams, collaborating with data scientists and engineers, and applying data quality checks to ensure high-quality data. This is an excellent opportunity for senior-level professionals looking to leverage their expertise and expand their skill set.

The ideal candidate will have prior experience building efficient, secure, and scalable pipelines, and be comfortable working in a fast-paced delivery environment. They will also have a strong understanding of data management and analytics principles.

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Gcp Data Platform Engineer

    4 days ago

    Sydney, New South Wales, Australia Novon Full time

    OverviewJoin to apply for theGCP Data Platform Engineerrole atNOVONNovon is a boutique Tech Consulting Company with Blue-chip (ASX50) clients. Join a connected Data and Engineering Community. 10 years delivering successful data outcomes.MandateSupport our customers by designing and delivering enterprise-grade data platform engineering solutions in the GCP...

  • GCP Data Platform Engineer

    6 days ago

    Sydney, New South Wales, Australia NOVON Full time

    OverviewJoin to apply for the GCP Data Platform Engineer role at NOVONNovon is a boutique Tech Consulting Company with Blue-chip (ASX50) clients. Join a connected Data and Engineering Community. 10 years delivering successful data outcomes.MandateSupport our customers by designing and delivering enterprise-grade data platform engineering solutions in the GCP...

  • Data Platform Engineer Leader

    6 days ago

    Sydney, New South Wales, Australia beBeeEngineering Full time $180,000 - $250,000

    Job OverviewWe are seeking a seasoned Data Platform Engineering Manager to lead our team in designing, developing, and delivering high-performance data capabilities that drive business insights and decision-making.Key Responsibilities:Oversee the entire development lifecycle from project planning through to deployment, ensuring quality, reusability, and...

  • Senior Data Platform Engineer

    1 week ago

    Sydney, New South Wales, Australia Bebeedataengineering Full time

    Leading Data Engineering TeamWe are seeking a talented leader to spearhead our high-performance data engineering team, driving performance, career development, and delivery.The ideal candidate will own and deliver the vision, strategy, and roadmap for our data platform.They will architect platform components that scale across APAC and integrate...

  • Data Platforms Engineer

    7 days ago

    Sydney, New South Wales, Australia beBeeEngineering Full time $170,000 - $220,000

    Job OverviewAs a seasoned engineering leader, you will spearhead the development and management of data platforms to drive business success. Your team's work will focus on delivering streamlined, efficient, and secure systems.Main Responsibilities:Lead a team creating, managing, and optimizing data platforms for business growth.Drive thought leadership,...

  • Data Platform Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Buscojobs Full time

    Data Platform Engineer Get recognition and reward working with this a pioneering industry leader, as they embark on a transformative journey We are currently seeking a passionate Data platform engineer for an exciting 12-month contract opportunity within their highly respected Technology team.This pivotal role demands a seasoned professional with robust...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...