Senior Data Engineer

2 weeks ago

Sydney, New South Wales, Australia beBeeData Full time
About the Role

As a seasoned Data Engineer, you will design and build cutting-edge data pipelines on Databricks and related cloud platforms. Collaborating closely with data scientists, analysts, and engineers, you will ensure our data infrastructure supports advanced analytics and business insights across various industries.

Key Responsibilities:
  • Develop robust ETL/ELT pipelines on Databricks using AWS/Azure/GCP tools and services to ingest, process, and transform large datasets.
  • Implement data validation, cleansing, and governance procedures to guarantee data quality, integrity, and security.
  • Continuously improve the scalability, efficiency, and cost-effectiveness of data pipelines.
  • Monitor data pipeline performance and troubleshoot any issues or failures to ensure high data availability and consistency.
Requirements

To succeed in this role, you should possess:

  • Proficiency in Python for data engineering, including PySpark and libraries like pandas/Polars.
  • Solid understanding of data warehousing concepts and dimensional data modeling.
  • Hands-on experience with relational database systems and SQL, as well as familiarity with NoSQL databases.
  • Strong experience designing and implementing ETL/ELT processes and integrating data from multiple sources.
  • Proven experience working with multiple cloud data platforms.
  • Expertise in Databricks and the Spark ecosystem for large-scale data processing.
What We Offer

We provide a dynamic work environment, opportunities for growth and development, and a comprehensive benefits package, including:

  • A competitive salary and bonus structure.
  • A range of health and wellbeing programs.
  • Ongoing training and professional development opportunities.
  • A flexible and hybrid working arrangement.
Join Our Team

We are committed to fostering an inclusive and respectful workplace culture where everyone feels valued and empowered to contribute their best work. If you are passionate about data engineering and committed to delivering exceptional results, we encourage you to apply for this exciting opportunity.

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer Consultant

    3 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...

  • Senior Data Engineer

    1 week ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $219,000 - $365,000

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to design and build scalable, reusable data pipelines and transformations that power our cloud-based data platform.

  • Senior Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Ingrity Full time

    Join or sign in to find your next job Join to apply for the Senior Data Engineer (Azure) role at Ingrity2 days ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer (Azure) role at IngritySydney | Full-Time | Must have full working rights in AustraliaWork with enterprise clients. Architect data solutions. Deliver impact.About UsWe're...

  • Senior Data Engineer

    5 days ago

    Sydney, New South Wales, Australia Talenza Full time

    Base pay rangeA$1,150.00/daily - A$1,250.00/dailyDirect message the job poster from TalenzaSenior Data Engineer - NSW Public ServicesRole: Senior Data EngineerDay Rate: $1150 - $1250 incl. SuperContract Length: 6-monthsLocation: Sydney CBD/WFH FlexWe're looking for a Senior Data Engineer to join a large-scale digital transformation program. You\'ll play a...

  • Senior Data Engineer

    5 days ago

    Sydney, New South Wales, Australia Talenza Full time

    Base pay rangeA$1,150.00/daily - A$1,250.00/dailyDirect message the job poster from TalenzaSenior Data Engineer - NSW Public ServicesRole: Senior Data EngineerDay Rate: $1150 - $1250 incl. SuperContract Length: 6-monthsLocation: Sydney CBD/WFH FlexWe're looking for a Senior Data Engineer to join a large-scale digital transformation program. You\'ll play a...

  • Senior Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Equal Experts Full time

    Direct message the job poster from Equal ExpertsAt Equal Experts, we're a network of over 3500 experienced technology practitioners globally, who value autonomy, collaboration, and delivering meaningful outcomes for our clients. Our teams are made up of senior professionals who bring deep expertise across software engineering, data, product, and delivery.We...