Chief Data Engineering Specialist

1 day ago

Sydney, New South Wales, Australia beBeeDataEngineering Full time $170,000 - $200,000
Job Title: Chief Data Engineering Specialist

We are seeking a highly skilled and experienced Chief Data Engineering Specialist to join our team.

This is a challenging role that requires the ability to design, build, and optimize data pipeline solutions on Databricks and related cloud platforms.

You will work closely with data scientists, analysts, and engineers to ensure our data infrastructure supports advanced analytics and business insights across industries.

  • Develop close relationships with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective pipeline solutions.
  • Contribute to Data Architecture and Solution Design, helping to build Proof of Concepts.
  • Design, develop, and maintain robust ETL/ELT pipelines on using Databricks along with AWS / Azure / GCP tools and services, to ingest, process, and transform large datasets.
  • Implement data validation, cleansing, and governance procedures to guarantee data quality, integrity, and security.
  • Continuously improve the scalability, efficiency, and cost-effectiveness of data pipelines.
  • Monitor data pipeline performance and promptly troubleshoot any issues or failures to ensure high data availability and consistency.
Required Skills and Qualifications
  • Proficiency in Python for data engineering (including PySpark and libraries like pandas/Polars) and in SQL for data querying and transformation.
  • Solid understanding of data warehousing concepts and dimensional data modeling (e.g. star schema, Kimball methodology).
  • Hands-on experience with relational database systems and SQL (e.g. SQL Server, PostgreSQL) and familiarity with NoSQL databases (e.g. MongoDB, Cassandra) for varied data storage needs.
  • Strong experience designing and implementing ETL/ELT processes and integrating data from multiple sources.

  • Chief Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia beBeeDataEngineeringLead Full time $180,000 - $250,000

    Job OverviewWe are seeking a Chief Data Engineering Lead to spearhead our regulatory epics and drive transformation in our regulatory reporting platform.Main Responsibilities:Leverage data engineers to enhance platform efficiency by implementing AI, automation, and cutting-edge technologies.Guide the team in harnessing big data capabilities using Spark,...

  • Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer

    2 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    3 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    2 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Chief Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Westpac Full time

    Join or sign in to find your next job Join to apply for the Chief Engineer role at Westpac3 days ago Be among the first 25 applicants Join to apply for the Chief Engineer role at Westpac Get AI-powered advice on this job and more exclusive features.Job Description Join Us as Chief Engineer – Lead the Future of Data at UNITEThis role will play a crucial...

  • Chief Data Governance Specialist

    9 hours ago

    Sydney, New South Wales, Australia beBeeDataGovernance Full time $120,000 - $150,000

    Job Title:Test Data ArchitectDescription:We are seeking a skilled and innovative Chief Data Governance Specialist to join our team. As a key member of our organization, you will play a vital role in driving data governance and ensuring the highest standards of data quality across our enterprise.Responsibilities:Design and lead data governance initiatives to...

  • Chief Engineer

    1 day ago

    Sydney, New South Wales, Australia Westpac Group Full time

    Join Us as Chief Engineer – Lead the Future of Data at UNITEThis role will play a crucial part in the UNITE team.UNITE is our business-led, tech-enabled transformation, and a key priority for the Group.UNITE aims to deliver 'one best way' to simplify processes, systems, and technology to improve customer experience and ease for our people.What's the...

  • Chief Engineer

    5 days ago

    Sydney, New South Wales, Australia Westpac Group Full time

    Join Us as Chief Engineer - Lead the Future of Data at UNITEThis role will play a crucial part in the UNITE team.UNITE is our business-led, tech-enabled transformation, and a key priority for the Group.UNITE aims to deliver 'one best way' to simplify processes, systems, and technology to improve customer experience and ease for our people.What's the...

  • Chief Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Westpac Group Full time

    Join Us as Chief Engineer – Lead the Future of Data at UNITE This role will play a crucial part in the UNITE team.UNITE is our business-led, tech-enabled transformation, and a key priority for the Group.UNITE aims to deliver 'one best way' to simplify processes, systems, and technology to improve customer experience and ease for our people.What's the...