Data Pipeline Specialist

3 days ago

Sydney, New South Wales, Australia beBeeDataEngineer Full time
About the Role

Drive's Data Operations team is seeking an ETL Engineer to help us achieve our vision of shaping the future of automotive in Australia. As a key member of this team, you will be responsible for designing, implementing, and maintaining efficient data pipelines that drive business value.

The ideal candidate will have 5+ years of experience with ETL processes, data warehousing, and data modeling. They will be proficient in SQL and Python, with hands-on experience working within a major cloud environment such as AWS.

We are looking for someone who can work collaboratively with the business to design and deliver high-quality data solutions that meet functional requirements. If you have a passion for data engineering and want to be part of a dynamic team, we encourage you to apply.

  • Key Responsibilities:
  • Design, implement, and maintain data pipelines using ETL tools such as CDATA, Airflow, or Airbyte.
  • Work with the business to design and deliver correct, high-quality data solutions that meet functional requirements.
  • Implement data governance policies by masking or excluding sensitive information and ensuring regulatory traceability requirements are met.
  • Maintain comprehensive documentation of pipeline logic and data lineage.
Requirements
  • Bachelor's degree in computer science, information technology, or a related field.
  • 5+ years of experience with ETL processes, data warehousing, and data modeling.
  • Strong proficiency in SQL and Python for data manipulation, automation, and pipeline development.
  • Hands-on experience working within a major cloud environment such as AWS.
Nice-to-Haves
  • Demonstrated experience in evaluating, selecting, and implementing new ETL tools.
  • Database and warehouse proficiency across systems like PostgreSQL, Snowflake, BigQuery, and Redshift.

  • Data Centre Sales Specialist

    4 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Centre Sales Specialist role at NTT DATA, Inc.2 days ago Be among the first 25 applicantsJoin to apply for the Data Centre Sales Specialist role at NTT DATA, Inc.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and...

  • Game Development Pipeline Specialist

    2 days ago

    Sydney, New South Wales, Australia beBeePipeline Full time $120,000 - $150,000

    Game Development Pipeline SpecialistJob Description:As a Game Development Pipeline Specialist, you will play a crucial role in streamlining and enhancing the game development process. You will be responsible for designing, developing, and maintaining software tools and features that improve productivity and efficiency throughout the pipeline.Key...

  • Data Quality Specialist

    5 days ago

    Sydney, New South Wales, Australia beBeeDataQuality Full time

    Job Description:We are seeking a skilled and detail-oriented Data Quality Specialist to ensure the accuracy, reliability, and performance of our data-centric features. This is an excellent opportunity for individuals who thrive in dynamic environments and have a passion for delivering high-quality results.Key Responsibilities:Design and execute data...

  • AI Data Specialist

    2 days ago

    Sydney, New South Wales, Australia beBeeData Full time

    AI Data Specialist RoleEML is a leading Workers Compensation and Personal Injury Claims Management business. Our goal is to help people get their lives back through ongoing support during their return-to-work journey.We continue to experience growth and now have over 4,000 dedicated employees. We foster a learning culture that allows for continual investment...

  • Pipeline Deployment Specialist

    3 days ago

    Sydney, New South Wales, Australia beBeeRelease Full time $140,000 - $180,000

    Job DescriptionWe are seeking a skilled Pipeline Release Manager to oversee the release lifecycle, ensuring seamless deployment of pipeline code across development, test, and production environments.The successful candidate will collaborate with cross-functional teams to develop and maintain a robust release management process, identify potential risks, and...

  • Azure Partner Sales Specialist

    2 weeks ago

    Sydney, New South Wales, Australia Dicker Data Full time

    Join to apply for the Azure Partner Sales Specialist role at Dicker Data1 week ago Be among the first 25 applicantsJoin to apply for the Azure Partner Sales Specialist role at Dicker DataGet AI-powered advice on this job and more exclusive features.Founded in 1978, Dicker Data is Australia's leading locally owned and operated distributor of ICT hardware,...

  • Data Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataSpecialist Full time $160,000 - $200,000

    Immersive hands-on experience as a data specialist awaits in our trading firm, where data drives decisions that impact markets.You'll thrive in a high-performance environment with:Ownership of Sydney delivery backed by world-class teams globally.Building pipelines, tooling, and systems researchers can trust without compromise.Daily work with Databricks,...

  • Data Science Infrastructure Specialist

    1 day ago

    Sydney, New South Wales, Australia beBeeDataScience Full time $150,000 - $200,000

    Job Title: Data Science Infrastructure SpecialistThe successful candidate will design and implement scalable data pipelines, collaborate with cross-functional teams to integrate machine learning models into production, and ensure seamless deployment and monitoring of these models.Responsibilities:Develop Complex Data Pipelines: Utilize expertise in AWS...

  • Data Integration Specialist

    3 days ago

    Sydney, New South Wales, Australia beBeeDataIntegration Full time

    Job Description:We are seeking a highly skilled Data Integration Specialist to join our team. The ideal candidate will have expertise in designing and implementing data integration solutions using Microsoft Azure tools such as Azure Data Factory and SQL.The successful candidate will be responsible for developing, implementing, and maintaining ETL pipelines...

  • Business Intelligence Data Specialist

    45 minutes ago

    Sydney, New South Wales, Australia beBeeData Full time $100,000 - $130,000

    Job DescriptionThe role of Business Intelligence Developer is pivotal in converting raw data into actionable insights. This involves bridging the gap between our data platform and business stakeholders, utilizing skills in SQL, Python, DBT, and Snowflake to design and maintain robust data models that empower analytics and business intelligence.We seek a...