Data Pipeline Specialist

2 days ago

Sydney, New South Wales, Australia beBeeDataEngineer Full time $130,500 - $164,600
Job Summary

We are seeking an experienced Data Engineer to develop and maintain robust data pipelines and infrastructure for analytics, machine learning, and reporting platforms.

The ideal candidate will have a strong proficiency in cloud data warehouses, proficient SQL and Python coding skills, and experience developing Airflow or other open-source data orchestration tools.

About The Role

This role involves owning the development and maintenance of data pipelines and infrastructure to support analytics, machine learning, and reporting. You will design and implement efficient data pipelines to collect, process, and store large volumes of data from SQL sources, APIs, and streaming data.

  • Design and implement data pipelines using SQL and Python.
  • Maintain and operate the data platform using Airflow, dbt, Dataflow, ClickHouse, and BigQuery.
  • Achieve defined data availability and quality KPIs.
  • Implement data governance and security measures to ensure compliance with data privacy regulations.
  • Troubleshoot data-related issues and perform root-cause analysis.
Required Skills and Qualifications
  • B.S. in Computer Science or a related STEM field.
  • Minimum 3 years of experience as a data engineer.
  • Strong proficiency in cloud data warehouses.
  • Proficient SQL and Python coding skills.
  • Experience developing Airflow or other open-source data orchestration tools.
Benefits
  • Flexible work environment with remote days and office days.
  • Employee stock options.
  • Opportunity to work with passionate colleagues.
  • Engaging social initiatives and a collaborative culture.
Diversity and Inclusion

Cover Genius promotes diversity and inclusivity and does not tolerate discrimination or harassment based on protected status.

  • Data Pipeline Specialist

    5 days ago

    Sydney, New South Wales, Australia beBeePipeline Full time $140,000 - $180,000

    Job Opportunity: Data Pipeline SpecialistWe are seeking a highly skilled Data Pipeline Specialist to join our team. The successful candidate will be responsible for designing, implementing, and maintaining robust data pipelines that integrate data from diverse sources.The ideal candidate will have strong proficiency in SQL and Python for data manipulation,...

  • Data Pipeline Specialist

    24 hours ago

    Sydney, New South Wales, Australia beBeeDataPipeline Full time $200,000 - $250,000

    Key Role: Data Pipeline SpecialistWe are seeking a skilled data pipeline specialist to join our team.Design, optimize, and scale data pipelines using software engineering best practices (testing, version control, automation).Structure dbt projects and layers (staging, intermediate, marts) to ensure clarity, reusability, and business alignment.Embed...

  • Expert Data Pipeline Specialist

    1 week ago

    Sydney, New South Wales, Australia beBeeData Full time $100,000 - $150,000

    Job Summary:We are seeking an experienced Data Pipeline Specialist to play a vital role in ensuring the quality and integrity of our data pipelines.The ideal candidate will have 5+ years of expertise in SQL, Control-M, Unix, and data warehousing.Responsibilities Include:Design and ExecutionDesign, develop, and execute test plans and test cases for ETL...

  • Data Pipeline Architect

    1 day ago

    Sydney, New South Wales, Australia Bebeeintegration Full time

    Job Title: Data Integration SpecialistWe are on a mission to be a force for good, through our people, products and purpose.We seek individuals who are passionate, able to work at pace, comfortable with ambiguity, and committed to making a positive difference.Key Responsibilities:Design, build and optimize pipelines using AWS Glue, dbt, Airflow or similar...

  • Data Pipeline Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time

    About the RoleDrive's Data Operations team is seeking an ETL Engineer to help us achieve our vision of shaping the future of automotive in Australia. As a key member of this team, you will be responsible for designing, implementing, and maintaining efficient data pipelines that drive business value.The ideal candidate will have 5+ years of experience with...

  • Data Pipeline Specialist

    3 days ago

    Sydney, New South Wales, Australia beBeeETLEngineer Full time $120,000 - $140,000

    About this RoleWe are seeking an experienced ETL engineer to shape the future of automotive in Australia by providing authoritative reviews, detailed comparisons, and innovative commerce solutions.Your Key ResponsibilitiesDesign, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.Work with...

  • Data Pipeline Specialist

    1 week ago

    Sydney, New South Wales, Australia beBeeDevopser Full time $150,000 - $170,000

    Job DescriptionAs a DevOps Engineer, you will play a vital role in our trading technology team. You will be responsible for performing daily monitoring and market pre-open system checks utilizing automation, developing new tools and utilities to help build data pipelines and studies, and becoming a subject matter expert in our in-house systems and data...

  • Data Pipeline Specialist

    7 days ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $120,000 - $270,000

    Job Title: Data Engineer AssociateWe are looking for a highly skilled and motivated Data Engineer Associate to join our team. As a key member of our data engineering group, you will play a crucial role in designing, developing, and maintaining our modern data pipelines. You will be working closely with experienced engineers to develop solutions that improve...

  • Data Pipeline Architect

    3 days ago

    Sydney, New South Wales, Australia beBeeIntegration Full time $150,000 - $200,000

    Job Title: Data Integration SpecialistWe are on a mission to be a force for good, through our people, products and purpose.We seek individuals who are passionate, able to work at pace, comfortable with ambiguity, and committed to making a positive difference.Key Responsibilities:Design, build and optimize pipelines using AWS Glue, dbt, Airflow or similar...

  • Data Pipeline Strategist

    3 days ago

    Sydney, New South Wales, Australia beBeeData Full time $90,000 - $120,000

    Job OverviewData Analyst RoleThe Data Insights Specialist plays a vital role within the organization, supporting business projects by sourcing and maintaining data pipelines.Main Responsibilities:Design and maintain data pipelines by sourcing data across departments.Develop analytical data assets for self-service insights within the team.Analyze internal and...