Senior Data Pipeline Specialist

3 days ago

Sydney, New South Wales, Australia beBeeData Full time $120,000 - $175,000
Are you a seasoned data professional looking for your next challenge? We have an exciting opportunity for a Data Engineer to join our team in a large-scale program. As a key member of our technical team, you will be responsible for designing, building, and maintaining data pipelines in an Azure environment.This role requires strong expertise in Databricks and Spark SQL, including joins and query optimization. You should also have hands-on experience with ETL development and pipeline orchestration, as well as solid SQL skills and the ability to work with large datasets.We are seeking a mid-senior level Data Engineer who can collaborate with cross-functional teams to align data flows and resolve issues. The ideal candidate will have proven experience in a cloud environment and be able to ensure that data pipelines are reliable, efficient, and well-documented.If you have a passion for data engineering and a desire to work on challenging projects, we encourage you to apply for this exciting opportunity.Key Responsibilities:
  • Design, build, and maintain ETL pipelines using Databricks and Spark SQL
  • Develop and optimize SQL queries for large-scale data transformation and performance
  • Extract and load data from source systems into Azure-based data warehouses and downstream platforms
  • Collaborate with data and integration teams to align data flows and resolve issues
  • Ensure data pipelines are reliable, efficient, and well-documented
  • Support testing, troubleshooting, and performance tuning activities
Required Skills and Qualifications:
  • Proven experience as a Data Engineer or similar role in a cloud environment
  • Strong expertise in Databricks and Spark SQL, including joins and query optimization
  • Hands-on experience with ETL development and pipeline orchestration (Azure Data Factory desirable)
  • Solid SQL skills and ability to work with large datasets
  • Familiarity with Azure data services (Data Lake, Synapse, D365 exposure a bonus)
  • Strong problem-solving skills and ability to work collaboratively within cross-functional teams
Benefits:
  • Mid-senior level position with opportunities for growth and development
  • Collaborative and dynamic work environment
  • Competitive salary and benefits package
Others:

Interested candidates who meet the required skillset of the role are encouraged to apply via the link with an updated resume.

  • Data Pipeline Specialist

    1 week ago

    Sydney, New South Wales, Australia beBeePipeline Full time $140,000 - $180,000

    Job Opportunity: Data Pipeline SpecialistWe are seeking a highly skilled Data Pipeline Specialist to join our team. The successful candidate will be responsible for designing, implementing, and maintaining robust data pipelines that integrate data from diverse sources.The ideal candidate will have strong proficiency in SQL and Python for data manipulation,...

  • Data Pipeline Specialist

    3 days ago

    Sydney, New South Wales, Australia beBeeDataPipeline Full time $200,000 - $250,000

    Key Role: Data Pipeline SpecialistWe are seeking a skilled data pipeline specialist to join our team.Design, optimize, and scale data pipelines using software engineering best practices (testing, version control, automation).Structure dbt projects and layers (staging, intermediate, marts) to ensure clarity, reusability, and business alignment.Embed...

  • Senior Data Pipeline Specialist

    9 hours ago

    Sydney, New South Wales, Australia beBeeData Full time $120,000 - $180,000

    Lead Data EngineerThis is a 6-month project in Sydney with the possibility of extension.About the Role:The ideal candidate will have extensive experience in ADF and SSIS development, GIT, and JSON. They will be responsible for developing data pipelines, performing code reviews, issue resolution, and mentoring junior developers.Key Responsibilities:Develop...

  • Data Pipeline Specialist

    1 week ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $120,000 - $270,000

    Job Title: Data Engineer AssociateWe are looking for a highly skilled and motivated Data Engineer Associate to join our team. As a key member of our data engineering group, you will play a crucial role in designing, developing, and maintaining our modern data pipelines. You will be working closely with experienced engineers to develop solutions that improve...

  • Senior Data Pipeline Specialist

    1 week ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $90,000 - $120,000

    We're seeking a skilled Data Engineer to join our high-performing team. As a key member, you'll play a pivotal role in building and maintaining robust data pipelines that drive business growth.Key Responsibilities:Data Pipeline Development: Design, develop, and deploy scalable data pipelines using cutting-edge tools and technologies such as Apache Spark,...

  • Data Pipeline Strategist

    5 days ago

    Sydney, New South Wales, Australia beBeeData Full time $90,000 - $120,000

    Job OverviewData Analyst RoleThe Data Insights Specialist plays a vital role within the organization, supporting business projects by sourcing and maintaining data pipelines.Main Responsibilities:Design and maintain data pipelines by sourcing data across departments.Develop analytical data assets for self-service insights within the team.Analyze internal and...

  • Senior Data Pipeline Engineer

    5 days ago

    Sydney, New South Wales, Australia beBeeDataPipelineEngineer Full time $120,000 - $150,000

    Senior Data Pipeline EngineerRole OverviewWe are seeking a highly skilled Senior Data Pipeline Engineer to drive the evolution of an existing proof-of-concept (PoC) into a robust and scalable production-ready service.This individual will be responsible for designing, implementing, and maintaining large-scale data pipelines that support ongoing monitoring and...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $120,000 - $180,000

    Drive is a leading automotive enthusiast brand. We're looking for a skilled professional to help us achieve our vision of shaping the future of automotive in Australia.We're a business with extensive reach across all media channels, including TV, digital, social, print, and radio. Our data operations are at the heart of this vision, and we need someone to...

  • Principal Data Pipeline Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $80,000 - $120,000

    Job OverviewWe're seeking a talented Data Engineer to support the development and maintenance of modern data pipelines. In this role, you'll gain hands-on experience with tools like DBT, Airflow, Snowflake, and Databricks while working alongside experienced engineers to design data models, improve data quality, and document solutions.Data Engineering...

  • Senior Data Pipeline Specialist

    1 week ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $90,000 - $170,000

    Job OverviewThe role of Data Engineer involves designing and optimizing data pipelines to power business insights.Designing robust data architectures that integrate diverse data sources including SQL databases and flat files.Managing structured data and metadata efficiently, utilizing tools for querying, reporting, and OLAP.Data Engineers will be responsible...