Senior Data Pipeline Specialist

5 days ago

Brisbane, Queensland, Australia beBeeDataEngineer Full time $120,000 - $180,000

About the Role:

We are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have expertise in automating, monitoring, and optimizing data pipelines and infrastructure to ensure efficient, scalable, and reliable data workflows.

The successful candidate will focus on implementing DataOps best practices, CI/CD automation, cloud infrastructure, observability, and security, enabling seamless data delivery across the organization.

Key Responsibilities include streamlining data pipeline deployment through CI/CD, ensuring observability, performance, and security in cloud data environments, automating infrastructure management and data workflow orchestration, driving best practices for DataOps, governance, and cost optimization.

Key Technologies:

  • Cloud data platforms (AWS, Azure, GCP)
  • Orchestration tools (Apache Airflow, Prefect, Dagster, AWS Step Functions)
  • Infrastructure-as-code (IaC) templates (Terraform)
  • Observability tools (Datadog, Prometheus, Grafana, CloudWatch)

Required Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, Cloud Computing, or a related field
  • 3+ years of experience in DevOps, Data Engineering, or Cloud Infrastructure roles
  • Experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps etc.)
  • Proficiency in Python, Bash, or PowerShell for automation and scripting

Benefits:

  • Career Opportunities
  • Competitive salary plus generous commission scheme
  • Opportunity to work with a well-known, household brand
  • Work with a team of highly energised, motivated and driven professionals

What's next?

If you are someone who fosters team spirit, has resilience and aspires to continue learning and developing your skills to drive commercial outcomes, you will have tremendous success in helping us achieve our progressive growth agendas. High energy levels and a love of having fun are also important to working in this energetic business.

  • Analytical Data Pipeline Specialist

    2 weeks ago

    Brisbane, Queensland, Australia beBeeDataEngineer Full time $140,000 - $180,000

    Senior Data Engineer Job DescriptionAre you a skilled data engineer looking for a new challenge? Do you have experience building analytical data pipelines in cloud systems? We are seeking a Senior Data Engineer to join our team and help us drive value for the business.The ideal candidate will have solid experience building ETL pipelines for production...

  • Data Pipeline Tester

    7 days ago

    Brisbane, Queensland, Australia beBeeSpecialist Full time $90,000 - $122,500

    About this role, we are on an exciting journey to deliver high-quality, reliable data pipelines that underpin business decisions and digital services. Our ETL Specialists will directly contribute to ensuring data integrity, accuracy, and completeness across multiple systems, supporting a seamless data-driven environment.Key Responsibilities:Test, validate,...

  • Data Pipeline Specialist

    1 week ago

    Brisbane, Queensland, Australia beBeeDataEngineering Full time $150,000 - $200,000

    Job Title: Data EngineerThe CareCone Group is seeking a skilled professional to design, build, and maintain scalable data pipelines for structured and unstructured data. As a key member of our team, you will collaborate with data scientists, analysts, and business teams to understand data needs and implement data storage solutions such as data lakes and data...

  • Data Pipeline Automation Expert

    2 weeks ago

    Brisbane, Queensland, Australia beBeeAutomation Full time $124,342 - $153,041

    Job SummaryWe're seeking a skilled Data Pipeline Automation Specialist to design and implement cutting-edge data workflows.The successful candidate will be responsible for developing infrastructure-as-code templates, implementing automated ETL/ELT workflow management using orchestration tools, and ensuring scalability and efficiency of data pipelines.

  • Senior Pipeline Engineer

    6 days ago

    Brisbane, Queensland, Australia beBeePipeline Full time $120,000 - $140,000

    Job Title:Senior Pipeline Engineering SpecialistAbout the Role:We are seeking an experienced Senior Pipeline Engineering Specialist to join our team. The successful candidate will be responsible for designing and developing pipeline systems, including mechanical, civil, and process engineering.Key Responsibilities:Design and develop pipeline systems,...

  • Data Pipeline Developer

    7 days ago

    Brisbane, Queensland, Australia beBeeDataPipeline Full time $160,000 - $170,000

    Job SummaryAbout the RoleAs a Data Pipeline Developer, you will be responsible for designing and implementing efficient data pipelines to support analytics and reporting. You will write and optimize SQL queries for high-performing data processing and retrieval.Key Responsibilities:Design and implement data pipelines using ETL frameworks and tools.Write and...

  • Data Pipeline Architect

    2 weeks ago

    Brisbane, Queensland, Australia beBeeData Full time $100,000 - $140,000

    Job Title: Data Pipeline ArchitectThis role involves the design, implementation and maintenance of data pipelines that are efficient, scalable and reliable. The ideal candidate will have expertise in DevOps, cloud data platforms, infrastructure automation and data pipeline orchestration.The primary objectives of this role are:Streamlining data pipeline...

  • Lead Data Engineer

    1 week ago

    Brisbane, Queensland, Australia beBeeDataEngineering Full time $120,000 - $180,000

    Job DescriptionWe are seeking an accomplished Lead Data Engineer to spearhead the design, development, and optimization of data pipeline solutions on Databricks and related cloud platforms. This role will entail collaborating with cross-functional teams, including data scientists, analysts, and engineers, to deliver advanced analytics and business insights...

  • Senior Pipeline Integrity Specialist

    2 weeks ago

    Brisbane, Queensland, Australia beBeePipelineSpecialist Full time $105,000 - $155,000

    Senior Pipeline Integrity SpecialistThis role plays a vital part in providing pipeline integrity advice to clients from both strategic and front-line perspectives. As an integral member of a high-performing team of integrity professionals, you will execute jobs of varying sizes and complexity.To ensure your success, you will be mentored by experienced...

  • Chief Data Pipeline Architect

    1 day ago

    Brisbane, Queensland, Australia beBeeDataEngineer Full time $70,000 - $120,000

    Senior Data Engineer PositionWe are seeking a highly skilled data engineer to design and implement scalable data pipelines, directly supporting analytics and business decision-making.The ideal candidate will have hands-on experience with SQL, ETL frameworks, and performance tuning. They will also possess strong skills in data modelling, transformation, and...