Senior Data Pipeline Architect

2 weeks ago

Melbourne, Victoria, Australia beBeeData Full time $180,000 - $250,000

As a seasoned Data Engineer, you will play a pivotal role in shaping our data infrastructure and engineering strategies. You will lead the architecture and implementation of scalable, high-performance data pipelines, optimizing ETL/ELT processes with tools like Spark, Hadoop and Kafka.

Your expertise will be crucial in designing, building, maintaining, and enhancing scalable data pipelines and ensuring efficient data architecture. You will undertake practical work with complex and diverse datasets, focusing on data integration from various sources, ensuring real-time data flow and reliability across cloud platforms (AWS, Azure, GCP).

You will also oversee the automation and monitoring of data workflows, using languages and frameworks such as Python, Scala, and Kubernetes. Your solid understanding of data engineering and pipelines (SQL, ETL/ELT, distributed systems), metadata driven data engineering, and orchestration services will drive success in this role.

We are seeking an experienced professional with 4+ years of experience delivering data pipelines in a business environment. Analytical skills, problem-solving abilities, and communication skills are essential for this position. Technical skills include strong programming skills in Python, extensive experience with cloud platforms, and proficiency in big data technologies.

Job Description:
  • Design, build, maintain, and enhance scalable data pipelines
  • Lead the architecture and implementation of data pipelines
  • Oversight of data integration from various sources

Required Skills and Qualifications:

  • Strong analytical skills
  • Problem-solving abilities
  • Communication skills
  • Technical skills: Strong programming skills in Python, extensive experience with cloud platforms, and proficiency in big data technologies

Benefits:

  • The opportunity to work with leading organisations and cutting-edge technology that challenge and expand your expertise
  • Flexibility to choose when, where, and how you work
  • Clear paths for career progression supported by continuous learning and leadership development

  • Chief Data Pipeline Architect

    2 weeks ago

    Melbourne, Victoria, Australia beBeeSoftwareEngineer Full time $120,000 - $180,000

    This is a unique opportunity to leverage your expertise as a Software/Data Engineer and contribute to the development of modern data platforms.As a key member of our team, you will work with innovative technologies like Apache Spark, architect high-performance distributed applications, and integrate tools for seamless data governance and machine learning...

  • Senior Data Architect

    2 weeks ago

    Melbourne, Victoria, Australia beBeeDataEngineer Full time $180,000 - $210,000

    Job DescriptionAs a senior data engineer, you will play a crucial role in architecting and evolving core components of the data ingestion platform. Your expertise will shape how data flows across domains at enterprise scale.The ideal candidate will combine deep systems thinking with hands-on development and mentorship skills. You will lead the development of...

  • Senior Data Architect

    2 weeks ago

    Melbourne, Victoria, Australia Datamatics Full time

    Role: Senior Data ArchitectLocation: Melbourne/SydneyRequired experience: 12-15yrsDemonstrated domain experience in BFSI and Manufacturing industriesLead strategic enterprise data transformations with SAS to Databricks migration as a core capabilityArchitect cloud-native data platforms using Microsoft Azure (ADF, ADLS, Azure SQL, Synapse)Design scalable data...

  • Building Efficient Data Pipelines

    2 weeks ago

    Melbourne, Victoria, Australia beBeeData Full time $160,000 - $200,000

    Key Data Engineering RoleCraft and implement high-performance data pipelines that support our entire data ecosystem as a skilled Software Development Data Engineer.Pipeline Architecture OverviewBuild efficient data acquisition pipelines integrating with various systems across the industry, leveraging software development principles and system architecture...

  • Senior Data Architect

    1 week ago

    Melbourne, Victoria, Australia beBeeDataEngineer Full time $112,858 - $145,583

    Job OverviewKey Responsibilities:Develop scalable data architectures to support business intelligence, advanced analytics, and self-service reporting.Design and build enterprise data warehouses and large-scale data processing systems that deliver business insights.Collaborate with stakeholders to implement modern data engineering practices that streamline...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Melbourne, Victoria, Australia beBeeDataEngineer Full time $150,000 - $180,000

    About our Data Engineering role:We are passionate about simplifying complex data solutions by saving time, money, and effort.With over 20 years' experience in cloud-based platforms, we compare a wide range of data solutions and our trained experts help customers to compare, select and save more, putting them in control.The ideal candidate will use their...

  • Senior Data Engineer

    1 week ago

    Melbourne, Victoria, Australia beBeeDataEngineer Full time $122,736 - $132,847

    This is a senior data engineer position at a top ASX-listed company. We are seeking an experienced professional to join our team and contribute to the design, development, and maintenance of scalable AWS Glue pipelines.The ideal candidate will have a strong background in data engineering with experience working on complex datasets and cloud-based pipeline...

  • Data Architect Opportunity

    1 week ago

    Melbourne, Victoria, Australia beBeeData Full time $120,000 - $180,000

    Senior Data ArchitectJob Title: Senior Data ArchitectAs a seasoned data architect, you will be responsible for leading the development of logical and physical entity relationship diagrams and defining standards for a new data lake in a financial services business. This is an excellent opportunity to utilise your expertise in data modelling methodologies to...

  • Senior Data Lakehouse Architect

    1 week ago

    Melbourne, Victoria, Australia beBeeDataLakehouse Full time $140,000 - $160,000

    Data Lakehouse ArchitectWe are seeking a highly skilled Data Lakehouse Architect to lead our journey towards a unified lakehouse on Databricks.As a senior data specialist, you will own the transformation from legacy silos to a modern data platform, steering presales conversations and facilitating discovery workshops. You will shape target architecture and...

  • Senior Data Architect

    1 week ago

    Melbourne, Victoria, Australia beBeeData Full time $90,000 - $140,000

    Job Description: We are seeking a highly skilled Data Architect to join our team. As a Data Architect, you will design and build scalable data pipelines to ingest, transform, and load data from various sources. Key Responsibilities: Design and implement data architectures to meet business requirements Develop and maintain data quality standards and metrics...