Senior Data Pipeline Architect

2 days ago

Sydney, New South Wales, Australia beBeeDataEngineering Full time $120,000 - $180,000

Job Description

As a Snr Data Engineer, you will play a critical role in designing and managing cloud databases and data pipelines that underpin a decoupled cloud architecture and API-first approach.

You will collaborate with cross-functional teams to design, develop, deploy, and operate data services and solutions for a cloud ecosystem.

Key responsibilities include owning functional and non-functional design aspects, contributing to roadmaps, and technical direction of data services on AWS environments.

Additionally, you will model data and ensure quality, availability, and reliability to support advanced analytics, machine learning, and generative AI requirements.

  • Design, create, and manage cloud databases and data pipelines.
  • Collaborate with cross-functional teams to design, develop, deploy, and operate data services and solutions.
  • Own functional and non-functional design aspects and contribute to roadmaps and technical direction.
  • Model data and ensure quality, availability, and reliability.

Required Skills and Qualifications

The ideal candidate will have a deep understanding of data modelling and data quality, extensive experience with SQL and relational databases, and expertise in designing and building reliable and efficient data pipelines using modern cloud services on AWS.

Other key skills and qualifications include experience with data-centric frameworks such as Spark, programming knowledge in Scala or Python, comfort with Linux, shell scripting, and automation frameworks, and experience with version control (e.g., Git) and CI/CD practices.

  • Deep understanding of data modelling and data quality.
  • Extensive experience with SQL and relational databases.
  • Experience designing and building reliable and efficient data pipelines.
  • Expertise in data-centric frameworks such as Spark.
  • Programming knowledge in Scala or Python.
  • Comfort with Linux, shell scripting, and automation frameworks.
  • Experience with version control (e.g., Git) and CI/CD practices.

Benefits

We offer flexible work arrangements, including in-office and remote options, with partial in-office time and other flexible working arrangements available. We value diversity, inclusion, and a respectful workplace, and encourage ideas and initiative.

Others

If you are passionate about data engineering and have the required skills and qualifications, we encourage you to apply today.

  • Senior Data Architect

    1 day ago

    Sydney, New South Wales, Australia beBeeDataArchitect Full time $118,000 - $145,000

    Job Title: Senior Data Architect\We are seeking a highly skilled Senior Data Architect to join our team. As a key member of the Engineering division, you will work closely with stakeholders to understand data objectives and champion the use and evolution of the central data platform.\About the Role:\You will collaborate with line-of-business data and...

  • Senior Data Architect

    3 weeks ago

    Sydney, New South Wales, Australia Maltem Australia Full time

    2 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Direct message the job poster from Maltem AustraliaEngagement: Contractor, initial 25-day part-time engagement with potential extensionStart Date: Approximately the end of AugustAbout Maltem:Maltem is a global consulting group specialising in digital...

  • Senior Data Architect

    6 days ago

    Sydney, New South Wales, Australia Maltem Australia Full time

    2 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Direct message the job poster from Maltem AustraliaEngagement: Contractor, initial 25-day part-time engagement with potential extensionStart Date: Approximately the end of AugustAbout Maltem:Maltem is a global consulting group specialising in digital...

  • Data Architect

    5 days ago

    Sydney, New South Wales, Australia Krauss Partners Full time

    Get AI-powered advice on this job and more exclusive features.This range is provided by Krauss Partners.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Base pay rangeA$150,000.00/yr - A$170,000.00/yrData Architect - Health Sector | SydneyWe are seeking an experienced Data Architect to join a health...

  • Senior Data Engineer/Architect

    2 weeks ago

    Sydney, New South Wales, Australia Ingrity Full time

    Ingrity Millers Point, New South Wales, AustraliaJoin or sign in to find your next jobJoin to apply for the Senior Data Engineer/Architect - Azure role at IngrityIngrity Millers Point, New South Wales, Australia1 day ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer/Architect - Azure role at IngrityGet AI-powered advice on this...

  • Senior Data Architect

    3 days ago

    Sydney, New South Wales, Australia beBeeData Full time $150,000 - $250,000

    Senior Data Architect OpportunityWe are seeking a seasoned data architect to lead our regulatory epics and transform our regulatory reporting platform. This is an exceptional opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within our high-performing Data Team.The team collaborates across a wide...

  • Senior Data Architect Position

    18 hours ago

    Sydney, New South Wales, Australia beBeeInformatica Full time $140,000 - $180,000

    Data ArchitectExpert360 is seeking a seasoned data architect to drive the development of scalable data solutions and lead complex migration projects.Key Responsibilities:Design and implement scalable data solutions using Informatica IDMC/CDI, PowerCenter, and related ETL tools across large, diverse data platforms.Lead solution design efforts for large-scale...

  • Data Architect

    6 days ago

    Sydney, New South Wales, Australia Krauss Partners Full time

    Get AI-powered advice on this job and more exclusive features.This range is provided by Krauss Partners. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Base pay rangeA$150,000.00/yr - A$170,000.00/yrData Architect - Health Sector | SydneyWe are seeking an experienced Data Architect to join a health...

  • Lead Data Architect

    4 days ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $180,000 - $220,000

    We're looking for a seasoned data professional to lead the design and implementation of complex data pipelines and infrastructure solutions.Key ResponsibilitiesDevelop high-performance and scalable data ingestion pipelines for property data assets.Establish them as the authoritative source for all property-related decisions and lifecycle journeys across...

  • Data Architect

    3 days ago

    Sydney, New South Wales, Australia Minfy Full time

    Overview Role Summary: We are seeking a Part-Time Data Architect to design, oversee, and guide the implementation of scalable, secure, and efficient data architectures for enterprise-grade digital transformation projects. This role will support active initiatives in data platforms, AI/ML, GenAI, and application modernization, ensuring data systems are...