Data Pipeline Architect

7 days ago

Sydney, New South Wales, Australia beBeeData Full time $100,000 - $170,000
Job Description

As a Senior Data Engineer, you will play a pivotal role in crafting and implementing cutting-edge data pipelines that transform raw market data into actionable insights for traders worldwide.

Our ideal candidate will possess exceptional technical skills, paired with outstanding collaboration and problem-solving abilities.

Key Responsibilities:
  • Design, build, and maintain high-performance data pipelines to deliver relevant and timely data to our users.
  • Implement and maintain AWS cloud infrastructure for the data team in APAC.
  • Develop and optimize ELT processes to transform raw data into meaningful insights.
  • Manage and optimize data warehousing plans in Snowflake, ensuring efficient storage, retrieval, and analysis of data.
  • Implement and maintain data lakes, ensuring data organization, security, and availability.
  • Collaborate with BI developers, business analysts, and internal stakeholders to understand data needs and deliver data in a secure, scalable, and efficient way.
  • Ensure data quality, integrity, and governance by implementing best practices across the entire data lifecycle.
  • Perform performance tuning and optimization of data queries and pipelines.
Requirements:
  • 5+ years of experience as a Data Engineer or similar role.
  • Infrastructure as code (Terraform preferably).
  • Python.
  • Redshift or Snowflake.
  • DBT.
  • SQL.
  • GitHub.
  • Excellent communication, collaboration, and problem-solving skills.
  • Full Australian working rights.

  • Data Pipeline Architect

    1 week ago

    Sydney, New South Wales, Australia beBeeDataEngineering Full time $170,000 - $200,000

    Job Description:As a Lead Data Engineer, you will design, build, and optimize data pipeline solutions on Databricks and related cloud platforms. You will work closely with data scientists, analysts, and engineers to ensure our data infrastructure supports advanced analytics and business insights across industries.You will contribute to Data Architecture and...

  • Data Architect

    6 days ago

    Sydney, New South Wales, Australia beBeeData Full time $120,000 - $160,000

    Job Opportunity: Data ArchitectWe are seeking a highly skilled Data Architect to design and implement cutting-edge data solutions in Azure. This individual will work closely with technical teams to develop efficient, high-quality data pipelines.Key Responsibilities:Design, develop, and maintain scalable data architectures using Databricks and Spark...

  • Senior Data Infrastructure Specialist

    2 days ago

    Sydney, New South Wales, Australia beBeeData Architect Full time $160,000 - $200,000

    Job SummaryWe are seeking an accomplished data architect to spearhead the development of a hybrid on-premises and cloud-based data platform. This position demands expertise in designing scalable, high-performance data infrastructure that supports trading, research, and operations by ensuring accurate, timely, and accessible data.About the RoleCreate...

  • Data Pipeline Architect

    3 days ago

    Sydney, New South Wales, Australia Bebeeintegration Full time

    Job Title: Data Integration SpecialistWe are on a mission to be a force for good, through our people, products and purpose.We seek individuals who are passionate, able to work at pace, comfortable with ambiguity, and committed to making a positive difference.Key Responsibilities:Design, build and optimize pipelines using AWS Glue, dbt, Airflow or similar...

  • Data Pipeline Architect

    5 days ago

    Sydney, New South Wales, Australia beBeeIntegration Full time $150,000 - $200,000

    Job Title: Data Integration SpecialistWe are on a mission to be a force for good, through our people, products and purpose.We seek individuals who are passionate, able to work at pace, comfortable with ambiguity, and committed to making a positive difference.Key Responsibilities:Design, build and optimize pipelines using AWS Glue, dbt, Airflow or similar...

  • Data Pipeline Specialist

    10 hours ago

    Sydney, New South Wales, Australia beBeeAutomation Full time $140,000 - $170,000

    Systems ArchitectWe are a global financial trading firm with a drive to deeply understand the world around us and make optimal business decisions every day.Your role involves performing support, deployment, and automation tasks related to data pipelines throughout the Asia Pacific region as part of our trading technology team.This role is integral to our...

  • Data Pipeline Architect

    1 week ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $90,000 - $120,000

    About the RoleWe're seeking a skilled professional to develop data pipelines, optimize architecture, and enable stakeholders to make informed decisions.Design, build, and maintain scalable ETL pipelines for extracting, transforming, and loading data from various systems.Collaborate with analysts, scientists, and domain specialists to deliver optimized data...

  • Lead Data Pipeline Developer

    3 days ago

    Sydney, New South Wales, Australia Bebeedataengineering Full time

    Software Engineer PositionWe are seeking an experienced software engineer to collaborate with our global teams and contribute to the development of cutting-edge software solutions that support large-scale data processing and analytics.Job Description:We design and build custom software components for data pipelines using Python or other programming...

  • Data Architect

    2 days ago

    Sydney, New South Wales, Australia beBeeData Full time $180,000 - $220,000

    Job OverviewAs a skilled data architect, you will be responsible for designing and implementing scalable data architecture to meet the needs of our organization. Your expertise in data engineering and pipelines will enable you to drive business outcomes through innovative solutions.Key Responsibilities:Develop and maintain robust data pipelines using ETL/ELT...

  • Data Architect

    6 days ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    OverviewDrive long-term value and innovation through data-led transformationBe involved in key transformation projectsMake Your Mark – Newly Created PositionAbout usEstablished in 2007, CDC Data Centresis Australia's leading operator of sovereign, secure, world-class data centre facilities.Headquartered in Canberra with multiple facilities in the ACT, NSW,...