Cloud Data Pipeline Developer

1 day ago

Melbourne, Victoria, Australia beBeeData Full time $122,736 - $132,847
Data Engineering Opportunity

We are seeking an experienced Data Engineer to join our team. This is a permanent opportunity with a strong focus on cloud-based pipeline development.

  • Design, build, and optimize scalable AWS Glue (PySpark) pipelines for structured and semi-structured data sources using industry-standard practices and tools.
  • Develop clear and accurate source-to-target mappings and integration specifications across complex datasets to ensure seamless data flow.
  • Ingest and transform data from multiple systems into S3, Elastic, and downstream platforms using robust ETL/ELT design patterns.
  • Collaborate with cross-functional teams including architects, business SMEs, and ETL/BI developers to drive innovation and efficiency in data engineering.
  • Ensure pipelines are production-grade, fault-tolerant, and aligned to data governance and security standards to maintain high-quality data delivery.
Requirements:
  • 5+ years of experience in Data Engineering in enterprise environments with a proven track record of delivering large-scale projects.
  • Strong hands-on expertise in AWS Glue (PySpark), AWS native services (e.g., S3, Lambda, Athena, Step Functions), and data modeling techniques.
  • Practical experience integrating with Elastic/Elasticsearch for data indexing and retrieval to enhance search functionality.
  • Deep understanding of ETL/ELT design patterns, Change Data Capture (CDC), and data modeling principles to ensure efficient data processing.
  • Solid grasp of source-to-target mapping principles and best practices to guarantee accurate data transfer.
  • Strong SQL and Python skills to write efficient and scalable code.

This role presents an exciting opportunity to contribute to the development of scalable and reliable data pipelines in a top ASX-listed company.

  • Key Data Pipeline Developer

    3 days ago

    Melbourne, Victoria, Australia beBeeDataEngineer Full time $120,000 - $140,000

    Build Scalable Data Pipelines as a Key Team MemberThe role of Data Engineer is pivotal in our organization, requiring collaboration with stakeholders to design and develop data pipelines that meet business needs. This involves working closely with the technology team to build robust end-to-end solutions.Responsibilities:Develop and maintain high-quality data...

  • Data Pipeline Architect

    4 days ago

    Melbourne, Victoria, Australia beBeeData Full time $120,000 - $160,000

    About our organization:We support millions of Australians in comparing and purchasing personal finance and household products.Our company makes Australians' lives easier by saving them time, money, and effort. With over 20 years of experience, we are a one-stop destination for comparison and purchasing across insurance, utilities, and personal finance...

  • Data Pipeline Engineer

    5 days ago

    Melbourne, Victoria, Australia beBeeData Full time $140,000 - $170,000

    Job Description">As a Data Engineer, you will play a key role in automating and optimizing data workflows to ensure efficiency and scalability. You will be responsible for designing and implementing CI/CD pipelines, developing infrastructure-as-code templates, and automating ETL/ELT workflow management.Key Responsibilities:Design and implement CI/CD...

  • Data Pipeline Specialist

    7 days ago

    Melbourne, Victoria, Australia beBeeDataPipeline Full time

    Job Title:Data Pipeline Specialist">About Us:We are a forward-thinking organization that simplifies the process of making informed financial decisions. Our mission is to make a positive impact in the lives of our customers by providing seamless data delivery across the organization.iSelect and Compare the Market: At iSelect and Compare the Market, we're...

  • Cloud Data Infrastructure Developer

    2 days ago

    Melbourne, Victoria, Australia beBeeDataInfrastructure Full time $190,000 - $205,000

    Cloud Data Infrastructure DeveloperWe are seeking a highly skilled Cloud Data Infrastructure Developer to lead the development of scalable, cloud-native data infrastructure that powers fundraising and supporter engagement.Key ResponsibilitiesDesign and implement efficient data models using SQL and dbt to ensure seamless storage, transformation, and...

  • Building Scalable Data Pipelines

    3 days ago

    Melbourne, Victoria, Australia beBeeDataEngineering Full time $190,000 - $220,000

    Job Title: Data EngineerJob Description:We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining scalable data pipelines and ETL processes.This role requires a strong understanding of cloud data architecture and big data platforms. You will work closely with data...

  • Cloud Data Architect

    1 day ago

    Melbourne, Victoria, Australia beBeeDataEngineer Full time $100,000 - $150,000

    Job OverviewData Engineer - Cloud ArchitectureAs a senior data engineer, you will be responsible for designing and implementing cloud-based architectures to support our business goals.The ideal candidate will have hands-on experience with cloud platforms such as AWS, Azure, or GCP, as well as strong expertise in data engineering, architecture, and...

  • Data Engineer

    2 days ago

    Melbourne, Victoria, Australia beBeeDataEngineer Full time $90,000 - $120,000

    About This RoleWe're seeking a skilled professional to drive our data pipeline efficiency and scalability.Job SummaryThis role focuses on optimizing data workflows, implementing cloud infrastructure, and ensuring seamless data delivery across the organization.Key ResponsibilitiesData Pipeline Automation: Design, implement, and maintain CI/CD pipelines for...

  • Cloud Data Specialist

    1 week ago

    Melbourne, Victoria, Australia beBeeCloudDataSpecialist Full time $140,000 - $170,000

    About Cloud Data SpecialistWe are seeking an experienced Cloud Data Specialist to drive the design and implementation of large-scale cloud data systems. This role will involve overseeing complex technical work, focusing on high-volume data handling across multiple cloud platforms.Main Responsibilities:Ensure efficient ingestion, transformation, and...

  • Cloud Data Architect

    2 days ago

    Melbourne, Victoria, Australia beBeeData Full time $90,000 - $153,000

    Job Description:As a skilled Snowflake Engineer, you will play a crucial role in designing, developing, and managing data solutions using the Snowflake cloud data platform. You will work closely with clients to understand their data needs and provide tailored solutions.Key Responsibilities:Design and develop data pipelines that meet business...