Building Scalable Data Pipelines

2 days ago

Melbourne, Victoria, Australia beBeeDataEngineering Full time $190,000 - $220,000

Job Title: Data Engineer

Job Description:

We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining scalable data pipelines and ETL processes.

This role requires a strong understanding of cloud data architecture and big data platforms. You will work closely with data scientists, analysts, and business stakeholders to support analytical and operational needs.

Key Responsibilities:
  • Design, build, and maintain scalable data pipelines and ETL processes.
  • Work with large data sets across cloud environments to deliver high-quality, reliable data solutions.
  • Collaborate with cross-functional teams to support analytical and operational needs.
  • Optimise data workflows for performance, reliability, and cost efficiency.
  • Drive best practices in data engineering, coding standards, and solution architecture.
Required Skills and Qualifications:
  • Strong experience with Databricks and Microsoft stack (Azure Data Factory, Synapse, SQL Server, Power BI).
  • Proven track record in developing and optimising data pipelines and ETL processes.
  • Solid understanding of cloud data architecture and big data platforms.
  • Proficiency in Python, PySpark.
  • Excellent problem-solving skills and ability to work in a fast-paced environment.
Benefits:
  • Competitive salary.
  • Opportunities for professional growth and development.
  • Collaborative and dynamic work environment.
Others:

The ideal candidate will have a passion for innovation and a desire to make a meaningful impact.

  • Building Scalable Data Systems

    1 day ago

    Melbourne, Victoria, Australia beBeeDataEngineer Full time $80 - $100

    As a Data Engineer, you will be responsible for designing and building scalable data pipelines to support business needs.Working collaboratively with cross-functional teams, you will gather data requirements and deliver solutions that optimize data systems and workflows for enhanced efficiency.Key responsibilities include implementing data quality checks,...

  • Data Pipeline Architect

    3 days ago

    Melbourne, Victoria, Australia beBeeDataConsultant Full time $150,000 - $180,000

    Senior Data ConsultantAs a seasoned Senior Data Consultant, you will be responsible for developing and delivering high-quality data solutions that drive business value.You will work closely with cross-functional teams to design, build, and maintain scalable and reliable data pipelines that extract, transform, and load (ETL/ELT) data from various sources into...

  • Data Pipeline Engineer

    11 hours ago

    Melbourne, Victoria, Australia beBeeData Full time $150,000 - $200,000

    About the Role">The Data Acquisition Team is responsible for ingesting, validating and orchestrating raw data from internal systems and third-party providers. As a Software Developer, you'll play a key role in designing robust, scalable pipelines that feed the entire data ecosystem.">The team builds the foundation of WEX's data platform transformation,...

  • Building Scalable Data Systems

    7 days ago

    Melbourne, Victoria, Australia beBeeDataEngineer Full time

    Job OverviewThe Data Acquisition Team is responsible for ingesting, validating, and orchestrating raw data from internal systems and third-party providers.As a Software Engineer, you will design and build robust pipelines that feed the entire data ecosystem at WEX. You will work across multiple data domains and ingestion patterns—batch, streaming, and...

  • Key Data Pipeline Developer

    2 days ago

    Melbourne, Victoria, Australia beBeeDataEngineer Full time $120,000 - $140,000

    Build Scalable Data Pipelines as a Key Team MemberThe role of Data Engineer is pivotal in our organization, requiring collaboration with stakeholders to design and develop data pipelines that meet business needs. This involves working closely with the technology team to build robust end-to-end solutions.Responsibilities:Develop and maintain high-quality data...

  • Cloud Data Pipeline Developer

    11 hours ago

    Melbourne, Victoria, Australia beBeeData Full time $122,736 - $132,847

    Data Engineering OpportunityWe are seeking an experienced Data Engineer to join our team. This is a permanent opportunity with a strong focus on cloud-based pipeline development.Design, build, and optimize scalable AWS Glue (PySpark) pipelines for structured and semi-structured data sources using industry-standard practices and tools.Develop clear and...

  • Data Pipeline Engineer

    4 days ago

    Melbourne, Victoria, Australia beBeeData Full time $140,000 - $170,000

    Job Description">As a Data Engineer, you will play a key role in automating and optimizing data workflows to ensure efficiency and scalability. You will be responsible for designing and implementing CI/CD pipelines, developing infrastructure-as-code templates, and automating ETL/ELT workflow management.Key Responsibilities:Design and implement CI/CD...

  • Data Pipeline Specialist

    7 days ago

    Melbourne, Victoria, Australia beBeeDataPipeline Full time

    Job Title:Data Pipeline Specialist">About Us:We are a forward-thinking organization that simplifies the process of making informed financial decisions. Our mission is to make a positive impact in the lives of our customers by providing seamless data delivery across the organization.iSelect and Compare the Market: At iSelect and Compare the Market, we're...

  • Unlock Data Potential: Lead Scalable Data Solutions

    15 hours ago

    Melbourne, Victoria, Australia beBeeData Full time $108,571 - $119,893

    Senior Data ArchitectAs a Senior Data Architect, you will be responsible for designing and delivering high-quality data solutions and building scalable, secure infrastructure required for optimal ETL/ELT processes from a wide variety of data sources using SQL, data lake, Databricks technologies.Key Responsibilities:Designing, building, and maintaining...

  • Data Pipeline Architect

    3 days ago

    Melbourne, Victoria, Australia beBeeData Full time $120,000 - $160,000

    About our organization:We support millions of Australians in comparing and purchasing personal finance and household products.Our company makes Australians' lives easier by saving them time, money, and effort. With over 20 years of experience, we are a one-stop destination for comparison and purchasing across insurance, utilities, and personal finance...