Highly Skilled Data Engineer Wanted For Building Scalable Data Solutions

1 week ago

Sydney, New South Wales, Australia Bebeedata Full time

Data Specialist
This role focuses on transforming existing proof-of-concept into scalable data solutions. Ideal candidate will have extensive knowledge of Python, especially working with PySpark.
The successful Data Engineer will be responsible for building and refining complex data pipelines to support ongoing monitoring and management. They must collaborate closely with developers and stakeholders to ensure timely delivery within a set deadline.
Key responsibilities include taking ownership of an existing PoC, building scalable data pipelines, collaborating with team members, and applying best practices in CI/CD and production deployment.
Requirements
Mandatory Skills:
Python:
Advanced proficiency, particularly working with PySpark.
Databricks:
Solid experience with Unity Catalog and Delta Live Tables.
RESTful APIs:
Experience managing client credential requests using Python.
CI/CD:
Deep understanding of best practices in setting up and maintaining pipelines.
End-to-End Development:
Confidence in pushing solutions into production environments.
Nice-to-Have Skills:
SQL:
Useful for data manipulation and validation.
Microsoft Graph API:
Familiarity is beneficial but not required.

  • Building Scalable Data Solutions

    7 days ago

    Sydney, New South Wales, Australia beBeeDataEngineering Full time $180,000 - $210,000

    Job OverviewWe are seeking a highly skilled Data Engineering Lead to lead our modern data stack and oversee a team of engineers in building scalable, high-performing data solutions. The ideal candidate thrives in architecting data platforms, mentoring teams, and has hands-on experience with Databricks and dbt.Key ResponsibilitiesLead and mentor a team of...

  • Building Scalable Data Solutions

    6 days ago

    Sydney, New South Wales, Australia beBeeData Full time $100,000 - $130,000

    Advanced Analytics Solutions EngineerThe Advanced Analytics Solutions Engineer will design, develop and implement scalable data solutions using Google Cloud products.This role includes building data pipelines, logging, and monitoring as part of a multidisciplinary team in close partnership with Data Scientists.Develop cloud-based data pipelines to solve a...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Building Scalable Data Pipelines

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $140,000 - $182,000

    Job Title: Senior Data EngineerAs a senior data engineer at our organization, you will play a critical role in shaping the future of financial capability for young people. You will be responsible for designing and implementing scalable data pipelines that drive high-impact, sustainable solutions in a fast-paced scale-up environment.Key...

  • Highly Skilled Data Engineer

    1 week ago

    Sydney, New South Wales, Australia beBeeDataEngineering Full time $120,000 - $180,000

    Senior Data Solutions Developer\We are seeking a highly skilled and motivated Senior Data Solutions Developer to join our organization. As a key member of our team, you will be responsible for designing, developing, and implementing high-quality data solutions that meet the evolving needs of our business.\Job Description\The ideal candidate will have...

  • Highly Skilled Data Architect

    1 week ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $150,000 - $180,000

    Job Title: Data EngineerA highly skilled and accomplished Data Engineer is sought after to drive the strategic design and execution of robust, scalable data architecture.This role will spearhead integrations of complex data ecosystems, ensuring high reliability and performance for real-time processing across leading cloud platforms.The ideal candidate will...

  • Highly Skilled Data Engineer Wanted

    7 days ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $120,000 - $150,000

    Key Engineering RoleWe are seeking a seasoned data engineer to support and advance the data needs of our research team. You will work closely with researchers and our Global Research and Data Platform teams to productionize workflows, optimize large-scale data processing, and manage infrastructure costs efficiently.About the RoleThis is an exciting...