Current jobs related to Data Pipeline Specialist - Sydney, New South Wales - beBeeDataEngineer
-
Data Pipeline Specialist
2 weeks ago
Sydney, New South Wales, Australia beBeeDataPipeline Full time $200,000 - $250,000Key Role: Data Pipeline SpecialistWe are seeking a skilled data pipeline specialist to join our team.Design, optimize, and scale data pipelines using software engineering best practices (testing, version control, automation).Structure dbt projects and layers (staging, intermediate, marts) to ensure clarity, reusability, and business alignment.Embed...
-
Senior Data Pipeline Specialist
1 week ago
Sydney, New South Wales, Australia beBeeData Full time $120,000 - $180,000Lead Data EngineerThis is a 6-month project in Sydney with the possibility of extension.About the Role:The ideal candidate will have extensive experience in ADF and SSIS development, GIT, and JSON. They will be responsible for developing data pipelines, performing code reviews, issue resolution, and mentoring junior developers.Key Responsibilities:Develop...
-
Data Pipeline Specialist
1 week ago
Sydney, New South Wales, Australia beBeeAutomation Full time $140,000 - $170,000Systems ArchitectWe are a global financial trading firm with a drive to deeply understand the world around us and make optimal business decisions every day.Your role involves performing support, deployment, and automation tasks related to data pipelines throughout the Asia Pacific region as part of our trading technology team.This role is integral to our...
-
Data Pipeline Architect
2 weeks ago
Sydney, New South Wales, Australia Bebeeintegration Full timeJob Title: Data Integration SpecialistWe are on a mission to be a force for good, through our people, products and purpose.We seek individuals who are passionate, able to work at pace, comfortable with ambiguity, and committed to making a positive difference.Key Responsibilities:Design, build and optimize pipelines using AWS Glue, dbt, Airflow or similar...
-
Data Pipeline Specialist
2 weeks ago
Sydney, New South Wales, Australia beBeeDataEngineer Full time $130,500 - $164,600Job SummaryWe are seeking an experienced Data Engineer to develop and maintain robust data pipelines and infrastructure for analytics, machine learning, and reporting platforms.The ideal candidate will have a strong proficiency in cloud data warehouses, proficient SQL and Python coding skills, and experience developing Airflow or other open-source data...
-
Data Pipelines Specialist
1 week ago
Sydney, New South Wales, Australia beBeeDataEngineer Full time $136,000 - $164,000About our ideal candidateWe are seeking a skilled professional to join our team in Sydney, Australia. This individual will be responsible for developing core data pipelines and tools that turn real-world, multi-sensor data into actionable intelligence — powering systems that operate in the world's most complex and high-stakes environments.This is a unique...
-
Data Pipeline Specialist
1 week ago
Sydney, New South Wales, Australia beBeeDevops Full time $80,000 - $130,000Job OverviewWe are seeking a skilled DevOps consultant to join our team on a long-term contract in Sydney. The ideal candidate will have unrestricted work rights in Australia.Key Responsibilities:Design and develop scalable data pipelines using Azure Databricks, PySpark, and SQL.Implement structured streaming, Delta Lake, and Unity Catalog.Optimize Spark...
-
Senior Data Pipeline Specialist
2 weeks ago
Sydney, New South Wales, Australia beBeeData Full time $120,000 - $175,000Are you a seasoned data professional looking for your next challenge? We have an exciting opportunity for a Data Engineer to join our team in a large-scale program. As a key member of our technical team, you will be responsible for designing, building, and maintaining data pipelines in an Azure environment.This role requires strong expertise in Databricks...
-
Senior Data Pipeline Specialist
1 week ago
Sydney, New South Wales, Australia beBeeDataEngineer Full time $150,000 - $180,000Data EngineerAbout the RoleWe're seeking a skilled data engineer to manage our data pipelines and create integrations with various platforms, vendors, and third-party data providers. This is a hands-on role where you'll understand business needs to create efficient data flows within technical constraints.The ideal candidate will have experience in designing,...
-
Expert Data Pipeline Architect
1 week ago
Sydney, New South Wales, Australia beBeeDataEngineer Full time $120,000 - $160,000As a highly skilled Data Engineer, you will play a critical role in designing, building, and maintaining scalable data pipelines using Databricks, PySpark, and Spark SQL.The ideal candidate will have strong expertise in Azure Synapse, with experience in developing data integration and transformation solutions on spark and sql pools.We are seeking a talented...
Data Pipeline Specialist
3 weeks ago
We are looking for a highly skilled and motivated Data Engineer Associate to join our team. As a key member of our data engineering group, you will play a crucial role in designing, developing, and maintaining our modern data pipelines. You will be working closely with experienced engineers to develop solutions that improve the quality and scalability of our data platforms.
About the Role:
This is an excellent opportunity to gain hands-on experience with cutting-edge data engineering tools such as DBT, Airflow, Snowflake, and Databricks. You will work on real-world projects, collaborating with senior engineers to design and implement data models, improve data quality, and document solutions.
Responsibilities:
- Assist in the development, maintenance, and monitoring of data pipelines using modern data stack tools under senior guidance.
- Contribute to data analysis and solution prototyping activities as part of a team; work with other engineers in designing new data models and enhancements, documenting learning and approaches.
- Gain hands-on experience using data pipeline and ETL tools (DBT, Airflow, Python) through active participation in team projects; learn and support processes related to cloud data warehouse deployments (development, testing, production); work with Snowflake and Databricks environments, assisting with Unity Catalog, Delta Live Tables & Spark under supervision.
- Collaborate closely with data engineers, analysts, and business stakeholders to gather requirements and clarify technical specifications; communicate technical challenges or questions, escalating appropriately for senior support.
- Maintain clear and concise documentation for data engineering tasks, including updated records of pipelines, workflows, and technical solutions; assist in preparing user and process documentation as part of project deliverables.
- Support the implementation of data governance policies by monitoring data quality and flagging issues; run routine data validation checks and report anomalies to the senior engineering team.
- Stay updated on industry trends and best practices in data engineering and cloud technologies; actively seek mentoring and learning opportunities within the team and through provided resources.
- Observe and learn from seniors on optimising data pipelines and improving process performance; assist in routine performance monitoring tasks and suggest incremental improvements as knowledge grows.
Qualifications:
To be successful in this role, you will need:
- Bachelor's degree in Computer Science, Data Science, IT, or related field (or equivalent experience).
- Basic SQL skills and understanding of relational databases.
- Familiarity with Python and an interest in data engineering tools such as DBT or Airflow.
- Exposure to cloud data platforms, ideally Snowflake or Databricks.
- Understanding of data modelling concepts and data governance principles.
- Strong problem-solving skills and attention to detail.
