Building Efficient Data Pipelines
4 days ago
Craft and implement high-performance data pipelines that support our entire data ecosystem as a skilled Software Development Data Engineer.
Pipeline Architecture Overview- Build efficient data acquisition pipelines integrating with various systems across the industry, leveraging software development principles and system architecture expertise.
- Contribute to modular ingestion platform development for reusability, reliability, and scalability at scale.
- Implement core pipeline components such as schema validation, transformation orchestration, error handling, and audit logging.
- Support batch and streaming ingestion flows ensuring varying latency and volume requirements across business units, guaranteeing traceability and security through integration with control plane and governance systems.
- Take ownership and accountability to build systems that last, utilizing strong understanding of data pipelines, software development principles, and system architecture.
- Ensure key skills are applied, including strong understanding of data pipelines, software development principles, and system architecture.
Key Qualifications: Strong understanding of data pipelines, software development principles, and system architecture.
We seek a highly skilled Senior Pipeline Architect to join our team and contribute to building efficient data pipelines.
-
Building Scalable Data Pipelines
2 weeks ago
Melbourne, Victoria, Australia beBeeDataEngineering Full time $190,000 - $220,000Job Title: Data EngineerJob Description:We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining scalable data pipelines and ETL processes.This role requires a strong understanding of cloud data architecture and big data platforms. You will work closely with data...
-
Data Engineer
1 week ago
Melbourne, Victoria, Australia beBeeDataEngineer Full time $90,000 - $120,000About This RoleWe're seeking a skilled professional to drive our data pipeline efficiency and scalability.Job SummaryThis role focuses on optimizing data workflows, implementing cloud infrastructure, and ensuring seamless data delivery across the organization.Key ResponsibilitiesData Pipeline Automation: Design, implement, and maintain CI/CD pipelines for...
-
Building Scalable Data Pipelines
1 week ago
Melbourne, Victoria, Australia beBeeDataEngineer Full time $80,000 - $120,000About the RoleThe Data Acquisition Team serves as the entry point to a comprehensive data platform responsible for ingesting, validating, and orchestrating raw data from multiple internal systems and third-party providers. As an Engineer, you'll play a key role in designing and building robust, scalable, and extensible pipelines that feed the entire data...
-
Building Scalable Data Pipelines
5 days ago
Melbourne, Victoria, Australia Bebeedataengineer Full timeAbout the RoleThe Data Acquisition Team serves as the entry point to a comprehensive data platform responsible for ingesting, validating, and orchestrating raw data from multiple internal systems and third-party providers.As an Engineer, you'll play a key role in designing and building robust, scalable, and extensible pipelines that feed the entire data...
-
Data Pipeline Architect
2 weeks ago
Melbourne, Victoria, Australia beBeeDataConsultant Full time $150,000 - $180,000Senior Data ConsultantAs a seasoned Senior Data Consultant, you will be responsible for developing and delivering high-quality data solutions that drive business value.You will work closely with cross-functional teams to design, build, and maintain scalable and reliable data pipelines that extract, transform, and load (ETL/ELT) data from various sources into...
-
Senior Data Pipeline Specialist
4 days ago
Melbourne, Victoria, Australia beBeeDataEngineering Full time $120,000 - $130,000Data Engineer OpportunityWe're seeking a talented data engineer to join our team of experts. This is an opportunity to work on high-impact projects, designing and building scalable pipelines that drive real-world change.As a key member of our technology team, you'll be responsible for:Designing metadata-driven pipelines that scale and are efficient.Bringing...
-
Cloud Data Pipeline Developer
1 week ago
Melbourne, Victoria, Australia beBeeData Full time $122,736 - $132,847Data Engineering OpportunityWe are seeking an experienced Data Engineer to join our team. This is a permanent opportunity with a strong focus on cloud-based pipeline development.Design, build, and optimize scalable AWS Glue (PySpark) pipelines for structured and semi-structured data sources using industry-standard practices and tools.Develop clear and...
-
Data Pipeline Engineer
2 weeks ago
Melbourne, Victoria, Australia beBeeData Full time $140,000 - $170,000Job Description">As a Data Engineer, you will play a key role in automating and optimizing data workflows to ensure efficiency and scalability. You will be responsible for designing and implementing CI/CD pipelines, developing infrastructure-as-code templates, and automating ETL/ELT workflow management.Key Responsibilities:Design and implement CI/CD...
-
Senior Data Pipeline Architect
4 days ago
Melbourne, Victoria, Australia beBeeData Full time $180,000 - $250,000As a seasoned Data Engineer, you will play a pivotal role in shaping our data infrastructure and engineering strategies. You will lead the architecture and implementation of scalable, high-performance data pipelines, optimizing ETL/ELT processes with tools like Spark, Hadoop and Kafka.Your expertise will be crucial in designing, building, maintaining, and...
-
Data Pipeline Architect
2 weeks ago
Melbourne, Victoria, Australia beBeeData Full time $120,000 - $160,000About our organization:We support millions of Australians in comparing and purchasing personal finance and household products.Our company makes Australians' lives easier by saving them time, money, and effort. With over 20 years of experience, we are a one-stop destination for comparison and purchasing across insurance, utilities, and personal finance...
