Current jobs related to Data Pipeline Engineer - Brisbane, Queensland - beBeeSparkDeveloper
-
Pipeline Engineer
2 weeks ago
Brisbane, Queensland, Australia Ngare Employment Solutions Pty Ltd Full timeFull time – Permanent role based in Brisbane CBDFlexible & supportive team environment with attractive salary on offerGrowing ASX listed Multidiscipline Engineering businessMake a real impactAt Verbrec, you will get to directly influence the transition to renewable energy systems and decarbonisation.Help us as we become a recognised partner for a...
-
Pipeline Engineer
3 weeks ago
Brisbane, Queensland, Australia NGARE EMPLOYMENT SOLUTIONS PTY LTD Full timeFull time – Permanent role based in Brisbane CBDFlexible & supportive team environment with attractive salary on offerGrowing ASX listed Multidiscipline Engineering businessMake a real impactAt Verbrec, you will get to directly influence the transition to renewable energy systems and decarbonisation. Help us as we become a recognised partner for a...
-
Advanced Data Pipeline Specialist
1 week ago
Brisbane, Queensland, Australia beBeeDataEngineer Full time $140,000 - $180,000Job Description:We are seeking an experienced professional to fill the position of a Data Engineer. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines for structured and unstructured data.The role requires strong technical skills, including experience with data engineering tools and technologies, as well...
-
Chief Data Pipeline Architect
1 week ago
Brisbane, Queensland, Australia beBeeDataEngineer Full time $70,000 - $120,000Senior Data Engineer PositionWe are seeking a highly skilled data engineer to design and implement scalable data pipelines, directly supporting analytics and business decision-making.The ideal candidate will have hands-on experience with SQL, ETL frameworks, and performance tuning. They will also possess strong skills in data modelling, transformation, and...
-
Senior Pipeline Engineer
2 weeks ago
Brisbane, Queensland, Australia beBeePipeline Full time $120,000 - $140,000Job Title:Senior Pipeline Engineering SpecialistAbout the Role:We are seeking an experienced Senior Pipeline Engineering Specialist to join our team. The successful candidate will be responsible for designing and developing pipeline systems, including mechanical, civil, and process engineering.Key Responsibilities:Design and develop pipeline systems,...
-
Senior Data Pipeline Specialist
2 weeks ago
Brisbane, Queensland, Australia beBeeDataEngineer Full time $120,000 - $180,000About the Role:We are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have expertise in automating, monitoring, and optimizing data pipelines and infrastructure to ensure efficient, scalable, and reliable data workflows.The successful candidate will focus on implementing DataOps best practices, CI/CD automation, cloud...
-
Data Pipeline Developer
2 weeks ago
Brisbane, Queensland, Australia beBeeDataPipeline Full time $160,000 - $170,000Job SummaryAbout the RoleAs a Data Pipeline Developer, you will be responsible for designing and implementing efficient data pipelines to support analytics and reporting. You will write and optimize SQL queries for high-performing data processing and retrieval.Key Responsibilities:Design and implement data pipelines using ETL frameworks and tools.Write and...
-
Lead Pipeline Engineer
2 weeks ago
Brisbane, Queensland, Australia Verbrec Ltd Full timeOverviewLead Pipeline Engineer role at Verbrec Ltd. Join a collaborative team involved in oil and gas pipeline projects with opportunities to influence the transition to renewable energy systems and decarbonisation.ResponsibilitiesProviding technical leadership across FEED and detailed design stages for oil and gas pipelines, including...
-
Lead Pipeline Engineer
2 weeks ago
Brisbane, Queensland, Australia Verbrec Ltd Full timeOverviewLead Pipeline Engineer role at Verbrec Ltd. Join a collaborative team involved in oil and gas pipeline projects with opportunities to influence the transition to renewable energy systems and decarbonisation.ResponsibilitiesProviding technical leadership across FEED and detailed design stages for oil and gas pipelines, including...
-
Lead Pipeline Engineer
2 weeks ago
Brisbane, Queensland, Australia Verbrec Full timeFull time permanent position based in Brisbane CBD Lead and develop one of Queensland's most successful Pipeline teams Create a legacy of high impact, with exclusive projects in oil and gas Make a real impact At Verbrec, you will get to directly influence the transition to renewable energy systems and decarbonisation.Help us as we become a recognised partner...
Data Pipeline Engineer
3 weeks ago
About the Role
- This role is based at our Newstead, QLD office and involves a broad understanding of object-oriented programming, software development lifecycle, algorithms and data structures, test-driven development, peer programming, and reading and writing technical schematics in industry standard notation.
You will learn on the job and become a highly sought-after Apache Spark subject matter expert by diving deep into knowledge articles, reading open-source Spark code, and developing highly optimized libraries for data developers to consume.
Key Responsibilities:- Participate and collaborate in a high-performing SCRUM team to deliver on key BAU activities and milestones from the Project Roadmap, and the Data Science and Analytics strategy.
- Demonstrate excellent judgement skills at interpreting business requirements, estimating workloads, prioritizing tasks, and managing time in the delivery of quality solutions to meet deadlines.
- Proactively contribute to managing your projects, keeping stakeholders up-to-date, developing delivery plans, obtaining design authority approvals, and keeping records up-to-date.
- Communicate well and respectfully through all written and verbal interactions.
- Provide technical guidance, and be a role model to Developers, Scientists, and other Engineers.
- Develop highly performant, efficiently administered, cost-considerate, well-tested, and fully secure Python libraries and data pipeline solutions built on Apache Spark.
The ideal candidate will draw on experience and deep knowledge of programming across multiple interpreted and compiled programming languages to develop strongly-typed, self-documenting Python code and libraries.
Your knowledge and thorough understanding of DevSecOps, MLOps, and DataOps release pipelines will help you stand out from the rest as you're able to develop, unit test, review, and deploy.
- Have 4+ years of experience in Software Engineering with proven experience developing enterprise solutions involving multiple development teams.
- Hold a degree in Information Technology, Computer Science or equivalent IT work experience.
- Experienced member of SCRUM and agile teams.
- Experienced working with project management and developing delivery plans.
- Proven skills programming with Python and other C-style languages.
- Proven skills with object-oriented programming, design patterns, unit testing, and debugging.
- Proven skills to research, learn quickly, and apply abstract concepts into real-world solutions.
- Demonstrated knowledge DevOps, CI/CD, and release management.
