Leading Data Engineer

2 weeks ago

Brisbane, Queensland, Australia beBeeData Full time $161,510 - $216,419

Unlock a career opportunity that drives innovation in data-centric systems.

Senior Software Engineer

Caterpillar Inc. is seeking a Senior Software Engineer to join a specialist team focused on building a scalable data platform that ingests high-frequency telemetry data from mobile field machines and supports data science and machine learning workloads.

About the Role

The successful candidate will design and implement robust, scalable components for ingesting, processing, and persisting high-frequency telemetry data, collaborate with data scientists to host, orchestrate, and optimize workloads in Python, Scala, and Java, and drive modernization efforts including containerization and deployment on Kubernetes.

Key Responsibilities
  • Component Development: Design and implement components using technologies like Apache Spark, Delta Lake, Redis/Valuekey, MQTT, and PostgreSQL.
  • Technology Evaluation: Evaluate and integrate emerging technologies to optimize performance and scalability.
  • Architectural Contributions: Contribute to architectural decisions involving event sourcing, CQRS, and hybrid cloud deployments.
Requirements
  • Extensive experience in backend development with languages such as Java, Scala, and Python.
  • Proven track record working in teams to develop large, complex applications.
  • Deep understanding of streaming and batch data processing, ideally with Apache Spark or similar.
  • Experience with containerization (Docker) and orchestration (Kubernetes).
What We Offer
  • Competitive remuneration based on degree and professional experience.
  • Attractive bonus and share options.
  • Career development with global prospects.
  • A strong commitment to safety and wellbeing.

Work on a technically challenging and meaningful application in the mining domain, be part of a forward-thinking team driving innovation in data-centric systems, influence architectural direction and technology choices, and collaborate with experts in autonomy, data science, and distributed systems.

  • Data Engineering Lead

    2 weeks ago

    Brisbane, Queensland, Australia P&C Partners Pty Ltd Full time

    About the RoleThis is a newly created strategic leadership position within a growing SaaS and digital services organisation. The Data Engineering Lead will play a pivotal role in modernising the company's data infrastructure, leading a small but high-performing team, and delivering scalable, secure, and insightful data solutions across both internal...

  • Data Engineering Lead

    2 weeks ago

    Brisbane, Queensland, Australia P&C Partners Pty Ltd Full time

    About the RoleThis is a newly created strategic leadership position within a growing SaaS and digital services organisation. The Data Engineering Lead will play a pivotal role in modernising the company's data infrastructure, leading a small but high-performing team, and delivering scalable, secure, and insightful data solutions across both internal...

  • Data Engineering Lead

    1 week ago

    Brisbane, Queensland, Australia beBeeDataLead Full time $180,000 - $210,000

    Job OpportunityIn this key position, you will lead a Data Migration project with our exceptional data and product team.You will have the opportunity to work on and introduce new and innovative technologies with a focus on Data Engineering, Data Architecture, and Governance.Data Driven Technologies: Design, develop, implement, and own technologies with a...

  • Lead Data Engineer

    3 weeks ago

    Brisbane, Queensland, Australia CYOS Solutions Full time

    Join to apply for the Lead Data Engineer role at CYOS Solutions1 day ago Be among the first 25 applicantsJoin to apply for the Lead Data Engineer role at CYOS SolutionsGet AI-powered advice on this job and more exclusive features.Direct message the job poster from CYOS SolutionsTalent Acquisition Specialist @ CYOS Solutions | IT RecruitmentApplication...

  • Lead Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia CYOS Solutions Full time

    Join to apply for the Lead Data Engineer role at CYOS Solutions1 day ago Be among the first 25 applicantsJoin to apply for the Lead Data Engineer role at CYOS SolutionsGet AI-powered advice on this job and more exclusive features.Direct message the job poster from CYOS SolutionsTalent Acquisition Specialist @ CYOS Solutions | IT RecruitmentApplication...

  • Strategic Data Engineering Lead

    2 weeks ago

    Brisbane, Queensland, Australia beBeeDataEngineering Full time $140,000 - $180,000

    Job SummaryWe are seeking a highly skilled Strategic Data Engineering Lead to lead the design, development, and optimization of our enterprise data platform. This is an exciting opportunity to shape the strategy for scalability, reliability, and performance across the data ecosystem.About the RoleThe successful candidate will have a proven track record in...

  • Data Engineering Expertise Lead

    2 weeks ago

    Brisbane, Queensland, Australia beBeeData Full time $126,444 - $179,625

    Job OverviewThe role of Senior Data Engineer involves delivering and maintaining data assets, enhancing data quality, and driving business outcomes. Key responsibilities include leading solution development, data flow design, and data profiling to deliver value. This includes providing technical leadership, influencing team performance, mentoring junior...

  • Data Engineering Lead

    2 weeks ago

    Brisbane, Queensland, Australia beBeeSeniorData Full time $180,000 - $240,000

    As a leader in the field of data engineering, we are seeking a highly skilled Senior Data and AI Professional to join our team.This role involves driving innovation from data ingestion and integration to AI-powered experiences, with a focus on designing and automating data pipelines, building and maintaining large-scale data warehouse architectures, and...

  • Data Architect

    7 days ago

    Brisbane, Queensland, Australia Data#3 Full time $120,000 - $180,000 per year

    Data/Information ArchitectDuration:Initial contract to 26 June months) + Potential extensionsLocation:Brisbane, QLD (WFH 2 days)We are seeking an experiencedData/Information Architectto join a large-scale digital transformation program. This contract role will focus on designing and managing enterprise-level data architecture to support the replacement of a...

  • Lead Data Engineer

    3 weeks ago

    Brisbane, Queensland, Australia Endava Full time

    Job Description As a Lead Data Engineer specialising in Databricks, you will design, build, and optimise data pipeline solutions on Databricks and related cloud platforms. Working closely with data scientists, analysts, and engineers, you will ensure our data infrastructure supports advanced analytics and business insights across industries (including...