Strategic Data Engineering Lead

4 days ago

Brisbane, Queensland, Australia Bebeedata Full time

Senior Software Engineer
Our team is seeking a skilled Senior Software Engineer to develop scalable data platforms.
Job Description
The ideal candidate will design and implement robust, scalable components for ingesting, processing, and persisting high-frequency telemetry data.
Key Responsibilities:
Design and implement data processing systems using technologies like Apache Spark, Delta Lake, Redis/Valkey, MQTT, and PostgreSQL.
Collaborate with data scientists to host, orchestrate, and optimize workloads in Python, Scala, and Java.
Drive modernization efforts including containerization and deployment on Kubernetes.
Integrate with S3-compatible object stores (e.g., Ceph).
Evaluate and integrate emerging technologies to optimize performance and scalability.
The ideal candidate should have:
Extensive experience in backend development with languages such as Java, Scala, and Python.
Proven track record working in teams to develop large, complex applications.
Deep understanding of streaming and batch data processing, ideally with Apache Spark or similar.
Experience with containerization (Docker) and orchestration (Kubernetes).
Familiarity with data lake/lakehouse architectures, especially Delta Lake.
Strong knowledge of message brokers (MQTT, Kafka) and caching systems (Redis/Valkey).
Comfortable working across multiple languages (Java, Python, Scala).
Experience in designing systems for scalability, multi-tenancy, and hybrid deployments.
This role offers the opportunity to work on challenging projects, collaborate with experienced professionals, and grow your skills in data engineering.
We encourage applicants with diverse backgrounds and experiences to apply.

  • Strategic Data Engineering Lead

    2 days ago

    Brisbane, Queensland, Australia beBeeDataEngineering Full time $140,000 - $180,000

    Job SummaryWe are seeking a highly skilled Strategic Data Engineering Lead to lead the design, development, and optimization of our enterprise data platform. This is an exciting opportunity to shape the strategy for scalability, reliability, and performance across the data ecosystem.About the RoleThe successful candidate will have a proven track record in...

  • Data Engineering Lead

    2 days ago

    Brisbane, Queensland, Australia P&C Partners Pty Ltd Full time

    About the RoleThis is a newly created strategic leadership position within a growing SaaS and digital services organisation. The Data Engineering Lead will play a pivotal role in modernising the company's data infrastructure, leading a small but high-performing team, and delivering scalable, secure, and insightful data solutions across both internal...

  • Data Engineering Lead

    2 days ago

    Brisbane, Queensland, Australia P&C Partners Pty Ltd Full time

    About the RoleThis is a newly created strategic leadership position within a growing SaaS and digital services organisation. The Data Engineering Lead will play a pivotal role in modernising the company's data infrastructure, leading a small but high-performing team, and delivering scalable, secure, and insightful data solutions across both internal...

  • Strategic Data Engineering Lead

    2 weeks ago

    Brisbane, Queensland, Australia beBeeData Full time $180,000 - $250,000

    Senior Software EngineerOur team is seeking a skilled Senior Software Engineer to develop scalable data platforms. Job DescriptionThe ideal candidate will design and implement robust, scalable components for ingesting, processing, and persisting high-frequency telemetry data.Key Responsibilities:Design and implement data processing systems using technologies...

  • Data Engineer Lead

    1 week ago

    Brisbane, Queensland, Australia beBeeDataEngineeringManager Full time $180,000 - $250,000

    Job Title: Data Engineering Manager","The role of Data Engineering Manager involves leading and growing a global team of data services, overseeing the deployment, maintenance, and scaling of cloud-native platforms. This position is crucial in ensuring the scalability, reliability, and performance of data infrastructure.","About The Role:","Lead and mentor a...

  • Lead Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia CYOS Solutions Full time

    Join to apply for the Lead Data Engineer role at CYOS Solutions1 day ago Be among the first 25 applicantsJoin to apply for the Lead Data Engineer role at CYOS SolutionsGet AI-powered advice on this job and more exclusive features.Direct message the job poster from CYOS SolutionsTalent Acquisition Specialist @ CYOS Solutions | IT RecruitmentApplication...

  • Lead Data Engineer

    3 days ago

    Brisbane, Queensland, Australia CYOS Solutions Full time

    Join to apply for the Lead Data Engineer role at CYOS Solutions1 day ago Be among the first 25 applicantsJoin to apply for the Lead Data Engineer role at CYOS SolutionsGet AI-powered advice on this job and more exclusive features.Direct message the job poster from CYOS SolutionsTalent Acquisition Specialist @ CYOS Solutions | IT RecruitmentApplication...

  • Lead Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia Integrant, Inc. Full time

    We're on the lookout for exceptional individuals to join our team asLead Data Engineers.As a part of our team, you'll be driving change and making a significant impact in the gaming industry.Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies.Engage in collaborative...

  • Data Engineer

    5 days ago

    Brisbane, Queensland, Australia Pivotal Group Full time

    This hands-on role is ideal for a seasoned Data and Integration Engineer who thrives in smaller, agile businesses where they can drive meaningful, long-term impact.You will lead the evolution of the data and integration landscape, modernising data flows, eliminating manual processes, and enabling real-time, reliable reporting across the business.You will...

  • Data Engineering Lead

    7 days ago

    Brisbane, Queensland, Australia beBeeData Full time $120,000 - $150,000

    Job DescriptionAs a Senior Data Engineer, you will be responsible for designing and implementing end-to-end data pipelines and platforms using Azure and Microsoft Fabric. You will work closely with cross-functional teams to ensure seamless project execution and successful outcomes.">Key ResponsibilitiesDesign and implement scalable data platforms using Azure...