Expert in Scalable Data Systems

3 days ago

Brisbane, Queensland, Australia beBeeData Full time $180,000 - $240,000

Job Overview

We are seeking a talented Data Platform Expert to join our team focused on building scalable data systems for high-frequency telemetry data.

Key Responsibilities

  • Design and develop robust, scalable components for ingesting, processing, and persisting high-frequency telemetry data using Apache Spark, Delta Lake, and PostgreSQL.
  • Collaborate with data scientists to host, orchestrate and optimize workloads in Python, Scala, and Java.
  • Build components using technologies like Redis, MQTT, and Ceph S3-compatible object stores.
  • Drive modernization efforts including containerization and deployment on Kubernetes.
  • Evaluate and integrate emerging technologies to optimize performance and scalability.
  • Contribute to architectural decisions involving event sourcing, CQRS, and hybrid cloud deployments.

Requirements

  • Extensive experience in backend development with languages such as Java, Scala, and Python.
  • Proven track record working in teams to develop large, complex applications.
  • Deep understanding of streaming and batch data processing, ideally with Apache Spark or similar.
  • Experience with containerization (Docker) and orchestration (Kubernetes).
  • Familiarity with data lake/lakehouse architectures, especially Delta Lake.
  • Strong knowledge of message brokers (MQTT, Kafka) and caching systems (Redis).
  • Comfortable working across multiple languages (Java, Python, Scala).
  • Experience in designing systems for scalability, multi-tenancy, and hybrid deployments.

Why Work with Us?

  • Be part of a forward-thinking team driving innovation in data-centric systems.
  • Influence architectural direction and technology choices.
  • Collaborate with experts in autonomy, data science, and distributed systems.

Working Conditions

The ideal candidate will have excellent communication skills, be able to work collaboratively in a team environment, and demonstrate a strong passion for building scalable data systems.

Skills Assessment

  • Proficiency in Java, Scala, or Python programming languages.
  • Experience with containerization and orchestration tools.
  • Understanding of data storage and processing technologies.
  • Knowledge of data visualization and business intelligence tools.
  • Ability to design and implement scalable data systems.

  • Scalable Data Leader

    4 days ago

    Brisbane, Queensland, Australia beBeeLeader Full time $150,000 - $250,000

    Scalable Data Leader We are seeking a highly skilled and experienced leader to manage our engineering team, driving innovation and scalability in data solutions for Kubernetes and cloud environments. Job Description The Scalable Data Leader will be responsible for leading a high-performing team of engineers, focusing on designing, developing, and delivering...

  • IoT Data Engineer

    4 days ago

    Brisbane, Queensland, Australia beBeeCybersecurity Full time $120,000 - $180,000

    Are you passionate about the Internet of Things and software engineering? This exciting opportunity involves working as an IoT Data Engineer. We're looking for someone with a strong background in data processing, system architecture, and cybersecurity principles to join our team.About the RoleThis remote position is based in the EMEA region and will involve...

  • Data Platform Expert

    3 days ago

    Brisbane, Queensland, Australia Bebeesoftwareengineer Full time

    Job TitleData Platform Software Engineer - Telemetry SpecialistAbout the RoleWe are seeking a talented Data Platform Software Engineer to join our specialist team focused on building scalable data systems for high-frequency telemetry data.Main ResponsibilitiesDesign and develop robust, scalable components for ingesting, processing, and persisting...

  • Data Platform Expert

    5 days ago

    Brisbane, Queensland, Australia beBeeSoftwareEngineer Full time $120,000 - $180,000

    Job TitleData Platform Software Engineer - Telemetry SpecialistAbout the RoleWe are seeking a talented Data Platform Software Engineer to join our specialist team focused on building scalable data systems for high-frequency telemetry data.Main ResponsibilitiesDesign and develop robust, scalable components for ingesting, processing, and persisting...

  • Designing Scalable Backend Systems

    4 days ago

    Brisbane, Queensland, Australia beBeeBackend Full time $125,000 - $140,000

    Job Summary:This role is pivotal in shaping our Admin Experience Group, focusing on crafting and evolving scalable backend systems to support administrative experiences.Lead the development of scalable backend systems for large-scale enterprises and small businesses.Collaborate closely with cross-functional teams to understand admin needs and turn them into...

  • Data Centric Systems Architect

    1 day ago

    Brisbane, Queensland, Australia Bebeedataengineer Full time

    Shape the Future with Data EngineeringAbout the PositionWe're seeking a highly skilled Senior Engineer to join our specialist team in building a scalable data platform. This innovative platform will ingest high-frequency telemetry data from mobile field machines, supporting data science and machine learning workloads.As part of this project, you'll play a...

  • Expert Data Architect Required

    2 weeks ago

    Brisbane, Queensland, Australia beBeeDataArchitect Full time $147,000 - $183,000

    Job DescriptionWe are seeking an expert Data Architect to lead the design, development, and optimization of our enterprise data platform. As a key member of the data team, you will shape the data strategy, ensuring scalability, reliability, and performance across the data ecosystem.You will architect and lead the development of scalable, secure, and...

  • Data Centric Systems Architect

    3 days ago

    Brisbane, Queensland, Australia beBeeDataEngineer Full time $130,000 - $170,000

    Shape the Future with Data EngineeringAbout the PositionWe're seeking a highly skilled Senior Engineer to join our specialist team in building a scalable data platform. This innovative platform will ingest high-frequency telemetry data from mobile field machines, supporting data science and machine learning workloads.As part of this project, you'll play a...

  • Technologist for Scalable Data Infrastructure

    2 weeks ago

    Brisbane, Queensland, Australia beBeeDataEngineer Full time $120,000 - $150,000

    About the RoleWe are seeking an experienced Data Engineer to lead our data infrastructure development. This role is crucial in enabling data-driven decision-making across the organization.The successful candidate will design scalable, cloud-native data solutions using advanced SQL skills and experience with Google BigQuery, Cloud Storage, and Cloud...

  • Data Systems Analyst

    2 days ago

    Brisbane, Queensland, Australia Hudson Australia Full time

    This pay rate is inclusive of mandatory 25% casual loadingAs a Systems Analyst in the Data+ Program, you will be pivotal in assessing, optimising, and enhancing our data systems to drive strategic decisions. Your expertise will guide the analysis of business needs, the design of data models and architectures, and the implementation of reliable, scalable data...