High-Performance Data Platform Developer

1 day ago

Brisbane, Queensland, Australia beBeeSoftware Full time $120,000 - $200,000
Key Role in Data Platform Engineering

Caterpillar is seeking a highly skilled Senior Software Engineer to lead the development of a scalable data platform that ingests high-frequency telemetry data from mobile field machines. The successful candidate will be part of a specialist team focused on building and optimizing complex data-centric systems.

About the Position

The role involves designing and implementing robust components for ingesting, processing, and persisting large amounts of real-time data. This includes collaborating with data scientists to host, orchestrate and optimize workloads in Python, Scala, and Java.

Responsibilities
  • Data Ingestion and Processing: Design and implement scalable components using technologies like Apache Spark, Delta Lake, Redis, MQTT, and PostgreSQL.
  • Collaboration and Optimization: Work closely with data scientists to optimize workloads and drive modernization efforts, including containerization and deployment on Kubernetes.
  • Emerging Technologies: Evaluate and integrate emerging technologies to enhance performance and scalability, such as Flink, Trino, Kafka, DuckDB, Dask, and Daft.
  • System Architecture: Contribute to architectural decisions involving event sourcing, CQRS, and hybrid cloud deployments.
Requirements

To be successful in this role, you will need extensive experience in backend development with languages such as Java, Scala, and Python. A proven track record of working in teams to develop large, complex applications is also essential.

Benefits

This position offers a competitive remuneration package, attractive bonus and share options, career development opportunities, and a strong commitment to safety and wellbeing.

Why Join Us?

This role provides an exciting opportunity to work on a technically challenging and meaningful application in the mining domain. You will be part of a forward-thinking team driving innovation in data-centric systems.

  • Data Platform Developer

    1 day ago

    Brisbane, Queensland, Australia beBeeEnvironmentalHealth Full time $134,483 - $153,562

    Job Title: Environmental Health Data SpecialistOverviewSupport the development of a national-scale data platform for environmental health research. Acquire, prepare, and manage complex spatial and time-series datasets from various custodians.This role focuses on data identification, acquisition, documentation, and management. You will contribute to the...

  • Data Platform Specialist

    23 hours ago

    Brisbane, Queensland, Australia beBeeDataPlatform Full time $150,000 - $200,000

    Job Title: Data Platform EngineerWe are seeking a skilled Data Platform Engineer to join our team. As a key member of the Global Investor and Distribution Solutions (GIDS) APAC Data Platform team, you will lead the design, development, and optimization of our enterprise data platform.About the Role:The successful candidate will be responsible for shaping our...

  • Senior Data Platform Developer

    11 hours ago

    Brisbane, Queensland, Australia beBeeSoftwareDeveloper Full time $99,100 - $141,675

    Job DescriptionA software developer with expertise in creating application programming interfaces (APIs) is needed to work on designing, developing, and maintaining data platforms.This role involves writing APIs using tools such as REST and FastAPI, working with Python data libraries for data engineering tasks, and improving non-functional aspects of the...

  • Data Platform Specialist

    2 days ago

    Brisbane, Queensland, Australia beBeeApiDeveloper Full time $80,000 - $120,000

    We are seeking an experienced API Developer to join our team and contribute to the development and maintenance of our data platform. In this role, you will be responsible for defining, designing, and maintaining enterprise platforms and solutions.You will work with various DevOps tools and services, develop APIs using frameworks such as REST and FastAPI, and...

  • Solution Architect – Application Platform

    3 days ago

    Brisbane, Queensland, Australia Data#3 Full time

    Solution Architect – Application PlatformData#3 Brisbane City, Queensland, AustraliaJoin or sign in to find your next jobJoin to apply for the Solution Architect – Application Platform role at Data#3Solution Architect – Application PlatformData#3 Brisbane City, Queensland, Australia1 day ago Be among the first 25 applicantsJoin to apply for the...

  • Data Platform Developer

    16 hours ago

    Brisbane, Queensland, Australia beBeeDataEngineer Full time $100,353

    Job Description:The role of a Graduate Data Engineer involves supporting regulatory data processes in a hybrid work environment.Individuals will undertake various data engineering activities under senior team members' guidance.They will participate in requirements gathering and meetings to achieve objectives.Graduate Data Engineers will develop, deploy,...

  • Senior Data Engineer

    1 day ago

    Brisbane, Queensland, Australia beBeeDataEngineer Full time $150,000 - $200,000

    Job OverviewA senior data engineer position is available to lead the design, development and optimization of the enterprise data platform. As part of the APAC Data Platform team, this role involves shaping data platform strategy, ensuring scalability, reliability and performance across the data ecosystem.Key Responsibilities:Architect and lead the...

  • Platform Developer

    2 days ago

    Brisbane, Queensland, Australia beBeeDevelopment Full time $120,000 - $180,000

    Cloud Platform DeveloperCognizant seeks talented software engineers to join its team and contribute to cloud platform development and maintenance. In this role, you will design, develop, and maintain scalable enterprise platforms and solutions using various DevOps tools and services.Key Responsibilities:Design and develop robust enterprise platforms and...

  • Senior Data Platform Specialist

    1 day ago

    Brisbane, Queensland, Australia beBeeData Full time $150,000 - $195,000

    Job OverviewWe are seeking an experienced Data Architect to lead the design and development of our enterprise data platform. This role is pivotal in shaping our data platform strategy, ensuring scalability, reliability, and performance across our data ecosystem.You will contribute to the architecture and design of scalable, secure, and high-performance data...

  • Data Platform Strategist

    12 hours ago

    Brisbane, Queensland, Australia beBeeDataPlatform Full time $200,000 - $260,000

    Job Title: Data Platform Strategist","About the Role","We facilitate collaboration between technology and people to address challenges, create opportunities and discover new possibilities for our communities while upholding a culture of trust and respect.","","Main Responsibilities:","","Collaborate with clients to gather and clarify requirements and...