Transforming Data Expert

5 hours ago

Brisbane, Queensland, Australia beBeeData Full time $180,000 - $250,000

About Us

At Caterpillar Inc., we're dedicated to building a scalable data platform that transforms high-frequency telemetry data into actionable insights.

This project involves reimagining a legacy Java Spring Boot monolith as a containerized, cloud-ready architecture, enabling stream and batch data processing, lakehouse persistence, and low-latency predictive model hosting.

Main Responsibilities
  • We're seeking a skilled Senior Software Engineer to design and implement robust components for ingesting, processing, and persisting high-frequency telemetry data.
  • Collaborate with data scientists to host, orchestrate, and optimize workloads in Python, Scala, and Java.
  • The ideal candidate will have extensive experience in backend development with languages such as Java, Scala, and Python.

Key Requirements

  • Familiarity with data lake/lakehouse architectures, especially Delta Lake.
  • Strong knowledge of message brokers (MQTT, Kafka) and caching systems (Redis).
  • Deep understanding of streaming and batch data processing, ideally with Apache Spark or similar.
Ideal Candidate Profile

We're looking for a seasoned professional with a proven track record working in teams to develop large, complex applications.

A deep understanding of the required technologies and a passion for innovation will make you an excellent fit for this role.

  • Senior Data Transformation Expert

    3 days ago

    Brisbane, Queensland, Australia beBeeDataTransformation Full time $100,000 - $120,000

    We are seeking a seasoned data transformation expert to assist clients in delivering solutions utilizing Azure Data Factory.Key Responsibilities:Azure Data Factory (ADF) SaaS and Data FlowsAzure Data Factory API Triggers and Control-M IntegrationCloud-based data pipeline orchestration using Azure DevOps GIT and Bitbucket IntegrationDelivery of computing...

  • Mid-Senior Data Transformation Expert

    7 hours ago

    Brisbane, Queensland, Australia beBeeDataTransformation Full time $120,000 - $180,000

    Data Transformation Expert Job Description: We are seeking a highly skilled Data Transformation Expert to join our team. As a key member of our digital transformation initiative, you will play a critical role in shaping our data strategy and driving innovation. Responsibilities: Design and implement scalable data solutions that support business...

  • Data Transformation Expert

    1 week ago

    Brisbane, Queensland, Australia beBeeDataAnalyst Full time $120,000 - $140,000

    Senior Data Analyst Job OpportunityJob Overview:As a Senior Data Analyst, you will play a key role in transitioning and rationalizing legacy data products from various environments to a new cloud-based environment.This position offers a unique opportunity to make a significant impact on complex data challenges due to the company's smaller size compared to...

  • Expert Data Transformation Specialist

    2 weeks ago

    Brisbane, Queensland, Australia beBeeDataManagement Full time $60,000 - $80,000

    Transformative Data SpecialistWe are seeking an expert in data management to join our global research team. This exciting role will focus on digitizing school data, enabling informed decision-making and strategic planning.The ideal candidate will possess exceptional organizational skills, a keen eye for detail, and the ability to work effectively with...

  • Data Transformation Expert

    1 week ago

    Brisbane, Queensland, Australia beBeeDataMigration Full time $90,000 - $120,000

    About the RoleThis exciting opportunity exists for a Data Migration Specialist to join our team. As a key member of our technical department, you will play a crucial role in planning, leading and executing end-to-end data migration from legacy platforms into Microsoft Dynamics 365.The ideal candidate will possess excellent analytical skills, have experience...

  • Data Transformation Expert

    5 days ago

    Brisbane, Queensland, Australia beBeeDataMigration Full time $90,000 - $120,000

    Job OverviewThe role of a data migration specialist involves planning, executing and leading end-to-end data migration from legacy platforms to Microsoft Dynamics 365. The specialist will work with Azure cloud infrastructure.Key Responsibilities:Develop Migration Strategy: Define the overall approach, select tools and manage timelines, risks and rollback...

  • Digital Transformation Data Expert

    3 days ago

    Brisbane, Queensland, Australia beBeeDataEngineer Full time $120,000 - $180,000

    Job Summary:This is a high-impact role for a Data Engineer to contribute to a large-scale digital transformation program within the public sector.The successful candidate will play a pivotal part in designing and implementing data pipelines, architectures, and analytics solutions using cutting-edge Azure & Microsoft technologies.This is an exciting...

  • Advanced Data Transformation Expert

    3 days ago

    Brisbane, Queensland, Australia beBeeTransformation Full time $90,000 - $120,000

    Job OverviewWe are seeking a skilled Data Transformation Specialist to design and build advanced data transformation tools.The ideal candidate will have expertise in utilising APIs, knowledge of integration principles, and experience with 3rd party ETL tools.The Job ResponsibilitiesDesigning scalable data migration solutions using SQL scripts and...

  • Data Transformation Expert

    7 days ago

    Brisbane, Queensland, Australia beBeeSolution Full time $150,000 - $200,000

    Transformative Data Solutions ArchitectWe are seeking a seasoned Solutions Architect to join our Core Data Platforms squad and drive the design and implementation of high-impact data solutions.Key Responsibilities:Define end-to-end architectural solutions aligned with strategic goalsLead the integration of Databricks solutions for Core Data PlatformsChampion...

  • Consultant - Data & AI

    10 hours ago

    Brisbane, Queensland, Australia Data#3 Full time

    Data#3 is seeking an experienced consultant for cloud-native data and AI initiatives. Join a collaborative national Professional Services team delivering enterprise-scale data, AI, and modern application solutions.OverviewPassionate Talent Acquisition Specialist at Data#ResponsibilitiesStrong background in solution design, systems integration, and deploying...