Data Platform Engineer

13 hours ago

Perth, Western Australia beBeeData Full time $90,000 - $110,000

We are seeking a skilled Data Architect to join our team. This role will focus on designing and maintaining a hybrid on-premises and cloud-based data platform that ingests, stores, and serves large volumes of financial data with reliability and low latency.

About the Role

This position is responsible for architecting scalable, high-performance data infrastructure across on-prem and cloud environments. You will develop real-time and batch-oriented data pipelines for market data ingestion, integrate and manage data from internal systems and external vendors with a focus on reliability and quality, and implement best practices around data governance, access control, monitoring, and observability.

Key Responsibilities
  • Design and Build Scalable Data Infrastructure: Develop high-performance data infrastructure across on-prem and cloud environments.
  • Develop Real-Time and Batch-Oriented Data Pipelines: Create data pipelines for market data ingestion.
  • Integrate and Manage Data: Integrate and manage data from internal systems and external vendors.
  • Implement Best Practices: Implement best practices around data governance, access control, monitoring, and observability.
  • Collaborate with Stakeholders: Collaborate with traders, researchers, and developers to align data systems with business needs.
  • Automate Infrastructure Provisioning: Automate infrastructure provisioning using modern DevOps and IaC tools.
  • Provide Production Support: Provide production support, including out-of-hours assistance when needed.
Requirements
  • Bachelor's degree in Maths, Engineering, Computer Science, or comparable experience.
  • Strong understanding of distributed systems, data storage, and streaming technologies.
  • Proficiency with Linux, networking, and performance tuning.
  • Cloud platform experience (AWS, GCP).
  • Proficiency in Python, Go, or Java.
  • SQL and data modelling skills.
  • Experience with Kubernetes, Docker, and infrastructure as code.
  • Familiarity with orchestration tools like Airflow or Dagster.
  • Strong communication skills and fluency in English.
  • A passion for continuous learning.

  • Data Platform Engineer

    3 days ago

    Perth, Western Australia Perth Airport Full time

    Perth Airport is Australia's Western Hub connecting the people, businesses and communities of Western Australia with the rest of Australia and the world.Operating 24 hours a day, seven days a week throughout the year, Perth Airport plays a significant role in providing economic, social and cultural benefits to West Australians.Perth Airport is investing more...

  • Data Platform Engineer

    2 days ago

    Perth, Western Australia Perth Airport Pty Full time

    Perth Airport is Australia's Western Hub connecting the people, businesses and communities of Western Australia with the rest of Australia and the world.Operating 24 hours a day, seven days a week throughout the year, Perth Airport plays a significant role in providing economic, social and cultural benefits to West Australians.Perth Airport is investing more...

  • Data Platform Engineer

    7 days ago

    Perth, Western Australia Perth Airport Pty Full time

    Perth Airport is Australia's Western Hub connecting the people, businesses and communities of Western Australia with the rest of Australia and the world. Operating 24 hours a day, seven days a week throughout the year, Perth Airport plays a significant role in providing economic, social and cultural benefits to West Australians.Perth Airport is investing...

  • Highly Skilled Data Platforms Engineer

    3 days ago

    Perth, Western Australia beBeeData Full time $120,000 - $175,000

    Job Title: Specialist Data ProjectsBHP is generating large amounts of data from different sources and scaling value through delivery of emergent AI solutions. As a Specialist Data & AI Platforms Engineer, you will play a hands-on role supporting the design, implementation, and improvement of core Data & AI Platforms and Technologies.These platforms provide...

  • Senior Data Engineer with Scalable Data Platform Expertise

    7 days ago

    Perth, Western Australia beBeeData Full time $200,000 - $250,000

    Job DescriptionAs a senior data engineer, you will play a key role in leading the design, development, and optimization of our enterprise data platform. This is a pivotal position that requires expertise in shaping data platform strategy to ensure scalability, reliability, and performance across our data ecosystem.">

  • Data Platform Lead

    3 days ago

    Perth, Western Australia Australian Finance Group Full time $70,000 - $120,000 per year

    About the RoleAs our new Data Platform Lead, you'll play a pivotal role in driving AFG's data platform to meet our data goals. You'll lead a team of data engineers and architects, driving the design and evolution of our data lake and warehouse. This is a hands-on role where strategy meets engineering delivery.Reporting into the Head of Analytics and...

  • Platform Engineer/DevOps Engineer

    7 days ago

    Perth, Western Australia Talent Full time

    Talent Perth, Western Australia, AustraliaJoin or sign in to find your next jobJoin to apply for the Platform Engineer/DevOps Engineer role at TalentTalent Perth, Western Australia, Australia1 day ago Be among the first 25 applicantsJoin to apply for the Platform Engineer/DevOps Engineer role at TalentA major government agency is seeking an experienced...

  • Platform Engineer/DevOps Engineer

    7 days ago

    Perth, Western Australia Talent Full time

    Talent Perth, Western Australia, AustraliaJoin or sign in to find your next jobJoin to apply for the Platform Engineer/DevOps Engineer role at TalentTalent Perth, Western Australia, Australia1 day ago Be among the first 25 applicantsJoin to apply for the Platform Engineer/DevOps Engineer role at TalentA major government agency is seeking an experienced...

  • Data Platform Architect

    5 days ago

    Perth, Western Australia beBeeEngineering Full time $180,000 - $250,000

    Database Engineering Manager Role OverviewWe are seeking an experienced engineering leader to oversee the deployment, maintenance, and scaling of our cloud-native platform.Key Responsibilities: Lead and grow a global data services team. Oversee the development, implementation, and operation of cloud-based technologies. Collaborate with cross-functional teams...

  • Data Platform Specialist

    1 week ago

    Perth, Western Australia beBeeInfrastructure Full time $90,000 - $110,000

    Job OverviewWe seek a skilled infrastructure engineer to architect and maintain a hybrid on-premises and cloud-based data platform that ingests, stores, and serves large volumes of financial data with reliability and low latency.Key Responsibilities:Design scalable, high-performance data infrastructure across on-prem and cloud environments.Develop real-time...