Platform Engineer@Data Discovery

1 day ago

Sydney, New South Wales, Australia BURGEON IT SERVICES Full time $120,000 - $180,000 per year

Position: Platform Engineer for Data Discovery

Location: Sydney

Duration: 6 months

Role Overview

We are seeking a skilled and motivated Platform Engineer to join our Data Engineering team, focusing on building and enhancing our Data Discovery capabilities. You will be responsible for designing, implementing, and maintaining scalable platforms that enable metadata management, data cataloging, and lineage tracking across our enterprise data ecosystem.

Key Responsibilities

Design & Develop Data Discovery Platforms

  • Build scalable, secure, and high-performance platforms for metadata ingestion, cataloging, and lineage tracking.
  • Integrate discovery tools with enterprise data sources and pipelines.

Enable Data Governance & Self-Service

  • Implement role-based access controls, audit logging, and compliance features.
  • Support data democratization by enabling intuitive search and exploration features for users.

Collaborate Across Teams

  • Work closely with data engineers, analysts, governance teams, and business stakeholders to align platform capabilities with organizational needs.
  • Provide technical documentation and support for platform adoption.

Must-Have Skills

  • Programming & Scripting: Python, SQL, Bash
  • Cloud Platforms: AWS, Azure, or GCP (with data services like Glue, BigQuery, Synapse)
  • Data Discovery Tools: Hands-on experience with Alation, Collibra, Amundsen, or DataHub
  • Infrastructure as Code (IaC): Terraform, CloudFormation, or Pulumi
  • Containerization & Orchestration: Docker, Kubernetes
  • CI/CD & DevOps: GitHub Actions, Jenkins, GitLab CI
  • Data Engineering Concepts: ETL/ELT, data modeling, metadata management
  • Security & Compliance: Understanding of data privacy regulations (GDPR, HIPAA)

Nice-to-Have Skills

  • Serverless Architecture: AWS Lambda, Azure Functions
  • Monitoring & Observability: Prometheus, Grafana, Datadog
  • Data Lineage & Governance Frameworks
  • Experience with Open Source Tools: dbt, Apache Airflow, Apache Atlas
  • Multi-cloud Experience
  • Strong Communication & Documentation Skills
  • Experience in Agile/Scrum environments

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 7+ years of experience in platform engineering or data infrastructure roles.
  • Proven experience in implementing enterprise-grade data discovery solutions.

  • Platform Engineer for Data Discovery

    5 days ago

    Sydney, New South Wales, Australia BURGEON IT SERVICES Full time $90,000 - $120,000 per year

    Position: Platform Engineer for Data DiscoveryLocation: SydneyDuration: 6 monthsPlatform Engineer for Data DiscoveryProgramming Languages:Python : For scripting, automation, and data manipulation.SQL : For querying and managing structured data.Java/Scala : For building scalable data processing systems.Data Modeling & Design:Strong understanding of data...

  • Data Platform Engineer

    7 days ago

    Sydney, New South Wales, Australia Mane Consulting Full time $120,000 - $180,000 per year

    Get recognition and reward working with this a pioneering industry leader, as they embark on a transformative journey We are currently seeking a passionate Data platform engineer for an exciting 12-month contract opportunity within their highly respected Technology team. This pivotal role demands a seasoned professional with robust expertise in AWS Glue, AWS...

  • Lead - Discovery (Biologics)

    3 days ago

    Sydney, New South Wales, Australia The Garvan Institute of Medical Research Full time $160,000 per year

    Garvan's Biologics Platform enables the discovery, engineering, and development of protein-based therapeutics across cancer, immunology, and rare diseases. This position will be a cornerstone of our biologics discovery capability, delivering high-quality binders and early-stage candidates to downstream engineering, AI-driven optimisation, and translational...

  • Data Engineer, Data Platform

    5 days ago

    Sydney, New South Wales, Australia TikTok Full time $100,000 - $140,000 per year

    ResponsibilitiesTeam Intro:The Data Engineering team in Data Platform USDS is focused on ensuring the stability, reliability, scalability and risk management of TikTok's US data processing ecosystem. We maintain and operate both batch and streaming pipelines for multiple vertical businesses such as TikTok and TikTok Shop while simultaneously adhering to...

  • Azure Data Platform Engineer

    1 week ago

    Sydney, New South Wales, Australia Virtusa Full time $120,000 - $180,000 per year

    Job SummaryWe are seeking a highly skilled and proactive Azure Data Platform Engineer to design, implement, and manage robust data solutions on Microsoft Azure. The ideal candidate will have deep expertise in Azure Synapse, Azure Databricks, Azure Fabric, and cloud infrastructure administration. This role involves maintaining server health, managing...

  • AWS Data Platform Engineer

    1 week ago

    Sydney, New South Wales, Australia Maltem Australia Full time $120,000 - $180,000 per year

    About Maltem AustraliaMaltem Australia is a boutique consultancy specialising in data and analytics, part of the Maltem Group a global consulting firm with over 25 years of experience and operations in 12+ countries.In Australia, we partner with leading organisations across financial services, technology, and government to design and implement modern data...

  • Principal / Senior Data Engineer (Data Platforms)

    2 weeks ago

    Sydney, New South Wales, Australia Simple Machines Full time $120,000 - $180,000 per year

    Principal / Senior Data Engineer (Data Platforms)Darlinghurst, SydneySimple Machines. Data Engineered to LifeSimple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine...

  • Senior Data Platform Engineer

    5 days ago

    Sydney, New South Wales, Australia Simple Machines Full time $120,000 - $180,000 per year

    Simple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and...

  • Senior Data Platform Engineer

    5 days ago

    Sydney, New South Wales, Australia Simple Machines Full time $120,000 - $180,000 per year

    Simple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and...

  • Senior Data Platform Engineer

    5 days ago

    Sydney, New South Wales, Australia Simple Machines Full time $120,000 - $180,000 per year

    Simple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and...