Platform Engineer@Data Discovery

23 hours ago

Sydney, New South Wales, Australia BURGEON IT SERVICES Full time $120,000 - $180,000 per year

Position: Platform Engineer for Data Discovery

Location: Sydney

Duration: 6 months

Role Overview

We are seeking a skilled and motivated Platform Engineer to join our Data Engineering team, focusing on building and enhancing our Data Discovery capabilities. You will be responsible for designing, implementing, and maintaining scalable platforms that enable metadata management, data cataloging, and lineage tracking across our enterprise data ecosystem.

Key Responsibilities

Design & Develop Data Discovery Platforms

  • Build scalable, secure, and high-performance platforms for metadata ingestion, cataloging, and lineage tracking.
  • Integrate discovery tools with enterprise data sources and pipelines.

Enable Data Governance & Self-Service

  • Implement role-based access controls, audit logging, and compliance features.
  • Support data democratization by enabling intuitive search and exploration features for users.

Collaborate Across Teams

  • Work closely with data engineers, analysts, governance teams, and business stakeholders to align platform capabilities with organizational needs.
  • Provide technical documentation and support for platform adoption.

Must-Have Skills

  • Programming & Scripting: Python, SQL, Bash
  • Cloud Platforms: AWS, Azure, or GCP (with data services like Glue, BigQuery, Synapse)
  • Data Discovery Tools: Hands-on experience with Alation, Collibra, Amundsen, or DataHub
  • Infrastructure as Code (IaC): Terraform, CloudFormation, or Pulumi
  • Containerization & Orchestration: Docker, Kubernetes
  • CI/CD & DevOps: GitHub Actions, Jenkins, GitLab CI
  • Data Engineering Concepts: ETL/ELT, data modeling, metadata management
  • Security & Compliance: Understanding of data privacy regulations (GDPR, HIPAA)

Nice-to-Have Skills

  • Serverless Architecture: AWS Lambda, Azure Functions
  • Monitoring & Observability: Prometheus, Grafana, Datadog
  • Data Lineage & Governance Frameworks
  • Experience with Open Source Tools: dbt, Apache Airflow, Apache Atlas
  • Multi-cloud Experience
  • Strong Communication & Documentation Skills
  • Experience in Agile/Scrum environments

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 7+ years of experience in platform engineering or data infrastructure roles.
  • Proven experience in implementing enterprise-grade data discovery solutions.

  • Platform Engineer for Data Discovery

    5 days ago

    Sydney, New South Wales, Australia BURGEON IT SERVICES Full time $90,000 - $120,000 per year

    Position: Platform Engineer for Data DiscoveryLocation: SydneyDuration: 6 monthsPlatform Engineer for Data DiscoveryProgramming Languages:Python : For scripting, automation, and data manipulation.SQL : For querying and managing structured data.Java/Scala : For building scalable data processing systems.Data Modeling & Design:Strong understanding of data...

  • Data Platform Engineer

    7 days ago

    Sydney, New South Wales, Australia Mane Consulting Full time $120,000 - $180,000 per year

    Get recognition and reward working with this a pioneering industry leader, as they embark on a transformative journey We are currently seeking a passionate Data platform engineer for an exciting 12-month contract opportunity within their highly respected Technology team. This pivotal role demands a seasoned professional with robust expertise in AWS Glue, AWS...

  • Platform Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Whizdom Full time $80,000 - $120,000 per year

    About Our ClientOur client is a prestigious global consulting house, renowned for delivering innovative solutions across banking, financial services, and other major industry sectors. With a workforce numbering in the tens of thousands and offices spanning Australia, Asia-Pacific, Europe, and North America, they are recognised for their commitment to...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Silverlink Infotech Pty Ltd Full time $80,000 - $120,000 per year

    GreetingsWe have an urgent opening for "Multiple Data Engineer role " in Sydney , Australia. Please let me know your interest. Also you can refer us if anyone is interested contact to  Seek at / or : Role 1 –"Data Engineer"Location – Sydney, AustraliaDuration : ContractMust Have Skills:Hands On with advanced SQL, Python...

  • Data Engineer, Data Platform

    5 days ago

    Sydney, New South Wales, Australia TikTok Full time $100,000 - $140,000 per year

    ResponsibilitiesTeam Intro:The Data Engineering team in Data Platform USDS is focused on ensuring the stability, reliability, scalability and risk management of TikTok's US data processing ecosystem. We maintain and operate both batch and streaming pipelines for multiple vertical businesses such as TikTok and TikTok Shop while simultaneously adhering to...

  • Azure Data Platform Engineer

    1 week ago

    Sydney, New South Wales, Australia Virtusa Full time $120,000 - $180,000 per year

    Job SummaryWe are seeking a highly skilled and proactive Azure Data Platform Engineer to design, implement, and manage robust data solutions on Microsoft Azure. The ideal candidate will have deep expertise in Azure Synapse, Azure Databricks, Azure Fabric, and cloud infrastructure administration. This role involves maintaining server health, managing...

  • AWS Data Platform Engineer

    1 week ago

    Sydney, New South Wales, Australia Maltem Australia Full time $120,000 - $180,000 per year

    About Maltem AustraliaMaltem Australia is a boutique consultancy specialising in data and analytics, part of the Maltem Group a global consulting firm with over 25 years of experience and operations in 12+ countries.In Australia, we partner with leading organisations across financial services, technology, and government to design and implement modern data...

  • Principal / Senior Data Engineer (Data Platforms)

    7 days ago

    Sydney, New South Wales, Australia Simple Machines Full time $120,000 - $180,000 per year

    Principal / Senior Data Engineer (Data Platforms)Darlinghurst, SydneySimple Machines. Data Engineered to LifeSimple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine...

  • Principal / Senior Data Engineer (Data Platforms)

    1 week ago

    Sydney, New South Wales, Australia Simple Machines Full time $120,000 - $180,000 per year

    Principal / Senior Data Engineer (Data Platforms)Darlinghurst, SydneySimple Machines. Data Engineered to LifeSimple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine...

  • Principal Data Platform Engineer

    1 day ago

    Sydney, New South Wales, Australia Nuix Full time $120,000 - $180,000 per year

    Department:TechnologyLocation:Sydney (Australia)DescriptionWe're on a mission to be a Force For Good, through our People, Products and Purpose at Nuix.This extends to our People. We're fiercely passionate, love working at pace, thrive in ambiguity, live, and breathe outside of the box, and above all are good humans. We're determined to make a positive...