Senior Data Engineer

3 weeks ago


Council of the City of Sydney, Australia black.ai Full time

Location

Melbourne HQ or Sydney

Employment Type

Full time

Department

Engineering

Who is Heidi?

Heidi is building an AI Care Partner that supports clinicians every step of the way, from documentation to delivery of care.

We exist to double healthcare’s capacity while keeping care deeply human. In 18 months, Heidi has returned more than 18 million hours to clinicians and supported over 73 million patient visits. Today, more than two million patient visits each week are powered by Heidi across 116 countries and over 110 languages.

Founded by clinicians, Heidi brings together clinicians, engineers, designers, scientists, creatives, and mathematicians, working with a shared purpose: to strengthen the human connection at the heart of healthcare.

Backed by nearly $100 million in total funding, Heidi is expanding across the USA, UK, Canada, and Europe, partnering with major health systems including the NHS, Beth Israel Lahey Health, MaineGeneral, and Monash Health, among others.

We move quickly where it matters and stay grounded in what’s proven, shaping healthcare’s next era. Ready for the challenge?

The Role

As a Senior Data Platform Engineer at Heidi Health, you’ll help shape our modern data platform — the engine powering both internal analytics and our customer-facing data experiences.

You’ll design, build, and optimize scalable, secure, and reusable data infrastructure — enabling teams to deliver high-quality data products efficiently and confidently.

What you’ll do

- Design and implement efficient and modular data pipelines using Python, PySpark, dbt, and Prefect/Airflow, ensuring idempotency and reusability.

- Build and operate real-time data pipelines using Kafka, Redpanda, or Kinesis, supporting event-driven architectures and clickstream analytics.

- Deploy and scale infrastructure using Terraform’s IaC approach, and manage AWS resources for scalability, reliability, and performance.

- Craft automation and CI/CD workflows (GitHub Actions) for infrastructure and data pipelines, enabling consistent, tested, and repeatable deployments.

- Design RESTful APIs and frameworks for data access, integration, and in-app data delivery.

- Apply best practices in RBAC, security, and governance to ensure compliance and data integrity.

- Support and continuously improve the systems you build, championing reliability and automation at every layer.

- Implement data observability and monitoring to proactively detect, diagnose, and resolve platform issues.

- Collaborate across engineering and product teams to deliver performant data models and self‑serve capabilities.

- Embed data privacy, security, and compliance controls aligned with healthcare and industry standards such as HIPAA, SOC 2, and ISO 27001

- Promote a culture of documentation, testing, observability, and operational rigour across all data systems

What you'll bring

- A minimum of 4+ years of experience in data engineering or a related field.

- Proven track record of building and scaling production data systems in cloud environments (preferably AWS and Databricks).

- Strong experience designing, building, and maintaining cloud‑native data platforms (AWS preferred).

- Hands‑on expertise with Databricks (Spark, Delta Lake, Unity Catalog) and PySpark for scalable data processing.

- Deep understanding of Infrastructure as Code (Terraform) and CI/CD practices for automated deployments.

- Proficiency in Python and SQL, including reusable frameworks and data engineering libraries.

- Understanding of event‑driven architectures and streaming data systems (Kafka, Redpanda, Kinesis).

- Familiarity with data orchestration tools such as Prefect, Dagster, or Airflow.

- Experience implementing RBAC, data governance, and FinOps principles for cloud cost optimisation.

Nice to Have

- Experience with Kubernetes for orchestration of containerized workloads.

- Familiarity with ClickHouse or Postgres as analytical or serving data stores.

- Exposure to data observability tooling (e.g., Great Expectations, Monte Carlo, OpenLineage).

- Experience designing API‑based data products and self‑serve data platforms.

- Experience with dbt for transformation, testing, and modular data modelling.

What do we believe in?

Heidi builds for the future of healthcare, not just the next quarter, and our goals are ambitious because the world’s health demands it. We believe in progress built through precision, pace, and ownership.

- Live Forever - Every release moves care forward: measured, safe, and built to last. Data guides us, but patients define the truth that matters.

- Practice Ownership - Decisions follow logic and proof, not hierarchy. Exceptional care demands exceptional standards in our work, our thinking, and our character.

- Small Cuts Heal Faster - Stability earns trust, speed delivers impact. Progress is about learning fast without breaking what people depend on.

- Make others better - Feedback is direct, kindness is constant, and excellence lifts everyone. Our success is measured by collective growth, not individual output.

Our mission is clear: expand the world’s capacity to care, and do it without losing the humanity that makes care worth delivering.

Why you will flourish with us 🚀?

- Flexible hybrid working environment, with 3 days in the office.

- Additional paid day off for your birthday and wellness days

- Special corporate rates at Anytime Fitness in Melbourne, Sydney tbc.

- A generous personal development budget of $500 per annum

- Learn from some of the best engineers and creatives, joining a diverse team

- Become an owner, with shares (equity) in the company, if Heidi wins, we all win

- The rare chance to create a global impact as you immerse yourself in one of Australia’s leading healthtech startups

- If you have an impact quickly, the opportunity to fast track your startup career

Help us reimagine primary care and change the face of healthcare in Australia and then around the world.

#J-18808-Ljbffr



  • Council of the City of Sydney, Australia Neara Group Full time

    Imagine preventing wildfires before they start, or ensuring power grids stay resilient during extreme weather. That’s the real-world impact we create every day at Neara. We build 3D physics-enabled digital twins of critical infrastructure networks that help utilities and infrastructure companies run scenarios, assess risks, and make smarter decisions that...

  • Senior Data Engineer

    4 weeks ago


    Council of the City of Sydney, Australia FinXL Full time

    Senior Data Engineer Leading government client (consulting through FinXL) FinXL Professional Services is a leading IT consultancy that partners with clients to bridge the gap between business needs and technology capabilities. Since 2003, we've been delivering high-value ICT services across government, finance, telecommunications, and enterprise...


  • Council of the City of Sydney, Australia CoStar Group, Inc. Full time

    Senior Data Engineer – Domain – Sydney Job Description Company Overview CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the world’s real estate, empowering...


  • Council of the City of Sydney, Australia BINGO Industries Limited Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Senior Data and AI Engineer Date: 22 Oct 2025 Location: Sydney, NSW, AU Company: Bingo BINGO Industries is at a pivotal chapter in our growth journey. More than a recycling company, we are transforming waste into sustainable resources that improve all our lives,...


  • Council of the City of Sydney, Australia Singtel Group Full time

    A leading telecommunications company in Australia is seeking a Staff Data Engineer to join their Data Engineering Centre of Excellence. This senior role combines hands-on engineering with strategic leadership to shape the future of their enterprise data platform. Candidates should possess strong experience with cloud data platforms and proficiency in Python...

  • Data Engineer

    7 days ago


    Council of the City of Sydney, Australia TRAILD PTY LTD Full time

    About TRAILD TRAILD is a dynamic, fast-growing, remote-first SaaS company that streamlines, automates, and protects Accounts Payable (AP). Just as your bank provides always-on protection for your credit card, TRAILD delivers the same level of security to help businesses safeguard their B2B payments from fraud, errors, and mistakes. Our specialised...

  • Senior Data Engineer

    3 weeks ago


    Council of the City of Sydney, Australia SONITEC Full time

    About the role The company is seeking a Senior Data Engineer with focus on AI/ML DataOps pipelines to join the Sensor Fusion AI Team in Sydney CBD. Responsibilities, Duties and Expectations - Design, develop, maintain and/or refine internal software tools used for processing data, workflow automation, benchmarking and testing the a Sensor AI engine -...


  • Council of the City of Sydney, Australia MIP Full time

    Senior Data Engineer – Microsoft Fabric (Snowflake or Databricks) We’re growing our data engineering practice and need a Senior Data Engineer who can own delivery as well as build. This person will lead project squads – running stand-ups, managing scope, keeping RAID up to date, and reporting to stakeholders – while also being hands‑on in...


  • Council of the City of Sydney, Australia Feedzai Full time

    Senior Software Engineer - Data Orchestration Feedzai is the world’s first RiskOps platform for financial risk management, and the market leader in safeguarding global commerce with today’s most advanced cloud-based risk management platform, powered by machine learning and artificial intelligence. Feedzai is securing the transition to a cashless world...


  • Council of the City of Sydney, Australia Heidi Health Full time

    Who is Heidi? Heidi is building an AI Care Partner that supports clinicians every step of the way, from documentation to delivery of care. We exist to double healthcare’s capacity while keeping care deeply human. In 18 months, Heidi has returned more than 18 million hours to clinicians and supported over 73 million patient visits. Today, more than two...