Senior Data Engineer

14 hours ago

Melbourne, Victoria, Australia Maincode Full time $120,000 - $180,000 per year
Overview

Maincode is building sovereign AI models in Australia. We are training foundation models from scratch, designing new reasoning architectures, and deploying them on state-of-the-art GPU clusters. Our models are built on datasets we create ourselves, curated, cleaned, and engineered for performance at scale. This is not buying off-the-shelf corpora or scraping without thought. This is building world-class datasets from the ground up.

As a Senior Data Engineer, you will lead the design and construction of these datasets. You will work hands-on to source, clean, transform, and structure massive amounts of raw data into training-ready form. You will design the architecture that powers data ingestion, validation, and storage for multi-terabyte to petabyte-scale AI training. You will collaborate with AI Researchers and Engineers to ensure every byte is high quality, relevant, and optimised for training cutting-edge large language models and other architectures.

This is a deep technical role. You will be writing code, building pipelines, defining schemas, and debugging unusual data edge cases at scale. You will think like both a data scientist and a systems engineer, designing for correctness, scalability, and future proofing. If you want to build the datasets that power sovereign AI from first principles, this is your team.


What you'll do

  • Design and build large-scale data ingestion and curation pipelines for AI training datasets

  • Source, filter, and process diverse data types including text, structured data, code, and multimodal, from raw form to model-ready format

  • Implement robust quality control and validation systems to ensure dataset integrity, relevance, and ethical compliance

  • Architect storage and retrieval systems optimised for distributed training at scale

  • Build tooling to track dataset lineage, reproducibility, and metadata at all stages of the pipeline

  • Work closely with AI Researchers to align datasets with evolving model architectures and training objectives

  • Collaborate with DevOps and ML engineers to integrate data systems into large-scale training workflows

  • Continuously improve ingestion speed, preprocessing efficiency, and data freshness for iterative training cycles


Who you are

  • Passionate about building world-class datasets for AI training from raw source to training-ready

  • Experienced in Python and data engineering frameworks such as Apache Spark, Ray, or Dask

  • Skilled in working with distributed data storage and processing systems such as S3, HDFS, or cloud object storage

  • Strong understanding of data quality, validation, and reproducibility in large-scale ML workflows

  • Familiar with ML frameworks like PyTorch or JAX, and how data pipelines interact with them

  • Comfortable working with multi-terabyte or larger datasets

  • Hands-on and pragmatic, you like solving real data problems with code and automation

  • Motivated to help build sovereign AI capability in Australia


Why Maincode

We are a small team building some of the most advanced AI systems in Australia. We create new foundation models from scratch, not just fine-tune existing ones, and we build the datasets they run on from the ground up.

We operate our own GPU clusters, run large-scale training, and integrate research and engineering closely to push the frontier of what is possible.

You will be surrounded by people who:

  • Care deeply about data quality and architecture, not just volume

  • Build systems that scale reliably and repeatably

  • Take pride in learning, experimenting, and shipping

  • Want to help Australia build independent, world-class AI systems

  • Senior Data Engineer

    11 hours ago

    Melbourne, Victoria, Australia Konnexus Full time $120,000 - $180,000 per year

    At Konnexus, we're partnering with a trusted client who is looking to bring on a Senior Data Engineer in Sydney or Melbourne. This role involves leading data driven solution that help to transform clients' landscapes and solve problems through the power of data. As a Senior Data Engineer, you'll be great on the tools and speaking with non-technical...

  • Senior Data Engineer

    6 days ago

    Melbourne, Victoria, Australia DNA Technology Services Full time $120,000 - $180,000 per year

    We're Hiring: Senior Data Engineer – Melbourne Location: Melbourne Job Type: Fixed Term – 1 year (potential to extend up to 2 more years)About the RoleWe are seeking aSenior Data Engineerto join our client's Data & Insights team. This role will be a key contributor to themigration of legacy reporting platformsand themodernization of data infrastructure....

  • Senior Data Engineer

    1 week ago

    Melbourne, Victoria, Australia INNOVATE IT AUSTRALIA Full time $150,000 - $200,000 per year

    Senior Data Engineer – MainframeJob DescriptionMust Have SkillsPL SQLMainframeUnixDetailed Job DescriptionMandatory Skills:· Strong data engineering skills using SQL, Unix, OracleDetailed Job DescriptionMandatory Skills: · Strong data engineering skills using SQL, Unix, Oracle· Sound foundation in SQL and Shell scripting· Should have SQL Query...

  • Senior Data Engineer

    1 week ago

    Melbourne, Victoria, Australia INNOVATE IT AUSTRALIA Full time $104,000 - $130,878 per year

    Title : Senior Data Engineer : : MainframeLocation :Melbourne, VICMust Have Skills:• PL SQL• Mainframe• UnixDetailed Job DescriptionMandatory Skills:• Strong data engineering skills using SQL, Unix, Oracle• Sound foundation in SQL and Shell scripting• Should have SQL Query optimization skills• Extensive experience working in an agile...

  • Senior Data Engineers

    2 weeks ago

    Melbourne, Victoria, Australia Otic Group Full time $120,000 - $180,000 per year

    "Otic" means smart people doing smart work, together.We are a wholly owned Australian company committed to helping our clients design and build intelligent software solutions that unlock value in their business.Otic Group was formed to provide talented technology professionals an opportunity to work with not only some of the most prominent companies in...

  • Senior Data Engineer

    13 hours ago

    Melbourne, Victoria, Australia Ippon Technologies Full time $120,000 - $180,000 per year

    Ippon Australia is a team of true technologists who leverage contemporary thinking and tools to enhance the way our clients drive value. Whether it's a bespoke platform to improve employee engagement within a national retail chain, or developing an app that provides next level direct customer interaction; value is delivered to our clients when we begin by...

  • Senior Data Engineer

    2 weeks ago

    Melbourne, Victoria, Australia Maincode Full time $120,000 - $180,000 per year

    OverviewMaincode is building sovereign AI models in Australia. We are training foundation models from scratch, designing new reasoning architectures, and deploying them on state-of-the-art GPU clusters. Our models are built on datasets we create ourselves, curated, cleaned, and engineered for performance at scale. This is not buying off-the-shelf corpora or...

  • Senior Data Scientist

    13 hours ago

    Melbourne, Victoria, Australia Tech & Data People Full time $120,000 - $180,000 per year

    If you're the kind of data scientist who loves diving deep into probabilities, simulation models, and complex statistical challenges — this is a great role for you.You'll join a growing team that's building out the industry leading data science projects. This isn't about stakeholder decks or endless meetings; it's a hands-on role for someone who loves...

  • Senior Data Engineer

    13 hours ago

    Melbourne, Victoria, Australia DBG Health Full time $120,000 - $180,000 per year

    About DBG HealthDBG Health is a leading Melbourne-based health, wellness, and beauty company with over 1,500 professionals dedicated to making wellbeing accessible to all. Our diverse portfolio, spanning Arrotex Pharmaceuticals, VidaCorp Consumer Brands, Independent Pharmacies of Australia Group, Axe Health Services and MyDNA reflects our commitment to...

  • Principal Data Engineer

    2 weeks ago

    Melbourne, Victoria, Australia Tech & Data People Full time $250,000 per year

    Principal Data Engineer – Melbourne – Hybrid - $250,000 - bleeding-edge Cloud & Data tech - enable next-gen analytics & AI Tech and Data People are working with a leading organisation that is driving large-scale digital and data transformation. We're looking for a Principal Data Engineer to design and deliver modern, secure, and scalable data...