Data Platform Engineering Team Lead

1 day ago

Sydney, New South Wales, Australia DroneShield Full time $120,000 - $180,000 per year

About the role

You'll build and lead a team responsible for a significant uplift of our tools and infrastructure for data capture, ingest, storage, annotation, and service. This will mean a combination of in-house tool development and integration with off-the-shelf solutions.

The position will report to the Engineering Manager, Algorithms, in the Sensors & Effectors group.

Responsibilities, Duties and Expectations 

  • Build and lead a team of Data and Software Engineers to develop tooling for data capture, ingest, storage, annotation, and service
  • Anticipate and respond to the needs of your customers, and drive solutions until they are successful
  • Develop technical and execution strategy to ensure that tools are built in a robust and scalable way within a cohesive end-to-end data tooling architecture
  • Ensure software stacks are well instrumented and routinely tested to enable continual assessment and improvement against key metrics
  • Create and deliver comprehensive training materials and workshops to teams across the business
  • Spot opportunities where off-the-shelf products exist to solve our problems
  • Collaborate with other teams to drive procurement and allocation of storage and compute resources
  • Automate away the operational tasks of your and other teams to help the business scale

Qualifications, Experience and Skills 

  • Bachelor's degree in Computer Science, Data Science, Mathematics or similar technical field of study, or equivalent practical experience 
  • Experience leading a team of Engineers (3+ years) 
  • Experience with Python, and one or more compiled languages (Go or C++ preferred) 
  • Experience with large scale data operations and associated infrastructure/platforms (e.g. Kubernetes, Snowflake, Spark, Databricks) 
  • Experience with AI/ML based systems (5+ years) 
  • Ability to translate business requirements and objectives between the engineering and executive team 
  • Ability to work in a multidisciplinary team, communicating effectively with engineers from non-software / data science backgrounds 
  • Track record for delivering commercial solutions through the entire life cycle 
  • Electronic Warfare (EW) experience is highly valued 

Who you are 

  • You thrive leading teams of people 
  • You enjoy mentoring others to adopt industry standard practices 
  • You are a lifelong learner who keeps up with current best practices in your areas of expertise 
  • You have an abundance of ambition and motivation to grow the business 
  • You want to beat the big players in the industry 

Note for recruitment agencies: We do not accept unsolicited candidates from external recruiters unless specifically instructed.

  • Data Engineer, Data Platform

    3 days ago

    Sydney, New South Wales, Australia TikTok Full time $100,000 - $140,000 per year

    ResponsibilitiesTeam Intro:The Data Engineering team in Data Platform USDS is focused on ensuring the stability, reliability, scalability and risk management of TikTok's US data processing ecosystem. We maintain and operate both batch and streaming pipelines for multiple vertical businesses such as TikTok and TikTok Shop while simultaneously adhering to...

  • Data Platform Engineer

    5 days ago

    Sydney, New South Wales, Australia Mane Consulting Full time $120,000 - $180,000 per year

    Get recognition and reward working with this a pioneering industry leader, as they embark on a transformative journey We are currently seeking a passionate Data platform engineer for an exciting 12-month contract opportunity within their highly respected Technology team. This pivotal role demands a seasoned professional with robust expertise in AWS Glue, AWS...

  • AWS Data Platform Engineer

    7 days ago

    Sydney, New South Wales, Australia Maltem Australia Full time $120,000 - $180,000 per year

    About Maltem AustraliaMaltem Australia is a boutique consultancy specialising in data and analytics, part of the Maltem Group a global consulting firm with over 25 years of experience and operations in 12+ countries.In Australia, we partner with leading organisations across financial services, technology, and government to design and implement modern data...

  • GCP Data Platform Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Novon Full time $70,000 - $120,000 per year

    Novon is a boutique Tech Consulting Company with Blue-chip (ASX50) clients.Join a connected Data and Engineering Community.10 years delivering successful data outcomes.Are you a Data Platform Engineering specialist, immersed in data-driven projects that help organisations modernise their platforms and build scalable analytics solutions? This opportunity...

  • GCP Data Platform Engineer

    2 weeks ago

    Sydney, New South Wales, Australia NOVON Full time $120,000 - $180,000 per year

    Novon is a boutique Tech Consulting Company with Blue-chip (ASX50) clients.Join a connected Data and Engineering Community.10 years delivering successful data outcomes.Are you a Data Platform Engineering specialist, immersed in data-driven projects that help organisations modernise their platforms and build scalable analytics solutions?This opportunity...

  • Azure Data Platform Engineer

    7 days ago

    Sydney, New South Wales, Australia Virtusa Full time $120,000 - $180,000 per year

    Job SummaryWe are seeking a highly skilled and proactive Azure Data Platform Engineer to design, implement, and manage robust data solutions on Microsoft Azure. The ideal candidate will have deep expertise in Azure Synapse, Azure Databricks, Azure Fabric, and cloud infrastructure administration. This role involves maintaining server health, managing...

  • Principal / Senior Data Engineer (Data Platforms)

    5 days ago

    Sydney, New South Wales, Australia Simple Machines Full time $120,000 - $180,000 per year

    Principal / Senior Data Engineer (Data Platforms)Darlinghurst, SydneySimple Machines. Data Engineered to LifeSimple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine...

  • Principal / Senior Data Engineer (Data Platforms)

    1 week ago

    Sydney, New South Wales, Australia Simple Machines Full time $120,000 - $180,000 per year

    Principal / Senior Data Engineer (Data Platforms)Darlinghurst, SydneySimple Machines. Data Engineered to LifeSimple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine...

  • Data Engineering Lead

    7 days ago

    Sydney, New South Wales, Australia Blackmores Group Full time $180,000 - $250,000 per year

    We are hiring aLead Data Engineerto join our Data & Analytics team.Purpose:Blackmores is on a journey to revamp their Data and Analytics (DNA) landscape to move from diagnostics analytics to predictive and prescriptive analytics. We are bringing in world class tools like Snowflake,Fivetran,Coalesceto build a platform which will enable us to change the DNA of...

  • Senior Data Platform Engineer

    3 days ago

    Sydney, New South Wales, Australia Simple Machines Full time $120,000 - $180,000 per year

    Simple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and...