Distributed Machine Learning Infrastructure Specialist

2 weeks ago


Sydney, New South Wales, Australia IMC Financial Markets Full time

Job Summary

You will work as part of an established and growing research team at IMC Financial Markets, helping to develop frameworks for training large models on a distributed cluster. Your collaboration with researchers, platform and software engineers will leverage your knowledge of infrastructure and training libraries to accelerate the rollout of a broad array of models.

Key Responsibilities

  • Develop and Support Libraries
    • Accelerate training on a distributed environment.
    • Automate ML workflows, experiment evaluation and management, hyperparam tuning (autoML) & retraining.
    • Use GPU hardware in research cluster efficiently (data pipeline design, leveraging libraries such as GPUDirect & DALI).
  • Evaluate and Roll Out Tooling
    • Evaluate third-party tooling (e.g. MLflow; Neptune; Ray; ...).
  • Contribute to Open-Source Tools
    • Dig into the internals of open-source ML tools to extend their capabilities and fix fundamental bugs.
  • Scheduling and Resource Management
    • Leverage experience in scheduling tools (k8s, slurm etc) to support the effective use of contested resource across a broad research team.

Requirements

  • MS degree in CS or similar fields or equivalent experience.
  • 3+ years of relevant work experience.
  • Experience in fundamental ML frameworks like Pytorch and Tensorflow.
  • Experienced in Python, experience in C++ is highly desired.


  • Sydney, New South Wales, Australia Atlassian Full time

    Job SummaryWe are seeking a highly skilled Senior Machine Learning Infrastructure Engineer to join our Central AI team at Atlassian. As a key member of our team, you will be responsible for building and maintaining the core infrastructure to support machine learning engineers and data scientists in developing, training, evaluating, deploying, and operating...


  • Sydney, New South Wales, Australia Atlassian Full time

    About the RoleWe are seeking a highly skilled Senior Machine Learning Engineer to join our Central AI team at Atlassian. As a key member of our team, you will be responsible for building and maintaining the core infrastructure for machine learning engineers and data scientists to develop, train, evaluate, deploy, and operate Machine Learning models and...


  • Sydney, New South Wales, Australia IMC Financial Markets Full time

    Job SummaryWe are seeking a highly skilled Senior Distributed Machine Learning Engineer to join our research team at IMC Financial Markets. As a key member of our team, you will be responsible for developing and supporting libraries for accelerating training on a distributed environment, automating ML workflows, and leveraging GPU hardware in our research...


  • Sydney, New South Wales, Australia IMC Financial Markets Full time

    Job SummaryWe are seeking a highly skilled Machine Learning Engineer to join our research team at IMC Financial Markets. As a Machine Learning Engineer, you will be responsible for developing and supporting libraries for accelerating training on a distributed environment, automating ML workflows, and leveraging GPU hardware in research clusters.Key...


  • Sydney, New South Wales, Australia Atlassian Full time

    About the RoleWe are seeking a highly skilled Principal Machine Learning Systems Engineer to join our Central AI team at Atlassian. As a key member of our organization, you will play a pivotal role in building and maintaining the core infrastructure for machine learning engineers and data scientists to develop, train, evaluate, deploy, and operate Machine...


  • Sydney, New South Wales, Australia IMC Financial Markets Full time

    About the RoleWe are seeking an experienced Senior Distributed Systems Engineer for Machine Learning to join our research team at IMC Financial Markets. As a key member of our team, you will be responsible for developing and supporting libraries for accelerating training on a distributed environment, automating ML workflows, and leveraging experience in...


  • Sydney, New South Wales, Australia IMC Financial Markets Full time

    Job Title: Machine Learning EngineerWe are seeking a highly skilled Machine Learning Engineer to join our research team at IMC Financial Markets. As a Machine Learning Engineer, you will play a key role in developing and supporting libraries for accelerating training on a distributed environment, automating ML workflows, and leveraging GPU hardware in...


  • Sydney, New South Wales, Australia Correlate Resources Full time

    Job Title: Advanced Analytics Expert and Logistics SpecialistAbout Us: Correlate Resources is a trusted Data Analytics Recruitment Partner, connecting talented professionals with exciting opportunities in the industry.The Role: We are seeking a highly skilled Data Scientist and Machine Learning Engineer to join our team. As a key member of our APAC region,...


  • Sydney, New South Wales, Australia IMC Financial Markets Full time

    Job SummaryYou will work as part of an established and growing research team at IMC Financial Markets, helping to develop frameworks that will be used to train large models on a distributed cluster. You'll closely collaborate with researchers, platform and software engineers, and leverage your knowledge of infrastructure and training libraries to accelerate...


  • Sydney, New South Wales, Australia FIS Australia Full time

    About the RoleFIS is seeking an experienced and dynamic MLOps engineer to join our team in Australia. As a key member of our Cloud-Based solution/product development team, you will be responsible for developing and deploying machine learning models on Azure Cloud.Key ResponsibilitiesParticipate in daily scrums to develop machine learning solutions, working...


  • Sydney, New South Wales, Australia H2o Full time

    About This OpportunityH2O.ai is at the forefront of the rapidly evolving MLOps landscape.We're leveraging MLOps to transform machine learning models from isolated, engineer-specific tools into robust, cloud-native services that are scalable and consistently available.Our approach is firmly rooted in Kubernetes, positioning our team at the cutting edge of...


  • Sydney, New South Wales, Australia Talenza Full time

    Role SummaryWe are seeking a skilled Machine Learning Engineer to design, build, and operate Machine Learning solutions using cutting-edge cloud technology.About the RoleAs a Machine Learning Engineer, you will take end-to-end ownership of your product in a modern DevOps culture. Your key responsibilities will include architecture, design, development,...


  • Sydney, New South Wales, Australia Culture Amp Full time

    About the RoleCulture Amp is seeking a highly skilled Senior Machine Learning Engineer to join our Machine Learning Platform team. As a key member of this team, you will be responsible for building and enhancing our machine learning platform powered by AI and Large Language Models (LLMs). We are partnering with Google to leverage their Vertex AI platform,...


  • Sydney, New South Wales, Australia FIS Full time

    About the RoleFIS is seeking an experienced and dynamic MLOps engineer to join our team. As a key member of our Cloud AI team, you will be responsible for developing and deploying machine learning solutions on Azure Cloud.Key ResponsibilitiesParticipate in daily scrums to develop machine learning solutionsWork with business and technical stakeholders to...


  • Sydney, New South Wales, Australia Correlate Resources Full time

    Correlate Resources is seeking a highly skilled Machine Learning and Data Science Specialist to join their team. This exciting opportunity will see you working at the forefront of cutting-edge technology, driving innovation and growth in the Australasian market.About the Role:Design and implement Big Data and Machine Learning platforms, pipelines, and...

  • Data Scientist

    2 days ago


    Sydney, New South Wales, Australia Correlate Resources Full time

    Exclusive Opportunity for Data Science ProfessionalsWe are working with a leading Australian company in the logistics and supply chain industry, offering unparalleled opportunities for career development and growth.About the Role:This is a hands-on position that involves building and deploying machine learning models. The ideal candidate will be a...


  • Sydney, New South Wales, Australia Talenza Full time

    **Machine Learning Innovator**At Talenza, we're looking for a skilled Machine Learning Innovator to join our team. As a key player in our Machine Learning department, you'll be responsible for designing, building, and operating Machine Learning solutions using cutting-edge cloud technology. Your expertise in data science and machine learning capabilities...

  • Data Scientist

    3 weeks ago


    Sydney, New South Wales, Australia Correlate Resources Full time

    CORRELATE RESOURCES : Your trusted Data Analytics Recruitment Partner. APPLY NOW for exclusive opportunities, market insights & ongoing career support DATA SCIENCE & AI: Machine Learning & Advanced Modelling Solutions DIVERSE SCOPE OF USE CASES within logistics and supply chain domain Permanent Position - Remote working flexibility The ClientOur client is...


  • Sydney, New South Wales, Australia Culture Amp Full time

    About Culture AmpCulture Amp is the world's leading employee experience platform, revolutionizing how companies create a better world of work. Our mission is to empower organizations to transform employee engagement, drive performance management, and develop high-performing teams.Job DescriptionWe're seeking a Staff Machine Learning Engineer to accelerate...


  • Sydney, New South Wales, Australia Luxury Escapes Full time

    About the RoleLuxury Escapes is seeking a highly skilled Senior Machine Learning Engineer to join our team. As a key member of our Recommendations Engine team, you will play a crucial role in developing and implementing cutting-edge machine learning solutions to solve complex business problems.ResponsibilitiesDesign, build, and deploy machine learning models...