Industry Phd Scholarship: Continual Learning and

2 weeks ago


Sydney, Australia Leonardo.Ai Full time

**Continual Learning and Deliberate Forgetting in Petascale Generative AI training**:
**Description**:
The Data Science Institute (DSI) at the University of Technology Sydney (UTS) is a world leader in data science and ethical artificial intelligence and has a strong focus on Industry engagement. The DSI boasts over 200 PhD students and 100 academic staff with award winning researchers in AI

In collaboration with Leonardo.Ai we are advertising an industry PhD program that will tackle research questions at the bleeding edge of GenAI research with an aim to drive forward both foundational research in the field through traditional publication outputs, as well as supercharging the Leonardo.Ai platform. Leonardo.Ai is a world leader in generative AI and is building one of the leading AI laboratories in foundational AI research. Leonardo.Ai has also recently been acquired by Canva and now hosts over 200 million users through the combined platforms. Both Leonardo.Ai and Canva have strong principles in: being a good human being foremost, maximizing impact, moving at speed and owning our goals and winning together.

**Project Aims**

This PhD project aims to improve the capacity of neural networks to continue to learn new things without loss of performance on previously learned tasks. Additionally, it will be explored both how to prevent and induce model forgetting such that concepts can be removed from models. The student will explore RAG, optimization theory, and finetuning methods among other areas of study. The student will work with petascale training environments to conduct large-scale experiments.

PhD research students will have access to leading edge compute facilities (e.g. H100s), a team of world class research leaders across both UTS, Leonardo and Canva, cutting edge datasets to conduct research, and mentoring and guidance to complete a best-in-class PhD research program.

**Eligibility**

We are looking for the best of the best You will be adequately qualified to enter the UTS PhD scheme with Undergraduate / Postgraduate Qualifications in e.g. Computer Science, Data Science, AI, Physics, Mathematics or equivalent.
- A strong background in programming, mathematics, statistics or related areas.
- Knowledge and interest in Diffusion, GANs, LLMs and generative AI in general as demonstrated by independent project work in GitHub.
- Proficiency in modern deep learning frameworks such as Pytorch or Jax.
- Proficiency in English (both Verbal and Written).

**Location**

This PhD will be hosted at the University of Technology Sydney and the student will spend significant time at the Leonardo.Ai headquarters, which is located on the waterfront in North Sydney (20 mins train ride from UTS).

**Full Domestic Scholarship**: Open to Australian citizens who will receive a full scholarship of $37k per year stipend + $10k per year top-up for 3.5 years.

**Full International Scholarship**: Open to all international applicants with $37k per year stipend, $45k per year international fees and $30k per year top-up for 3.5 years. Student visas will be provided by UTS.



  • Sydney, Australia Leonardo.Ai Full time

    **Safety and Bias in Generative AI**: **Description**: The Data Science Institute (DSI) at the University of Technology Sydney (UTS) is a world leader in data science and ethical artificial intelligence and has a strong focus on Industry engagement. The UTS Data Science Institute DSI boasts over 200 PhD students and 100 academic staff with award winning...


  • Sydney, Australia Leonardo.Ai Full time

    **Efficient Architectural Designs for Generative AI models**: **Description**: The Data Science Institute (DSI) at the University of Technology Sydney (UTS) is a world leader in data science and ethical artificial intelligence and has a strong focus on Industry engagement. The DSI boasts over 200 PhD students and 100 academic staff with award winning...


  • Sydney, Australia Leonardo.Ai Full time

    **Generative Models in the Fourier Domain**: **Description**: The Data Science Institute (DSI) at the University of Technology Sydney (UTS) is a world leader in data science and ethical artificial intelligence and has a strong focus on Industry engagement. The DSI boasts over 200 PhD students and 100 academic staff with award winning researchers in AI In...

  • Investment Executive

    6 months ago


    Sydney, Australia PHD Full time

    Investment Executive, PHD Why PHD and who are we? PHD is a strategic-led planning and buying media agency, a vital part of the Omnicom Media Group and Australia's fastest growing media network. We continually sets the benchmark by helping some of the world's largest and most influential brands Make the Leap in their media and advertising. Built on a culture...

  • Account Executive

    6 months ago


    Sydney, Australia PHD Full time

    Account Executive, PHD Why PHD and who are we? PHD is a strategic-led planning and buying media agency, a vital part of the Omnicom Media Group and Australia's fastest growing media network. We continually sets the benchmark by helping some of the world's largest and most influential brands Make the Leap in their media and advertising. Built on a culture of...

  • Strategy Director

    7 months ago


    Sydney, Australia PHD Full time

    Strategy Director, PHD  Why PHD and who are we? PHD is a strategic-led planning and buying media agency, a vital part of the Omnicom Media Group and Australia's fastest growing media network. We continually sets the benchmark by helping some of the world's largest and most influential brands Make the Leap in their media and advertising. Built on a...


  • Sydney, New South Wales, Australia PHD Full time

    About PHDAt PHD, we're a strategic-led planning and buying media agency that's part of the Omnicom Media Group. We're known for helping some of the world's largest brands achieve growth in their media and advertising.We invest heavily in our people and culture, creating a unique and collaborative working environment that inspires creativity and innovation....

  • Planning Director

    7 months ago


    Sydney, Australia PHD Full time

    Planning Director, PHD Why PHD and who are we? PHD is a strategic-led planning and buying media agency, a vital part of the Omnicom Media Group and Australia's fastest growing media network. We continually sets the benchmark by helping some of the world's largest and most influential brands Make the Leap in their media and advertising. Built on a...

  • Planning Executive

    6 months ago


    Sydney, Australia PHD Full time

    Planning Executive, PHD Why PHD and who are we? PHD is a strategic-led planning and buying media agency, a vital part of the Omnicom Media Group and Australia's fastest growing media network. We continually sets the benchmark by helping some of the world's largest and most influential brands Make the Leap in their media and advertising. Built on a culture of...

  • Digital Executive

    6 months ago


    Sydney, Australia PHD Full time

    Digital Executive, PHD Why PHD and who are we? PHD is a strategic-led planning and buying media agency, a vital part of the Omnicom Media Group and Australia's fastest growing media network. We continually sets the benchmark by helping some of the world's largest and most influential brands Make the Leap in their media and advertising. Built on a culture of...


  • Sydney, Australia PHD Full time

    Digital Manager, PHD Why PHD and who are we? PHD is a strategic-led planning and buying media agency, a vital part of the Omnicom Media Group and Australia's fastest growing media network. We continually sets the benchmark by helping some of the world's largest and most influential brands Make the Leap in their media and advertising. Built on a culture of...

  • Digital Manager

    6 months ago


    Sydney, Australia PHD Full time

    Digital Manager, PHD Why PHD and who are we? PHD is a strategic-led planning and buying media agency, a vital part of the Omnicom Media Group and Australia's fastest growing media network. We continually sets the benchmark by helping some of the world's largest and most influential brands Make the Leap in their media and advertising. Built on a culture of...


  • Sydney, New South Wales, Australia PHD Full time

    About PHD">PHD is a strategic-led planning and buying media agency, part of the Omnicom Media Group and Australia's fastest growing media network.">Our Purpose">We help some of the world's largest and most influential brands make the leap in their media and advertising. We invest in our people and culture to generate a unique, energetic, and collaborative...

  • Investment Manager

    6 months ago


    Sydney, Australia PHD Full time

    Investment Manager, PHD Why PHD and who are we? PHD is a strategic-led planning and buying media agency, a vital part of the Omnicom Media Group and Australia's fastest growing media network. We continually sets the benchmark by helping some of the world's largest and most influential brands Make the Leap in their media and advertising. Built on a culture of...


  • Sydney, New South Wales, Australia PHD Full time

    Strategy Director Role at PHDWe are seeking an experienced Strategy Director to join our team at PHD, a strategic-led planning and buying media agency.About PHD:PHD is part of the Omnicom Media Group and Australia's fastest growing media network. We focus on delivering innovative media solutions that drive business growth for our clients.Job Description:Lead...


  • Sydney, New South Wales, Australia PHD Full time

    Strategy Director Role at PHDWe are seeking an experienced Marketing Strategy Director to join our team at PHD. As a key member of our leadership group, you will lead channel-agnostic strategies for some of the world's most recognized brands.About PHDPHD is a strategic-led planning and buying media agency, part of the Omnicom Media Group and Australia's...

  • Planning Manager

    6 months ago


    Sydney, Australia PHD Full time

    Planning Manager, PHD Why PHD and who are we? PHD is a strategic-led planning and buying media agency, a vital part of the Omnicom Media Group and Australia's fastest growing media network. We continually sets the benchmark by helping some of the world's largest and most influential brands Make the Leap in their media and advertising. Built on a culture of...

  • Media Planning Manager

    6 months ago


    Sydney, Australia PHD Full time

    Planning Manager, PHD Why PHD and who are we? PHD is a strategic-led planning and buying media agency, a vital part of the Omnicom Media Group and Australia's fastest growing media network. We continually sets the benchmark by helping some of the world's largest and most influential brands Make the Leap in their media and advertising. Built on a culture of...

  • Planning Manager

    3 days ago


    Sydney, Australia PHD Full time

    **Planning Manager, PHD** **Why PHD and who are we?** PHD is a strategic-led planning and buying media agency, a vital part of the Omnicom Media Group and Australia's fastest growing media network. We continually sets the benchmark by helping some of the world's largest and most influential brands Make the Leap in their media and advertising. Built on a...


  • Sydney, New South Wales, Australia PHD Full time

    Company OverviewAt PHD, we pride ourselves on being a strategic-led planning and buying media agency. As a vital part of the Omnicom Media Group, we're Australia's fastest growing media network. We continually set the benchmark by helping some of the world's largest and most influential brands 'Make the Leap' in their media and advertising.Career Growth and...