Prompt Optimizer

15 hours ago

Melbourne, Victoria, Australia beBeePrompt Full time $180,000 - $250,000

About the Role

">

We're seeking a skilled Prompt Optimizer to join our AI/ML Platform team.

">

This is a hands-on, experimentation-heavy role that involves designing, testing, and optimizing prompts, system messages, and evaluation strategies for our GenAI features.

">

You'll work closely with applied ML teams, product managers, and researchers to ensure Large Language Model (LLM) outputs are accurate, safe, and aligned with product goals.

">
  • Create and refine prompts, system messages, and instructions for various LLM-powered products.">
  • Work with ML engineers to design automated and human-in-the-loop evaluation pipelines for prompt performance, accuracy, and safety.">
  • Run structured experiments to compare prompts, parameter settings, and model variants using A/B testing and offline benchmarks.">
  • Maintain prompt libraries, guidelines, and best practices to accelerate development across teams.">
">

Requirements

">
  • 2-4 years of experience in ML, NLP, or software engineering, with exposure to production-grade AI systems.">
  • Understanding of how prompts, temperature, system instructions, and context windows impact LLM behavior.">
  • Experience designing or running experiments to assess model output quality, accuracy, and safety.">
  • Proficiency in Python, with experience in data analysis, scripting, and working with APIs.">
  • Ability to identify failure cases, debug prompt behavior, and iterate quickly.">
  • Ability to work effectively in cross-functional teams and take feedback constructively.">
">

Benefits

">
  • Full ownership of projects, flexible working hours, professional development funds, and more.">
">

About Us

">

We're committed to making customer experience better. Our tech stack includes Python, AWS, OpenAI, Anthropic, Google, and Llama.

">

  • Prompt Engineer

    4 weeks ago

    Melbourne, Victoria, Australia Planit Full time

    Direct message the job poster from Planit Planit are world leaders in application testing and quality engineering.We provide solutions that support organisations to deliver high quality systems, applications, and IT architecture.Planit is now a proud NRI company and part of a global movement to deliver a sustainable and secure future through better...

  • Prompt Engineer

    1 week ago

    Melbourne, Victoria, Australia Planit Full time

    Direct message the job poster from PlanitPlanit are world leaders in application testing and quality engineering. We provide solutions that support organisations to deliver high quality systems, applications, and IT architecture.Planit is now a proud NRI company and part of a global movement to deliver a sustainable and secure future through better...

  • Prompt Engineer

    19 hours ago

    Melbourne, Victoria, Australia Planit Full time

    Direct message the job poster from PlanitPlanit are world leaders in application testing and quality engineering. We provide solutions that support organisations to deliver high quality systems, applications, and IT architecture.Planit is now a proud NRI company and part of a global movement to deliver a sustainable and secure future through better...

  • AI Prompt Specialist

    2 days ago

    Melbourne, Victoria, Australia beBeePromptEngineer Full time $120,000 - $150,000

    You will play a pivotal role in crafting and refining prompts for diverse applications.In this role, you will collaborate with cross-functional teams to gather insights, develop effective prompts, and integrate data into advanced AI systems.Develop and refine prompts for various applications, ensuring seamless integration with AI systems.Work closely with...

  • AI Prompt Specialist

    3 days ago

    Melbourne, Victoria, Australia beBeeEngineer Full time $120,000 - $180,000

    Artificial Intelligence Engineer PositionWe're looking for a highly skilled Artificial Intelligence Engineer to join our team.The ideal candidate will have experience designing, testing, and optimizing prompts, system messages, and evaluation strategies that power large language models. This role requires strong collaboration with applied AI teams, product...

  • Prompt Engineer/Ml Engineer

    14 hours ago

    Melbourne, Victoria, Australia Buscojobs Full time

    Job DescriptionZendesk's people have one goal in mind : to make Customer Experience better.Our products help more than 125,000 global brands (AirBnb, Uber, JetBrains, Slack, among others) make their billions of customers happy, every day.The AI / ML Platform team is at the forefront of this mission.We build the foundation that powers every AI-driven...

  • Senior Large Language Model Prompt Designer

    4 days ago

    Melbourne, Victoria, Australia beBeePromptEngineer Full time $100,000 - $150,000

    Are you passionate about designing and optimizing prompts for large language models? Do you have a strong background in machine learning engineering and a desire to improve AI output quality?">Job Description">We are seeking a skilled Prompt Engineer at the ML Engineer II level to join our team. As a Prompt Engineer, you will be responsible for designing,...

  • Prompt Engineer/ML Engineer

    4 days ago

    Melbourne, Victoria, Australia Zendesk Full time

    Job DescriptionZendesk's people have one goal in mind: to make Customer Experience better. Our products help more than 125,000 global brands (AirBnb, Uber, JetBrains, Slack, among others) make their billions of customers happy, every day.The AI/ML Platform team is at the forefront of this mission. We build the foundation that powers every AI-driven...

  • Prompt Engineer/ML Engineer

    5 days ago

    Melbourne, Victoria, Australia Zendesk Full time

    Job DescriptionZendesk's people have one goal in mind: to make Customer Experience better. Our products help more than 125,000 global brands (AirBnb, Uber, JetBrains, Slack, among others) make their billions of customers happy, every day.The AI/ML Platform team is at the forefront of this mission. We build the foundation that powers every AI-driven...

  • Prompt Engineer/ML Engineer

    4 days ago

    Melbourne, Victoria, Australia Zendesk Pty Ltd (Australia) Full time

    Zendesk's people have one goal in mind: to make Customer Experience better. Our products help more than 125,000 global brands (AirBnb, Uber, JetBrains, Slack, among others) make their billions of customers happy, every day.The AI/ML Platform team is at the forefront of this mission. We build the foundation that powers every AI-driven experience at Zendesk,...