Senior AI Model Evaluator

1 week ago


Sydney, New South Wales, Australia beBeeContent Full time $150,000 - $200,000
About the Role

The team responsible for developing content safety policies and strategies is looking for a professional with expertise in AI model evaluations, content moderation, and risk management.

Responsibilities:

  • Bulletin: Build platforms to support pre-launch and post-launch evaluations of AI models, online content safety moderation, root cause analysis for key metrics, and strategy iteration and recommendations.
  • Common Solutions: Provide common content safety solutions for User Profile, Search, Comment, Chat & Messaging, Push Message, and manage risk leakage and business impact by overkills.
  • Safety Planning: Deeply understand safety commonalities & differences, and content safety policies of emerging products, to design planning of general capabilities and roadmap, includes feature safety, metric systems, assessment platform and systematic development design;

Maintain up-to-date knowledge on industry trends and best practices in content moderation and safety, identify problems and opportunities with quantitative and qualitative analysis to continuously improve content safety measures.

Collaborate with stakeholders to secure necessary resources, and support rapid business development.


  • Senior AI Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Relevance AI Full time

    OverviewSenior AI Engineer role at Relevance AI, Sydney, Australia (Hybrid - 3 Days In Office).About UsAt Relevance AI, our mission is to empower anyone to delegate work to the AI workforce. We're building a new type of automation platform for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration. We're...

  • Senior AI Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Relevance AI Full time

    OverviewSenior AI Engineer role at Relevance AI, Sydney, Australia (Hybrid - 3 Days In Office).About UsAt Relevance AI, our mission is to empower anyone to delegate work to the AI workforce. We're building a new type of automation platform for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration. We're...


  • Sydney, New South Wales, Australia beBeebiology Full time US$40

    Clinical Researcher Job DescriptionThis role involves training AI models to improve their performance and logic. As a Clinical Researcher, you will be responsible for evaluating the progress of these models and identifying areas for improvement.


  • Sydney, New South Wales, Australia beBeeGeography Full time $60,000 - $120,000

    Shape the Future of AI in GeographyA unique opportunity awaits geography experts to contribute to the advancements of Artificial Intelligence by generating prompts, defining scoring criteria, and correcting model responses using their domain knowledge.As a geography specialist, you will have the chance to influence future AI models in your field. Your...


  • Sydney, New South Wales, Australia V2 AI Full time

    2 days ago Be among the first 25 applicants V2 AI is a leading Data & AI consultancy backed by $30m in VC funding, allowing us to meet our customers' needs.We harness the power of Data & AI to accelerate business outcomes for some of the world's largest brands.We bring decades of experience and a unique delivery model to partner with our customers on the...

  • AI Model Developer

    1 week ago


    Sydney, New South Wales, Australia beBeeMachine Full time $150,000 - $210,000

    Expert Machine Learning Engineer">">As a leading innovator in artificial intelligence, we are seeking a skilled Machine Learning Expert to spearhead the development of cutting-edge AI models and algorithms. The ideal candidate will possess a strong foundation in machine learning, computer science, and data analysis.">">About the Role">The successful...


  • Sydney, New South Wales, Australia beBeeResearch Full time $150,000 - $180,000

    AI Model Development SpecialistWe're seeking a highly skilled AI model developer to design and build sophisticated AI agents that can assess the quality and human alignment of generative design models.This role focuses on creating practical systems that make cutting-edge research effective, providing a rapid feedback loop to guide the future of design...


  • Sydney, New South Wales, Australia beBeeResearch Full time $150,000 - $180,000

    Job DescriptionDevelop a next-generation evaluation system by leveraging automatic evaluations.The ideal candidate will engineer sophisticated AI agents that can automatically assess the quality and human alignment of generative design models. This high-impact role focuses on building the practical systems that make cutting-edge research effective, to...


  • Sydney, New South Wales, Australia beBeeAI Full time $180,000 - $200,000

    Expert AI ResearcherWe are seeking a highly skilled and experienced Expert AI Researcher to join our team. As an integral part of our research and development efforts, you will contribute to the advancement of cutting-edge AI technologies.Job Description:You will be responsible for designing, implementing, and evaluating advanced AI models and algorithms to...


  • Sydney, New South Wales, Australia Westpac Full time

    **Permanent opportunity**:- **Hybrid working, currently 2-3 days in Sydney office location**:- **Lead dynamic, independent evaluations of cutting-edge AI models, shaping the future of innovation and excellence at Westpac Group****How will I help?**Reporting to our Executive Manager, Governance & Prescriptive Analytics, your role as a Manager, AI models,...