English LLM Evaluator

5 days ago

Australia CrowdGen by Appen Full time $104,000 - $130,878 per year
Join Project Spearmint, a multilingual AI response evaluation project reviewing large language model (LLM) outputs in different languages, focused on either Tone or Fluency. Native-level fluency in a target language, along with strong English comprehension, is required
As an evaluator, you will review short, pre-segmented datasets and assess model-generated replies based on specific quality dimensions. Your input will help validate evaluation frameworks and establish baseline quality metrics for future model development
Key Responsibilities: Evaluate model replies in your native language based on either Tone or Fluency Assess the overall quality, correctness, and naturalness of responses Read the user prompt and two model replies, then rate each using a five-point scale Provide brief rationales for any extreme ratings
Project Breakdown:
Batch 1 – Tone: Determine whether replies are helpful, insightful, engaging, and fair. Flag formality mismatches, condescension, bias, or other tonal issues
Batch 2 – Fluency: Assess grammatical accuracy, clarity, coherence, and natural flow

This is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account, reset your password, complete the setup requirements, and proceed with your application for this role
Make an impact on the future of AI – apply today and contribute from the comfort of your home.

  • Audio Evaluator — Native English

    5 days ago

    Australia CrowdGen by Appen Full time $32,000 per year

    Join CrowdGen and play a key role in AI development Assess the relevance of social media contents by evaluating their audio clips. Your insights will help determine the relevance and quality of these clips, playing a vital role in refining intelligent systems. Job Overview: Participants for this project will assess the quality of audio outputs from our...

  • Marketing - Audio/podcast professionals for AI Training - US English

    5 days ago

    Australia e2f, inc. Full time US$40,000 - US$80,000 per year

    About us:e2f provides Human Intelligence for Smarter AI with a 24×7 global model. Supporting leading LLM and AI app builders, our experts deliver high-quality training, fine-tuning, evaluation, benchmarking and monitoring data services to optimize AI outputs. e2f is proud to be listed as one of Forbes' Top 30 Best Companies for Remote Jobs,...

  • Artificial Intelligence Specialist

    2 days ago

    Australia beBeeAi Full time $150,000 - $200,000

    Leading the Future of Artificial IntelligenceWe are seeking an Ai Engineer / Prompter to spearhead the development of innovative Ai-powered solutions tailored for Japanese-speaking users. This pivotal role focuses on enhancing search, content generation, and user experience by integrating cutting-edge generative Ai technologies.About the RoleDevelop...

  • English Educator

    2 days ago

    Australia beBeeEducation Full time $90,000 - $120,000

    Teaching Opportunity">We are seeking an experienced and passionate educator to join our teaching team. The successful candidate will be responsible for delivering English lessons to students in Years 7-10.">About the Role:">">Deliver high-quality English lessons to students in Years 7-10">Develop and implement engaging lesson plans that cater to diverse...

  • Middle School English Educator

    2 days ago

    Australia beBeeCareer Full time $102,938 - $123,456

    Teaching OpportunityWe are seeking a qualified Middle School English Teacher to join our team. The successful candidate will be responsible for teaching English language arts to students in middle school.ResponsibilitiesInstruct students in English language arts through lecturing, demonstrating, and using various teaching aids.Prepare course objectives and...

  • Freelance Chemistry Specialist

    2 days ago

    Australia beBeeChemistry Full time $90,000 - $120,000

    Chemistry Freelance ExpertAbout the Role:As a freelance chemistry specialist, you will have the opportunity to work remotely on various projects, collaborating with AI developers from leading tech companies. The Mindrift platform enables you to tap into real-world expertise and unlock the potential of Generative AI.Key Responsibilities:Develop high-quality...

  • Senior Software Engineer

    2 days ago

    Australia Binance Full time

    Role OverviewThis role is pivotal in scaling our AI-driven Customer Service (CS) chat analysis. The specialist will manage data processing pipelines, optimize large language model (LLM) prompts, and collaborate closely with the existing project lead and cross-functional teams. The ultimate goal is to help expand classification coverage, drive bot adoption,...

  • Freelance Chemistry

    2 days ago

    Australia Mindrift Full time

    OverviewFreelance Chemistry - Quality Assurance (AI Trainer)This opportunity is remote and requires residency in the specified country. The Mindrift platform connects specialists with AI projects from major tech innovators to unlock the potential of Generative AI by tapping into real-world expertise.ResponsibilitiesContent Creation & Refinement: Create and...

  • Artificial Intelligence Engineer

    5 days ago

    Australia Attalis Capital Full time $90,000 - $120,000 per year

    Attalis Capital (Australian private equity business) is building a portfolio of AI-powered automation agents to streamline investor engagement, research, hiring, and operations. We're looking for a sharp, resourceful engineer who can turn high-quality specs into clean, production-grade workflows using n8n, OpenAI, Slack, and modern APIs. This role is...

  • Teaching Professional

    2 days ago

    Australia beBeeTeacher Full time $105,000 - $135,000

    English & HSIE Teacher RoleJoin a diverse organisation committed to transforming lives through faith-based education.">We are seeking an English and Humanities Integrated Studies (HSIE) teacher who can contribute to the educational journey of our students. As an integral member of our faculty, you will play a key role in delivering high-quality learning...