English LLM Evaluator
1 week ago
As an evaluator, you will review short, pre-segmented datasets and assess model-generated replies based on specific quality dimensions. Your input will help validate evaluation frameworks and establish baseline quality metrics for future model development
Key Responsibilities: Evaluate model replies in your native language based on either Tone or Fluency Assess the overall quality, correctness, and naturalness of responses Read the user prompt and two model replies, then rate each using a five-point scale Provide brief rationales for any extreme ratings
Project Breakdown:
Batch 1 – Tone: Determine whether replies are helpful, insightful, engaging, and fair. Flag formality mismatches, condescension, bias, or other tonal issues
Batch 2 – Fluency: Assess grammatical accuracy, clarity, coherence, and natural flow
This is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account, reset your password, complete the setup requirements, and proceed with your application for this role
Make an impact on the future of AI – apply today and contribute from the comfort of your home.
-
Australia e2f, inc. Full time $90,000 - $120,000 per yearAbout us:e2f provides Human Intelligence for Smarter AI with a 24×7 global model. Supporting leading LLM and AI app builders, our experts deliver high-quality training, fine-tuning, evaluation, benchmarking and monitoring data services to optimize AI outputs. e2f is proud to be listed as one of Forbes' Top 30 Best Companies for Remote Jobs,...
-
Australia e2f, inc. Full time $90,000 - $120,000 per yearAbout us:e2f provides Human Intelligence for Smarter AI with a 24×7 global model. Supporting leading LLM and AI app builders, our experts deliver high-quality training, fine-tuning, evaluation, benchmarking and monitoring data services to optimize AI outputs. e2f is proud to be listed as one of Forbes' Top 30 Best Companies for Remote Jobs,...
-
Principal Applied Scientist
4 days ago
Australia Oracle Full time $180,000 - $250,000 per yearOracle Health AI (OHAI) is Oracle's center of innovation for applying advanced artificial intelligence to the most critical challenges in healthcare and enterprise. Leveraging Oracle's extensive cloud resources and rich healthcare data assets, our multidisciplinary team of scientists, engineers, and clinicians develops leading-edge AI solutions -- such as...
-
Australia Oracle Full time $120,000 - $200,000 per yearAt Oracle Health and AI (OHAI), we're not just building the future of healthcare applications—we're redefining it. Our diverse team of visionaries and innovators is at the forefront of cutting-edge AI technology, particularly Generative AI, where creativity meets precision. As pioneers in this space, we've consistently delivered industry-leading AI...
-
0.8 English Teacher
5 days ago
Australia State Government of Victoria, Australia Full timeLocation: Barwon South West - Greater Geelong Reference: 1496063 Selection Criteria SC1 Demonstrated knowledge of the relevant curriculum, including the ability to incorporate the teaching of literacy and numeracy skills and trauma informed practice. Demonstrated experience in responding to student learning needs. SC2 Demonstrated experience in planning...
-
Senior Legal Counsel
1 week ago
Australia MAMBU AUSTRALIA PTY LTD Full time $120,000 - $200,000 per yearWho we areJoin the fintech revolution with Mambu, the leading SaaS cloud banking platform. We're on a mission to make banking better for a billion people. Explore exciting career opportunities and help shape the future of financial services. Learn more here.What you'll doIn collaboration the other legal counsels, you will provide legal advice and support to...
-
Freelance Recruitment Consultant
1 week ago
Australia Hyphen Connect Limited Full time $90,000 - $120,000 per yearAbout the role: This exciting position centers on sourcing, assessing, and placing high-caliber candidates to meet client demands. As a Freelance Recruitment Consultant, you'll lead a seamless and efficient recruitment process, applying your expertise and creative methods to identify and evaluate outstanding talent. The ideal candidate has a proven track...
-
Web Developer
1 week ago
Australia DataAnnotation Full time US$40,000 per yearDataAnnotation is committed to creating quality AI. Join our team to help train AI chatbots while gaining the flexibility of remote work and choosing your own schedule. We are looking for a proficient Web Developer to join our team to train our AI chatbots to code. You will work with the chatbots that we are building in order to measure their progress, as...
-
Back End Developer
1 week ago
Australia DataAnnotation Full time $80,000 - $120,000 per yearDataAnnotation is committed to creating quality AI. Join our team to help train AI chatbots while gaining the flexibility of remote work and choosing your own schedule. We are looking for a proficient Back-End Developer to join our team to train our AI chatbots to code. You will work with the chatbots that we are building in order to measure their...
-
Freelance Software Developer
1 week ago
Australia Mindrift Full time $90,000 - $120,000 per yearWhat we doAbout the RoleGenerate prompts that challenge AI. Define comprehensive scoring criteria to evaluate the accuracy of the AI's answers. Correct the model's responses based on your domain-specific knowledge. RequirementsYou have a Master's degree in Software Development, Computer Science, or other related fields. You have at least 3 years of...
