Ai Session Reviewer
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include
Benchmark ,
General Catalyst ,
Peter Thiel ,
Adam D'Angelo ,
Larry Summers , and
Jack Dorsey . Position:
AI Session Annotator (English) Type:
Contract Compensation:
$24–$30/hour Location:
Remote Role Responsibilities
Review recorded sessions where users interact with an AI assistant via voice and camera. Compare the assistant's responses to visible video content. Identify hallucinated or fabricated visual details. Score sessions on visual interpretation, accuracy, relevance, response timing, and spatial language use. Evaluate if the assistant appropriately warned users about health, safety, or financial risks. Write detailed comments supporting scores with concrete session evidence. Capture conversation turns in the intake form. Qualifications
Must-Have
Native or native-level
English , spoken and written. Clear, precise written English. An Android phone with a working camera and microphone . Attention to detail and consistent rubric application. Preferred
Experience in data annotation, linguistic QA, content moderation, or AI model evaluation. Training in linguistics, translation, or interpreting. Ability to recognize unnatural or non-native English. Start Date
Immediate ; high volume of work expected between
26 to 31 Aug .
-
Remote AI Session Annotator
2 days ago
Newcastle, New South Wales, Australia Mercor Full-timeMercor is seeking an AI Session Annotator (English) to work remotely. You will review recorded sessions where users interact with an AI assistant via voice and camera, and assess alignment with visible video content. You will score sessions on visual interpretation, accuracy, relevance, response timing, and the use of spatial language, capturing evidence in...
-
AI Content Reviewer — Remote
3 weeks ago
newcastle, new south wales, Australia HireFast Full-timeA leading workforce solutions provider in Australia is seeking a Remote Paralegal to support various evaluation tasks related to content and AI. This flexible position allows you to work independently while reviewing written material, analyzing responses, and enhancing AI-generated output's quality. Ideal candidates will exhibit strong written communication,...
-
Newcastle, New South Wales, Australia Mercor Full-timeMercor is seeking a Manufacturing Operations Reviewer for a remote contract role. You will evaluate AI-generated manufacturing content, review AI grader assessments, and assess the defensibility of AI scores. Collaboration with AI research teams will refine grading criteria to improve model performance. The workload requires independent, asynchronous work...
-
Remote AI Code Reviewer
3 days ago
Newcastle, New South Wales, Australia Planet Pharma Full-timePlanet Pharma is looking for an experienced software engineer to assess AI-generated code, review bug fixes, refactors, and technical solutions, and help design realistic engineering challenges. You will create tasks based on real-world scenarios, compare outputs, and develop test cases, evaluation rubrics, and quality standards. This role supports remote...
-
SDR: AI-Driven Outreach
3 days ago
Newcastle, New South Wales, Australia Scale-Up Philippines Full-timeScale Up Philippines is seeking an experienced Sales Development Representative to join a growing Australian sales consultancy. You’ll be the first point of contact for potential clients, generate and qualify opportunities, and book meetings for the sales team. Collaborate with a seasoned sales leader, use AI-enabled outreach, and leverage CRM tools. The...
-
Remote Legal Expert for AI Systems Review
4 days ago
Newcastle, New South Wales, Australia HumanitApp Full-timeMercor is seeking a Legal Expert for ongoing review projects. This remote, hourly contract role invites qualified lawyers who can assess real questions of law across jurisdictions. The opportunity emphasizes flexible scheduling and ongoing engagement with varied AI-related projects. Review workload and payment terms during the official application process;...
-
Remote Junior Lawyer
2 days ago
Newcastle, New South Wales, Australia HumanitApp Full-timeHumanitApp seeks contributors to review and annotate legal documents for AI training, focusing on U.S. standards and Bluebook format. You will edit writing samples, provide feedback on arguments, and summarize complex concepts for machine understanding. Role is remote and contractor-based. Prior law school and editorial experience preferred, with strong...
-
Remote Medical Device Software Reviewer
3 days ago
Newcastle, New South Wales, Australia Jobgether Full-timeJobgether on behalf of a partner company is seeking a Product Reviewer – Contractor based in Australia. You will independently assess medical device software, SaMD, and AI-enabled solutions, ensuring regulatory, technical and safety requirements are met across lifecycle documentation. Responsibilities include evaluating compliance with EU MDR, UK MDR, IEC...
-
Remote AI Evaluator: Live Chats
4 days ago
Newcastle, New South Wales, Australia Outlier Full-timeOutlier is seeking detail‑oriented English speakers to review AI‑generated media on a fully remote basis. You will roleplay live conversations with AI voice models, compare image and video outputs, and explain in writing what was off, all on your own schedule. Work from home or while travelling, with flexible hours and weekly payments. You’ll gain free...
-
Newcastle, New South Wales, Australia Alignerr Corp. Full-timeAlignerr is seeking a Cybersecurity Defense Expert to stress-test AI-generated security content, including threat analyses, remediation steps, and defensive configurations. You will assess its real-world applicability and safety across various defense domains.The role is fully remote with flexible hours, offering freelance autonomy on an hourly contract....
