Job ID: 260422
Position: Rubrics Writer / Auditor (AI Content Evaluation) – Remote
- Job Type: Hourly Contract
- Location: Remote (Global)
- Compensation: $25–$45 per hour
Role Overview
Mercor is partnering with a leading AI research lab to recruit Rubrics Writers / Auditors for a short-term, project-based initiative. This role focuses on enhancing AI assistants’ ability to generate and evaluate high-quality conversational content.
As a contributor, you will apply structured evaluation frameworks to assess AI-generated outputs, refine scoring rubrics, and help improve model performance. This opportunity is ideal for detail-oriented writers interested in shaping how AI systems interpret quality, nuance, and human-level judgment.
Key Responsibilities
- Evaluate AI-generated conversations using predefined rubric frameworks
- Develop and refine rubrics for general writing and conversational tasks
- Apply structured scoring criteria to assess clarity, coherence, accuracy, and tone
- Analyze edge cases and ambiguous outputs to ensure consistency in evaluation standards
- Provide clear, actionable feedback to support AI model improvement
Required Qualifications
- Experience in rubric-based evaluation, editing, or content review
- Strong generalist writing skills across multiple domains (e.g., business, academic, creative)
- Excellent attention to detail and ability to apply guidelines consistently
- Strong analytical thinking and sound judgment in ambiguous scenarios
- Proficiency in written English
Preferred Qualifications
- Background in English, Journalism, Communications, or related fields
- Prior experience in AI training, evaluation, or content moderation
- Familiarity with structured scoring systems or quality assurance processes
Compensation & Benefits
- Competitive hourly rate: $25–$45/hour (based on experience and location)
- Flexible, fully remote work environment
- Opportunity to take on lead reviewer or expanded responsibilities
- Work directly on cutting-edge AI development projects
Contract & Payment Terms
- Engagement type: Independent contractor
- Fully remote with flexible scheduling
- Project duration may vary based on performance and business needs
- Weekly payments via Stripe or Wise
- No access to confidential or proprietary third-party information required
- Note: Visa sponsorship (e.g., H1-B, STEM OPT) is not available for this role
Application Process
- Submit your resume and/or writing sample to apply
- Qualified candidates will be contacted within a few days for next steps
Equal Opportunity Statement
Mercor is an equal opportunity employer. We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
About Mercor
Mercor partners with leading AI labs and enterprises to train and improve frontier AI models using human expertise. By joining Mercor, you will collaborate with top researchers, contribute to advanced AI systems, and play a key role in shaping the future of artificial intelligence.
