Job ID: 260419
Position: AI Model Evaluator – Finance & Accounting (Remote, Contract)
Compensation:
Mercor is partnering with a leading AI lab to hire experienced finance and accounting professionals to evaluate AI-generated content.
This role focuses on improving the accuracy, safety, and reliability of AI systems used in high-stakes financial environments—where incorrect information can have serious consequences.
What You’ll Do
- Create realistic prompts based on real-world finance/accounting scenarios
- Evaluate AI-generated responses for:
- Accuracy and correctness
- Regulatory compliance
- Practical usefulness
- Detect fabricated claims, incorrect references, and flawed reasoning
- Score and rank responses using structured evaluation rubrics
- Provide clear, evidence-based written feedback
Ideal Qualifications
- Master’s degree or higher in **Finance, Accounting, or related field**
- Professional experience in **accounting, finance, audit, or advisory roles**
- Strong knowledge of **financial regulations, standards, or frameworks**
- Excellent analytical thinking and written communication skills
Work Setup
- ~20 hours per week
- Fully remote – flexible schedule
- Project-based (extensions possible based on performance)
Application Process
- Submit your resume
- Complete a Model Response Evaluation Assessment
Additional Details
- Independent contractor role
- No confidential or proprietary data access required
- Open to global applicants *(excluding H1-B / STEM OPT candidates)*
- Equal opportunity engagement with accommodations available
About Mercor
Mercor partners with leading AI labs to train and improve next-generation AI systems using real human expertise.
You’ll be contributing directly to cutting-edge AI development alongside top researchers.
.png)