1\. Role Overview
Mercor is partnering with a leading AI research organization to engage experienced management consultants for a project focused on evaluating how well AI systems perform real-world consulting work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.
2\. Key Responsibilities
- Design precise, task-specific grading criteria for real-world consulting deliverables (market analyses, strategy recommendations, financial models, client-ready slide decks, and implementation roadmaps)
- Score AI-generated and human work samples against those criteria, with detailed written justifications for every score
- Apply consistent, evidence-based judgment so that scores are reproducible and defensible
- Incorporate structured feedback from senior reviewers and iterate quickly on your work
3\. Ideal Qualifications
- 5+ years of professional management consulting experience
- Background at a top-tier strategy or management consulting firm (e.g., McKinsey, Bain, BCG, or equivalent)
- Deep fluency in structured problem solving, market sizing, financial modeling and business-case building, and slide-based executive communication
- Exceptionally strong written communication
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers
- Prior experience with AI training, evaluation, or human-data projects is a strong plus
4\. Application Process
- Submit your resume or relevant professional background to get started
- Qualified applicants may be asked to complete a brief assessment or submit additional information
Rate: $150.0-$220.0 USD/hourly
Commitment: hourly
Domain: Business Operations
Referral Bonus: $880.0
Hours/week: 40
Open slots: 33
Note: This is a third party job (Aggregated by careeruplift.ai). Shortlisting and Final hiring decision & process is handled by the company.