Baseball Expert - AI Evaluator

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Baseball Fan – Live MLB Game AI Evaluator (US)
Type: Contract
Compensation: $100–$120 per task
Location: Remote
Commitment: Event-based

Role Responsibilities

• Follow live MLB postseason games and ask AI assistants real fan questions about live scores, win probability, player and team stats, rules, challenges, schedules, broadcasts, highlights, and expert-style analysis.
• Run the same question on two AI products side by side, either as a single question or in a multi-turn conversation of 2 to 10 turns.
• Capture share links and full screenshots of every conversation.
• Rate each response for helpfulness, factual accuracy, and presentation. Choose which product performed better and write a clear rationale for your choice.
• Work independently and asynchronously during game windows on scheduled game days.

Qualifications

Must-Have

• Based in the United States.
• 1+ year of professional work experience.
• Solid baseball knowledge: rules, teams, players, and postseason structure.
• Comfortable using AI chat assistants and web search.
• Strong written English and sharp attention to detail.

Preferred

• Being an avid MLB fan or a general sports enthusiast.
• Prior AI rating or evaluation experience.

Start Date

• As early as Saturday, October 3

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: [email protected]

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.