Sports Subject Matter Experts - AI Model Evaluator (US-Remote)
Job Description
We are seeking multiple Sports Subject Matter Experts (SMEs) such as commentators, analysts, journalists, content creators, or ex-players to support the evaluation and development of Large Language Models (LLMs).
The selected individuals will act as domain-specific instructors to help improve model accuracy, contextual understanding, and performance by identifying gaps and providing detailed feedback.
• To Note: This is for an immediate project need. Project is approved for 3-months initially, with possibility to extend based on project/client demands.
• To Note: This is a fixed hourly rate project in USD ($57/hr)
Responsibilities:
• Evaluate LLM Responses: Formulate domain-relevant questions, assess AI-generated outputs, and identify gaps or inaccuracies.
• Provide Structured Feedback: Clearly document findings in a systematic format to support improvement efforts.
• Act as a Teacher to AI: Reinforce correct knowledge and address model misconceptions.
• Collaborate with AI Teams: Translate expert insights into actionable refinements for the AI.
• Maintain Expertise: Stay current on trends, rules, and events within your sport to ensure accurate and up-to-date evaluations.
Requirements:
• Proven domain expertise in at least one of the following sports: Soccer, Cricket, Football, Baseball, Basketball, or Formula 1.
• Strong analytical and critical thinking skills.
• Excellent written communication, particularly for feedback documentation.
• Familiarity with AI/ML is a plus, not a requirement.
• Ability to work independently and collaboratively in a dynamic environment.
Preferred Skills:
• Background in teaching, journalism, research, or professional analysis.
• Experience evaluating complex reasoning and contextual information.
• A curious, detail-oriented mindset with a drive to enhance AI systems.
Apply tot his job
Apply To this Job