Back to Jobs

[Remote] Remote AI Writing Evaluator

Remote, USA Full-time Posted 2025-11-24

Note: The job is a remote job and is open to candidates in USA. Outlier, a platform owned by Scale AI, is seeking English speakers to assist in training and refining AI systems. The role involves evaluating AI outputs and producing relevant data while contributing across various projects based on individual skillsets.


Responsibilities

  • Adopt a “user mindset” to produce natural data to meet the realistic needs you have or would use AI for
  • Evaluate AI outputs by reviewing and ranking responses from large language models
  • Contribute across projects depending on your specific skillset and experience

Skills

  • English speakers
  • Analytical and Problem-Solving Skills: Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning
  • Strong Writing: Clear, concise, and engaging writing to explain decisions or critique responses
  • Attention to Detail: Commitment to accuracy and ability to assess technical aspects of model outputs
  • Experience in fields like literature, creative writing, history, philosophy, theology, etc
  • Prior writing or editorial experience (content strategist, technical writer, editor, etc.)
  • Interest or background in AI, machine learning, or creative tech tools

Benefits

  • Bonuses: Additional pay available based on project performance.
  • Flexible hours — you choose when and how much to work.
  • Payouts: Weekly via our secure platform.

Company Overview

  • Owned by Scale AI (invested in by Amazon and Meta), Outlier is the world's largest platform that connect real-world experts and grads with AI training projects in Law, Computer Science, Web Development, Math, Science, Languages, and more. It was founded in 2023, and is headquartered in San Francisco, US, with a workforce of 10001+ employees. Its website is https://outlier.ai/.

  •   Apply To This Job

    Similar Jobs

    Enterprise Customer Success Manager - NY

    Remote, USA Full-time

    [Remote] React Developer - Trading Technology FinTech (Remote-Friendly)

    Remote, USA Full-time

    Retention Marketing Strategist (Ecommerce + Klaviyo | Remote)

    Remote, USA Full-time

    IP Admin Senior Analyst (Patent Paralegal)

    Remote, USA Full-time

    Enterprise Implementation Specialist

    Remote, USA Full-time

    Credit Risk Analyst

    Remote, USA Full-time

    Facebook / Tiktok Senior Media Buyer – RSOC Search Arbitrage Specialist

    Remote, USA Full-time

    Temporary Paid Social Manager [Remote]

    Remote, USA Full-time

    Senior Accountant - downtown Miami hybrid

    Remote, USA Full-time

    REMOTE POSITION / CLAIMS PROCESSOR

    Remote, USA Full-time

    Assistant Manager in Huntersville, NC

    Remote, USA Full-time

    Expert n8n AI-Automation Specialist for Long-Term, Per-Task Projects (OpenAI, Meta API, TikTok) - Contract to Hire

    Remote, USA Full-time

    Host Cook in Miami Beach, FL

    Remote, USA Full-time

    OPERATIONS ASSISTANT MANAGER in Jonesboro, LA

    Remote, USA Full-time

    Experienced Data Entry Customer Care Professional – Remote Opportunity for Delivering Exceptional Customer Experiences and Data Management at blithequark

    Remote, USA Full-time

    GARAGE - Team Leader PT - Coolsprings Galleria in Franklin, TN

    Remote, USA Full-time

    ASST STORE MGR in WEST POINT, IA S20028 in West Point, IA

    Remote, USA Full-time

    Account Executive, Growth in Chicago, IL

    Remote, USA Full-time

    AI Solution Architect, Agentforce Supply Chain 7 Locations

    Remote, USA Full-time

    Maintenance Technician in Canandaigua, NY

    Remote, USA Full-time