AI Content Reviewer (Remote)

About the role

We are looking for a meticulous AI Content Reviewer to evaluate and improve AI‑generated outputs across text, image descriptions, and code. The role is fully remote, allowing you to work with a global team while ensuring content meets accuracy, safety, and brand standards.

Key responsibilities

• Review AI‑generated text, image captions, and code for relevance, toxicity, bias, and factual correctness.
• Create high‑quality training datasets by labeling data according to strict guidelines.
• Audit junior reviewers or automated systems to guarantee consistency with project rubrics.
• Collaborate with operations to refine style guides and annotation instructions.
• Identify recurring model errors and provide detailed feedback to data scientists and engineers.
• Monitor metrics such as Inter‑Agreement Rates and F1 scores to assess review impact.

Required profile

• Minimum 2 years of experience in content review, moderation, fact‑checking, or quality assurance within tech or digital media.
• Proven ability to analyze complex information quickly and justify decisions under ambiguous guidelines.
• Comfort handling potentially sensitive or disturbing content with professionalism.
• Experience with generative AI models (e.g., ChatGPT, Bard, Midjourney) from a testing or feedback perspective.
• Background in linguistics, data annotation, or computational linguistics.
• Adaptability to fast‑paced, evolving environments.

Required skills

• Generative AI models (ChatGPT, Bard, Midjourney)
• Data annotation tools
• Spreadsheets
• Inter‑Agreement Rate metrics
• F1‑score evaluation