Domain Expert Reviewer – History
Job at a glance
Domain Expert Reviewer – History | Contractor | 8-Week Engagement | Worldwide Remote Turing is seeking a highly qualified History Domain Expert Reviewer to support quality assurance for Large Language Model (LLM) evaluation projects. In this role, you will review and validate domain-specific historical content, assess task accuracy, and provide actionable feedback to uphold rigorous annotation standards.
This is a fully remote contractor engagement requiring 40 hours per week with at least 4 hours of PST overlap. About Turing Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing helps accelerate frontier research with high-quality data, advanced training pipelines, and top AI researchers — and applies that expertise to help enterprises transform AI from proof of concept into measurable business impact.
Key Responsibilities Review and validate domain-specific prompts spanning ancient, medieval, modern, and contemporary history, including civilizations, political history, military history, archaeology, and historiography. Evaluate completed tasks for factual accuracy, reasoning quality, completeness, and compliance with project guidelines. Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations.
Ensure prompts are challenging, relevant, and aligned with project objectives. Provide clear, constructive, and evidence-based feedback to contributors to improve overall task quality. Maintain consistency across reviews by adhering to established quality standards and review guidelines. Escalate ambiguous or complex cases as needed and document review findings thoroughly. Collaborate with project managers and AI teams to continuously refine evaluation quality and review processes.
Minimum Qualifications Master's degree or higher in History, Archaeology, Historical Studies, Political History, World History, or a closely related discipline. Minimum 3 years of professional, research, teaching, or industry experience in the history domain. Prior experience reviewing, evaluating, editing, or quality-checking domain-specific content is preferred. Excellent written English communication and strong analytical skills.
Sharp attention to detail with the ability to identify factual, logical, and contextual errors. Engagement Details Hours: 40 hours per week with at least 4 hours PST overlap Employment Type: Contractor assignment (no medical or paid leave benefits) Duration: 8 weeks