Job at a glance
Geography Domain Expert Reviewer | Contractor | 8-Week Engagement | Worldwide Remote Turing is seeking a highly qualified Geography Domain Expert Reviewer to support quality assurance for Large Language Model (LLM) evaluation projects. In this role, you will review and validate geography-related prompts and annotations, ensuring factual accuracy, reasoning quality, and adherence to project guidelines.
Your expertise will directly contribute to the reliability and consistency of AI training data. About Turing: Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing specializes in high-quality data, advanced training pipelines, and top-tier AI research across coding, reasoning, STEM, multilinguality, multimodality, and agents.
Key Responsibilities: Review and validate domain-specific prompts covering physical geography, human geography, countries, capitals, climate, geopolitics, demographics, maps, environmental systems, and related topics. Evaluate completed tasks for factual accuracy, reasoning quality, completeness, and compliance with project guidelines. Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations.
Ensure prompts are challenging, relevant, and aligned with project objectives. Provide clear, constructive, and evidence-based feedback to contributors to improve task quality. Maintain consistency across reviews by following established quality standards and guidelines. Escalate ambiguous or complex cases and document review findings as needed. Collaborate with project managers and AI teams to continuously improve evaluation quality and review processes.
Minimum Qualifications: Master's degree or higher in Geography, Geoscience, Environmental Science, GIS, Urban Planning, or a closely related discipline. Minimum 3 years of professional, research, teaching, or industry experience in the geography domain. Prior experience reviewing, evaluating, editing, or quality-checking domain-specific content is preferred. Excellent written English communication and strong analytical skills.
High attention to detail with the ability to identify factual, logical, and contextual errors. Engagement Details: Hours: 40 hours per week with at least 4 hours PST overlap required Employment Type: Contractor assignment (no medical or paid leave benefits) Duration: 8-week contract