Domain Expert – Music
Job at a glance
Domain Expert – Music | Varies | Worldwide Remote Turing is seeking a highly qualified Music Domain Expert to help evaluate and improve Large Language Models (LLMs). In this role, you will design challenging prompts, assess AI-generated responses for accuracy and reasoning quality, and identify knowledge gaps across music theory, genres, composers, artists, production, and instruments. This is a fully remote, flexible contractor opportunity with a world-leading AI research accelerator.
About Turing Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing helps customers accelerate frontier research with high-quality data, advanced training pipelines, and top AI specialists — and helps enterprises transform AI from proof of concept into proprietary, measurable intelligence.
Key Responsibilities Create advanced prompts covering music theory, genres, composers, artists, production, and instruments. Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance. Identify hallucinations, logical inconsistencies, outdated information, and edge cases. Develop benchmark datasets and adversarial test cases. Provide evidence-based feedback supported by reliable references.
Collaborate with AI researchers to improve model performance. Maintain high annotation quality and thorough documentation. Minimum Qualifications Master's degree or higher in Music or a closely related discipline. 3+ years of professional, research, or teaching experience in music. Excellent written English and strong analytical skills. High attention to detail and ability to evaluate complex content objectively.
Preferred Qualifications Experience with LLMs, Generative AI, prompt engineering, or AI evaluation. Published research, industry recognition, or formal teaching experience. Ability to work independently and deliver objective, evidence-backed reviews. Sample Tasks Write domain-specific prompts of varying difficulty levels. Compare multiple AI responses and rank them with justification. Explain why a response is correct or incorrect using authoritative references.
Identify ambiguous questions and propose improved, clearer prompts. Benefits Work on cutting-edge AI projects at the frontier of research. Competitive compensation based on experience. Fully remote with flexible working hours.