Evaluation is at the heart of how we build our product. As Siri AI becomes more and more powerful and offers ever richer experiences to our users, our evaluations have to keep pace. We are seeking a senior manager to help drive our evaluation efforts. The role will involve managing teams working on evaluation development and data science, and leading high-impact initiatives to bring state-of-the-art agentic evaluation to the whole Siri team.

Minimum Qualifications
Experience managing a team building AI-powered systems
Track record of designing and delivering high-quality outcomes, and collaborating across multiple teams
Expertise in agentic modeling, data science and experimental design
Demonstrated expertise in using AI-assisted software development workflows to accelerate engineering while maintaining code quality

Preferred Qualifications
Excellent communication skills
Expertise in conversational AI and natural language understanding
Experience in evaluation for agentic systems
Track record of managing first-level managers and senior engineers, and developing their careers