Apple Services Engineering (ASE) powers many AI and LLM features across App Store, Music, Video and more. We believe that to build exceptional LLMs you need exceptional human beings to train them. Humans are essential in providing the best training data for these models, and ASE operates a large network of humans across the world to provide this training data. As the Head of Data Quality Operations in the Human-centered AI org, you will be responsible for ensuring that our training data quality is as useful for customers as possible. You will own ideating what high-quality training means and looks like across various projects, driving thought leadership with our customers about data quality, developing the entire annotator training program, creating our “golden datasets” to programmatically evaluate annotators, and scaling data collection via machine learning or LLM methods.