QA Engineer - Generative AI, Support Apps Austin,Texas,United States Machine Learning and AI Imagine what you could do here. At Apple, new ideas have a way of becoming phenomenal products, services, and customer experiences very quickly. Bring passion and dedication to your job and there’s no telling what you could accomplish. From day one, you’ll have the opportunity to make meaningful contributions to the big picture inside our AppleCare Digital team. AppleCare Digital seeks a QA Engineer to help drive platform and product testing for generative AI initiatives in our customer-facing support apps. The role will focus on implementing and analyzing the performance of generative AI solutions to improve customer experience, increase issue resolution, and achieve business goals. It requires process-oriented creative thinking and the ability to cut through ambiguity. The ideal candidate will have a proactive approach to identifying issues, strong analytical and problem-solving skills, an obsession with customer experience, and hands-on experience applying generative AI technology to end-customer interactions with proven, high-quality results. **Description** As a QA Engineer focused on Generative AI Product operations, we design and implement robust testing strategies for Generative AI solutions. Testing will include functionality, performance, accuracy and production sampling. Using the latest emerging AI technology, we test feature quality and assess customer experience. We will also collaborate with data scientists, ML engineers, and product teams to define testing requirements and identify potential risks. We develop and maintain automated test suites for AI/ML pipelines and APIs. Test data preprocessing pipelines and ensure data quality for AI model training. We validate AI generative solutions for bias, fairness, and ethical compliance. Perform load, stress, and security testing on solutions to ensure reliability. In this role, you will be the SME for auditing Generative AI quality across the AppleCare Digital platform. Collaboration, detailed troubleshooting, effective communication of issues, and timely resolution are critical skills required to succeed. **Minimum Qualifications** + Bachelor's in Computer Science, Software Engineering or similar field of study + 3+ years of experience in QA engineering, with a focus on AI/ML systems. + Strong programming skills in Python, Java, or another relevant language. + Hands-on experience with testing frameworks like PyTest, Selenium, or JUnit. + Familiarity with ML frameworks such as TensorFlow, PyTorch, or Hugging Face. + Understanding of RESTful APIs and tools like Postman for API testing. + Knowledge of CI/CD tools like Jenkins, GitHub Actions, or GitLab. + Experience in validating Generative AI models (e.g., GPT, DALL-E) + Knowledge of NLP, computer vision, or multimodal models. + Familiarity with synthetic data testing techniques. + Experience in verifying training data integrity and bias detection. + Familiarity with data annotation tools and quality control processes. + Experience with prompt engineering and LLMs in a hands-on capacity **Key Qualifications** **Preferred Qualifications** + Master's or equivalent experience in Computer Science, Software Engineering, or an MBA is a plus + Understanding of LLM fine-tuning and evaluation metrics (e.g., BLEU, ROUGE, F1-score). + Knowledge of XAI (explainable AI) tools (e.g., SHAP, LIME). + Familiarity with regulations like GDPR and AI ethics frameworks. + Experience with cloud platforms (AWS, Azure, Google Cloud) and MLOps tools (e.g., Kubeflow, MLflow). + Proficiency in load testing tools like JMeter or Locust. + Experience with security best practices in AI systems + Expert in the use of industry-standard data analysis and reporting tools including Tableau **Education & Experience** **Additional Requirements** + Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.Learn more about your EEO rights as an applicant. (https://www.eeoc.gov/sites/default/files/2023-06/22-088\_EEOC\_KnowYourRights6.12ScreenRdr.pdf) **Apple Footer** Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant (Opens in a new window) . Apple will not discriminate or retaliate against applicants who inquire about, disclose, or discuss their compensation or that of other applicants. United States Department of Labor. Learn more (Opens in a new window) . Apple will consider for employment all qualified applicants with criminal histories in a manner consistent with applicable law. If you’re applying for a position in San Francisco, review the San Francisco Fair Chance Ordinance guidelines (opens in a new window) applicable in your area. Apple participates in the E-Verify program in certain locations as required by law. Learn more about the E-Verify program (Opens in a new window) . Apple is committed to working with and providing reasonable accommodation to applicants with physical and mental disabilities. Reasonable Accommodation and Drug Free Workplace policy Learn more (Opens in a new window) . Apple is a drug-free workplace. Reasonable Accommodation and Drug Free Workplace policy Learn more (Opens in a new window) .