AIML - Machine Learning Engineer, Technical Lead, Evaluation at Apple

Cupertino, California, United States -

Full Time

Start Date

Immediate

Expiry Date

26 May, 26

Salary

0.0

Posted On

25 Feb, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data-Driven Evaluation, Machine Learning, Artificial Intelligence, Generative AI, LLM-Based Evaluation, Simulation-Based Evaluation, Strategy, Execution, High Quality Evaluation Datasets, Persona Development, Analytical Skills, Statistical Foundations, Metric Design, Cross-Functional Collaboration, Communication Skills, Engineering Experience

Industry

Computers and Electronics Manufacturing

Description

Do you want to play a part in building a groundbreaking technology for large scale systems, generative AI experiences and shipping next generation of Apple products? You will improve and enrich lives of Apple users across the globe. Join the Evaluation team at Apple AIML. DESCRIPTION You will play a critical role in scaling up global evaluation of Apple AIML products, with the primary focus on next generation Siri and Apple Intelligence features. You will drive and scale our evaluation work to enable high-velocity development and shipping of Generative AI features globally, in every country and language where Apple AIML features are available. You will drive LLM-based evaluation as a product, delivering simulation-based evaluation of personalized user experiences, reflective of cultural and language diversity of our customers. The focus of this technical lead role is strategy and execution of high quality evaluation datasets grounded in “personas”, acquired and synthetically generated, by language and region. This role requires a combination of engineering experience working with GenAI and ML based products, an ability to drive scale, and a relentless drive for improving signal-to-noise ratio. This role’s success will be driven by building deep cross-functional partnerships and by embracing and leading breakthrough technologies. MINIMUM QUALIFICATIONS Extensive experience with data-driven evaluation of complex systems (ML/AI/agents) and the ability to translate findings into product improvements. Strong analytical and statistical foundations with the ability to design metrics and interpret noisy or ambiguous signals. Demonstrated ability to collaborate with cross-functional partners (engineering, product, research) to drive impact at scale. Excellent communication skills, including articulating technical insights to both technical and non-technical audiences. BS/MS in Computer Science, Machine Learning, Statistics, Applied Math, or a related quantitative field. PREFERRED QUALIFICATIONS Experience with evaluation of large language models, tool-enabled agents, or multi-component AI systems. Background in simulation-based evaluation, user behavior modeling, or experimental design. Experience designing evaluation that scales across languages, cultures, or diverse user populations. Familiarity with instrumentation, telemetry, and large-scale measurement systems. Prior involvement in shipping customer-facing products where measurement informed strategic decisions.

Responsibilities

The role involves driving and scaling global evaluation efforts for Apple AIML products, primarily focusing on next-generation Siri and Apple Intelligence features to enable high-velocity development. A key focus is leading LLM-based evaluation as a product, delivering simulation-based evaluations that reflect diverse customer cultures and languages.