GPU Kernel Development Engineer at Advanced Micro Devices, Inc

Chaoyang District, Beijing, China -

Full Time

Start Date

Immediate

Expiry Date

15 Mar, 26

Salary

0.0

Posted On

15 Dec, 25

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

GPU Performance Engineering, Algorithms, Model Architectures, Kernel Implementations, HIP, CUDA, Triton, Transformer Models, Attention Mechanisms, Training Algorithms, Profiling, Optimizing Kernels, PyTorch Internals, Distributed Training, Kernel Agents, Performance Automation Tools

Industry

Semiconductor Manufacturing

Description

WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career. THE ROLE: As part of AMD’s Training Optimization Team, you will help customers train AI models seamlessly and efficiently on AMD GPUs. You will identify and fill gaps in AMD’s training ecosystem, optimize critical kernels, and leverage frontier techniques to push the limits of training performance on large-scale systems. You will also contribute to the development of kernel agents—tools that accelerate kernel iteration and ultimately assist humans in achieving extreme GPU performance. THE PERSON: You are a strong GPU performance engineer with a solid understanding of algorithms, model architectures, and kernel implementations. You can move fluidly from mathematical concepts to low-level optimization, and you excel in diagnosing real training bottlenecks. You are comfortable working directly with customers and collaborating across internal teams. KEY RESPONSIBILITIES: Support Customers: Ensure smooth training on AMD GPUs by identifying bottlenecks and delivering kernel-level performance improvements. Optimize Hot Operators: Design and optimize kernels using HIP, CUDA, and Triton across real training workloads. Advance Kernel Agents: Improve agent-based tooling to speed up kernel development and help achieve peak performance. Strengthen AMD’s Training Ecosystem: Fill functional gaps, improve framework integration, and enhance ROCm-based training performance. Explore Frontier Kernel Techniques: Prototype next-generation kernels (e.g., sparse attention, linear attention ops). Collaborate Across Teams: Work with GPU library teams, runtime/communication teams, and open-source maintainers to drive upstream improvements. Optimize Distributed Training: Improve performance across multi-GPU and multi-node clusters through better comm/compute overlap and parallelism strategies. PREFERRED EXPERIENCE: Hands-on experience with HIP, CUDA, Triton, and GPU performance tuning. Strong understanding of Transformer models, attention mechanisms, and training algorithms. Experience profiling and optimizing kernels with low-level tools. Familiarity with PyTorch internals, Megatron-LM, DeepSpeed, or other large-training frameworks. Experience debugging or optimizing distributed training (DP/TP/PP/ZeRO). Experience building or optimizing kernel agents, runtime schedulers, or performance-automation tools. Contributions to kernel libraries (CUTLASS, CK), Triton, or ML compiler ecosystems. ACADEMIC CREDENTIALS: Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent #LI-FL1 Benefits offered are described: AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

Responsibilities

The role involves supporting customers by optimizing training on AMD GPUs and improving kernel performance. Additionally, the engineer will advance kernel agents and explore frontier kernel techniques.