WHAT YOU DO AT AMD CHANGES EVERYTHING

We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our mission is the AMD culture. We push the limits of innovation to solve the world’s most important challenges. We strive for execution excellence while being direct, humble, collaborative, and inclusive of diverse perspectives.
AMD together we advance_

THE ROLE

• To lead the team’s pretraining efforts for our open source, multilingual language model pretraining, supporting the expansion of open-source AI support for long tail and lower resource languages.
• Plan and execute efficient language model pretraining while managing architecture risk; specific need for experience and interest in efficient training techniques like MoE and fine-grained MoE .
• Provide technical leadership and drive team’s approach to model architecture, stay up to date on current relevant research, experimentally evaluate new techniques, and drive or implement feature work to support training desired architecture.
• This team is crucial in building the role of Silo AI as a thought leader and foreground actor in developing and sharing multilingual open-source language models.

Collaboration with others

• This role will provide technical leadership for our model pretraining efforts, coordinating and directing work related to model architecture
• Provide input and collaborate with data teams on data pretraining mixes, synthetic data, mid-training data, etc.
• Provide feedback to and coordinate efforts with OpenEuroLLM model architecture work package.