Sign up with

Already have an account? Log in here

Need some help?
Talk to us at +91 7670800001

Member of Technical Staff, LLM Inference at Microsoft

Redmond, Washington, United States -

Full Time

Start Date

Immediate

Expiry Date

26 Feb, 26

Salary

0.0

Posted On

28 Nov, 25

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

C, C++, C#, Java, JavaScript, Python, Generative AI, Distributed Computing, GPU Kernel Programming, Benchmarking, Profiling, Optimizing, PyTorch, Open Source Inference Frameworks, vLLM, SGLang, JAX

Industry

Software Development

Description

Work alongside researchers and engineers to implement frontier AI research ideas. Introduce new systems, tools, and techniques to improve model inference performance. Build tools to help debug performance bottlenecks, numeric instabilities, and distributed systems issues. Build tools and establish processes to enhance the team's collective productivity. Find ways to overcome roadblocks and deliver your work to users quickly and iteratively. Enjoy working in a fast-paced, design-driven product development cycle. Embody our Culture and Values. Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python Experience with generative AI. Experience with distributed computing. Python and Python ecosystem (eg. uv, pybind/nanobind, FastAPI) expertise. Experience with large scale production inference. Experience with GPU kernel programming. Experience benchmarking, profiling, and optimizing PyTorch generative AI models. Experience with open source inference frameworks like vLLM and SGLang. Working experience and conversant with the material in the JAX scaling book.

Responsibilities

Work alongside researchers and engineers to implement frontier AI research ideas and improve model inference performance. Build tools to debug performance bottlenecks and enhance team productivity.