Principal Software Engineer

at  Microsoft

Are you passionate about driving efficiency in GPUs and working on cloud-scale engineering? Do you thrive in collaborative environments?
We are a team applying efficiency practices with the goal of maximizing hardware utilization. Our team directly engages with data scientists and engineers that develop, train, and run LLM models and seek to optimize for latency, throughput, and overall total cost of ownership. We work across Microsoft Copilot to optimize our usage on our large GPU cloud infrastructure. We help to balance responsive, low latency inferences, keep up with a large amount of opportunistic LLM use, and make available every excess FLOP of computation to train our next generation of models.
Our team members reside in Europe and have a mix of in-office, hybrid, and remote employees. We adhere to an inclusive environment where members can contribute equally across the physical and digital presence.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

REQUIRED QUALIFICATIONS:

• Bachelor’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
• OR equivalent experience.

OTHER REQUIREMENTS:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

PREFERRED QUALIFICATIONS:

• Bachelor’s Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python
• OR Master’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
• OR equivalent experience.
• Experience with one or more of the following technologies:
• GPU or Tensor Processors, especially NVIDIA.
• Distributed Systems
• Performance, Scalability, and Optimization
• PyTorch, CUDA, TensorFlow, Onyx Languages
• Hardware platform optimization, measurement, and characterization
• High Performance Computing (HPC)
• Interpersonal strengths a successful candidate demonstrates one or more of include:
• Clear and concise cross team communication;
• Facilitating knowledge transfer within and between teams;
• Project organization, planning, and tracking;
• Self motivation while encouraging team momentum.
• Additional experiences of interest include:
• Working with Finance, including on amortization, depreciations, NPV, operational and capital expenditure;
• Adapting cutting edge research into engineering practice;
• Green technology, carbon reduction;
• Engineering management and planning of projects encompassing large-cardinality sub-projects.

RESPONSIBILITIES

• Drive our team efforts around optimization of LLM inference and training on GPUs.
• Quickly adapt to unfamiliar code and services.
• Lead an expertise area, implementation in services, and thought evolution driven by experimentation.
• Regularly communicate and collaborate across team and organization boundaries.
• Show independent drive to advance your area of ownership while applying it broadly, contributing to our stream of engagements across our team.

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter