Senior Software Engineer at Microsoft

Beijing, Beijing, China -

Full Time

Start Date

Immediate

Expiry Date

30 Mar, 26

Salary

0.0

Posted On

30 Dec, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

AI Techniques, Prompt Engineering, LLM Optimization, Model Accuracy, Contextual Understanding, Response Reliability, AI Ethics, Collaboration, Problem Solving, Technical Leadership, C, C++, C#, Java, JavaScript, Python

Industry

Software Development

Description

Overview Join the Copilot Team and be at the forefront of AI-powered innovation. We are redefining the future of intelligent solutions, creating seamless connections across Windows, M365, and Azure. Our mission is to empower every person and organization on the planet to achieve more. We embrace a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Our values of respect, integrity, and accountability drive our inclusive culture where everyone can thrive. #CopilotTeam As a Senior Software Engineer (AI Engineer), you will be responsible for designing, optimizing, and implementing advanced prompt engineering strategies to enhance the performance, controllability, and application effectiveness of large language models (LLMs). You will work closely with cross-functional teams (product, AI/ML, and engineering) to drive prompt optimization across real-world business scenarios, ensuring efficient inference, high-quality responses, and seamless user experience. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction. Responsibilities Design, develop, and implement robust and scalable software applications that utilize AI techniques. Develop and optimize LLM prompt engineering techniques (e.g., Chain of Thought, ReAct, Few-Shot Learning, Self-Consistency, Prompt Chaining) to enhance model coherence, reasoning, and controllability. Optimize LLM models and their performance for specific use cases. Improve model accuracy, contextual understanding, and response reliability while minimizing hallucinations and irrelevant outputs. Help identify opportunities to improve and optimize existing systems using LLM. Work closely with Finetuning & Evaluation teams, engineering, and product teams to integrate LLM-powered solutions into Copilot. Stay up to date with the latest LLM research and best practices, applying new advancements to real-world applications. Provide technical leadership, mentoring junior engineers on prompt engineering, LLM optimization, and AI best practices. Qualifications Required Qualifications: Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Hands-on experience working with LLMs such as ChatGPT, LLaMA, Claude, Mistral, and a deep understanding of prompt engineering techniques. Solid problem-solving skills in LLM inference optimization, token efficiency, and response tuning. Experience with AI frameworks and libraries such as LangChain. Deep understanding of AI ethics, bias mitigation, and RAI principles. Proven experience in leading technical teams and making architectural decisions for AI-powered applications. Solid communication and collaboration skills, with the ability to work across product, engineering, and F&E teams. Preferred Qualifications: Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Experience in optimizing LLM inference efficiency, including token budgeting, temperature tuning, and latency reduction. Experience in AI-powered web/mobile/backend development. Solid analytical mind and a confident decision maker. Ability to balance competing demands and adapt to changing priorities. #MicrosoftAI This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Responsibilities

Design and implement advanced prompt engineering strategies for large language models to enhance performance and user experience. Collaborate with cross-functional teams to integrate LLM-powered solutions into products.