LOCATIONS

In this role you can work from Remote, United States
Overview
GitHub is looking for a Senior Director of Engineering to lead the development of the GitHub Copilot AI inference platform. This role involves overseeing the allocation and deployment of GitHub’s AI resources, managing high-throughput service infrastructure for inference workloads, and improving the experiment-to-production pipeline. This includes operating orchestration frameworks that support generative AI workloads at scale. The ideal candidate will possess a strategic vision, technical leadership in distributed systems and generative AI serving architectures, as well as the ability to mentor senior engineering leaders, build empowered high-trust teams, and foster a culture of technical excellence and experimentation.
The AI infrastructure at GitHub is crucial for the future of software development. As Senior Director of Engineering, you will lead four service-owning teams responsible for this foundation, ensuring efficient, secure, and business-aligned resource deployment. You will work with a team of architects to guide the platform’s evolution through deep technical leadership and organizational stewardship, collaborating with product, infrastructure, and research teams across GitHub and Microsoft to scale, optimize, and safeguard platform integrity.
This is a unique opportunity to shape the systems powering Copilot and other AI-driven experiences globally. We foster a culture that prioritizes developer empathy, transparency, and inclusive collaboration, where curiosity and impact drive our development efforts.
Responsibilities
-

Lead strategic alignment across teams to define and evolve the architecture of GitHub’s GPU infrastructure and AI serving platform.

• Oversee capacity planning, dynamic traffic shaping, and abuse mitigation systems to ensure performance, reliability, and compliance.
• Guide teams in designing scalable, secure, and observable systems that meet business and technical requirements.
• Champion experimentation and telemetry-driven development, enabling rapid iteration and data-informed decisions.
• Drive engineering excellence through automation, tooling, and standardization across deployment, testing, and operations.
• Foster cross-functional collaboration with product, design, and engineering leadership to align technical strategy with business goals.
• Mentor senior engineering leaders and cultivate a high-trust, high-performance culture across distributed teams.
• Own incident response and reliability practices, ensuring live services meet SLOs and postmortems drive systemic improvements.
• Work with architects to shape GitHub’s long-term vision for AI infrastructure, identifying opportunities for innovation and leading initiatives that scale globally.

Qualifications

REQUIRED/MINIMUM QUALIFICATIONS

• 11+ years’ experience in Software Engineering, Computer Science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python,

• OR Associate’s Degree in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 10+ years’ experience in Software Engineering, Computer Science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python,

• OR Bachelor’s Degree in Computer Science or related field AND 9+ years’ experience in Software Engineering, Computer Science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python,
• OR Master’s Degree in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 7+ years’ experience in Software Engineering, Computer Science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python,
• OR Doctorate in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 5+ years’ experience in Software Engineering, Computer Science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python,
• OR equivalent experience.
• 5+ years people management experience.

Preferred qualifications

• Deep understanding of distributed systems performance, including autoscaling, load balancing, and traffic shaping for inference workloads.
• Proven track record of building and scaling engineering organizations in high-growth or ambiguous environments.
• Experience collaborating across product, design, and engineering to align technical strategy with business outcomes.

WHO WE ARE

GitHub is the world’s leading AI-powered developer platform with 150 million developers and counting. We’re also home to the biggest open-source community on earth (and 99% of the world’s software has open-source code in its DNA). Many of the apps and programs you use every day are built on GitHub.
Our teams are dreamers, doers, and pioneers, leading the way in AI, driving humanitarian efforts around the globe, and even sending open source to Mars (and beyond!). At GitHub, our goal is to create the space you need to do your best work. We’re remote-first and offer competitive pay, generous learning and growth opportunities, and excellent benefits to support you, wherever you are—because we know that people flourish when they can work on their own terms.
Join us, and let’s change the world, together.

Please refer the Job description for details