SUMMARY

Wikimedia Foundation is hiring a Senior Site Reliability Engineer (SRE) to join our Service Operations SRE team, where we take care of the infrastructure that runs wikipedia.org and other Wikimedia Foundation projects.
The SRE team at Wikimedia is a distributed and diverse team of engineers with a drive to explore, experiment, and embrace new technologies. The SRE Service Operations team focuses on the application layer of our complex infrastructure as well as our developer-facing services. Our stack includes MediaWiki instances running on bare metal, surrounding microservices running on our own Kubernetes platform, an in-house designed deployment pipeline, and open source collaboration software (Gerrit, Gitlab, and Phabricator). We ❤️automation, and we automate as much as we can using primarily Python, Puppet, and Spicerack (https://github.com/wikimedia/operations-software-spicerack). We work in the open and document our work on our internal task management system and our technical wiki (https://wikitech.wikimedia.org). Feel free to check out our activities there!
As a senior engineer in the SRE Service Operations team, you will be involved in designing and running the infrastructure and services that form the base of Wikimedia Foundation’s projects, including, but not limited to: Kubernetes clusters, application servers, related datastores, and other developer-facing services. You will participate in 24/7 incident response and be on-call rotation. This role requires frequent work with other members of the SRE team to maintain and improve our systems, as well as interacting with people not in SRE, like Security, Release, and Software Engineers, together striving to move our projects and technologies forward.
We use more technologies than we can list here, and are interested in your experience even if it doesn’t exactly match the keywords above / below. If you find what we do interesting and enjoy the idea of working with a globally distributed team that runs a Top-15 website, we may be what you’re looking for!

SKILLS AND EXPERIENCE:

• 5+ years of experience in an SRE/Operations/DevOps role
• Experience with operating highly available infrastructure
• Experience with running applications and services at scale
• Experience implementing containerization solutions (Docker, Kubernetes)
• Proficient with shell and a programming language used in an SRE/Operations engineering context (Python, Go, Ruby, etc.)
• Comfortable with Open Source configuration management and orchestration tools (Puppet, Ansible, TerraForm etc.)
• Communicative technical English

• Design, implementation and maintenance of public facing infrastructure and services
• Use of configuration management and deployment tools
• Architectural design and operation at scale
• Monitoring of systems and services, optimization of performance and resource utilization
• Proactively identify sources of instability in distributed systems and analyze how complex systems fail from a reliability and resilience perspective.
• Common operating system level tasks such as logging and backup / restore
• Cookbook / runbook implementation for common maintenance actions
• Participate in 24/7 on-call rotation and escalations for resolving production issues
• Lead incident response and post-incident reviews, contributing to failure analysis and implementing preventive measures
• Automation and streamlining of tasks as well as identifying process gaps
• Collaborating with a global and asynchronously communicating team (don’t worry if you have never worked remotely, we’ll help you get used to it)
• Mentoring peers in your areas of technical and operational strength
• Expected to travel domestically or potentially internationally 2-3 times in a year for team gatherings and conferences