Software Python Engineer (Cloud Inference) at Gcore

Town of Poland, New York, United States -

Full Time

Start Date

Immediate

Expiry Date

18 Jan, 26

Salary

0.0

Posted On

20 Oct, 25

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Python, Machine Learning, Kubernetes, APIs, Docker, Helm, vLLM, SGLang, TensorFlow, PyTorch, Cloud-Native, Distributed Systems, Collaboration, Go, GPU Scheduling, Kubernetes Security

Industry

IT Services and IT Consulting

Description

Company Description Have you ever wondered why your favorite apps, social media content, and video games load in the blink of an eye? It's likely because of Gcore behind the scenes! Join a team that collaborates with industry giants like Intel, Dell, NVIDIA, Graphcore, and Equinix to accelerate AI training, provide cutting-edge cloud services, and optimize content delivery. If you are passionate about transforming the internet and contributing to cutting-edge innovations, come join us at Gcore! We are over 550 professionals and currently looking for a Software Python Engineer to join our Edge Cloud Team. Job Description Your Responsibilities: Contribute to the development of the Everywhere Inference platform - a Kubernetes-based solution enabling scalable and portable AI inference across a wide range of environments. Design and implement APIs and developer tools to simplify deployment, management, and monitoring of AI applications. Focus on packaging and integrating new ML models into the platform, using Python and common ML frameworks. Optimize serverless container workflows for AI workloads, ensuring performance, scalability, and seamless autoscaling. Collaborate with customers to fine-tune ML model performance and support their unique use cases. Work with cross-functional teams to improve the AI applications marketplace and ensure smooth model onboarding and lifecycle management. Stay current with trends in Kubernetes, machine learning, and MLOps, and help drive innovation within the platform. Qualifications We Expect you to Have: Proficiency with Python, especially in the context of ML tooling or backend development. Experience with AI/ML pipelines or integrating machine learning frameworks like TensorFlow or PyTorch into production environments. Hands-on experience with vLLM and SGLang Familiarity with cloud-native tooling such as Docker, Helm, and related CNCF technologies. A problem-solving mindset and genuine interest in working on distributed systems and platform-level challenges. Clear communication skills and a collaborative attitude - you enjoy working closely with others to build great solutions. Nice to Have: Solid experience with Go programming, particularly in the context of Kubernetes - including building controllers, operators, and working with custom resources (CRDs). Strong understanding of Kubernetes architecture, container orchestration, and resource management at scale. Understanding of GPU scheduling and performance optimization in Kubernetes. Awareness of Kubernetes security practices, including RBAC and container hardening. Contributions to open-source projects or involvement in cloud-native or MLOps communities. Additional Information What We Offer: We value our employees and offer a benefits package designed to support your health, well-being, and professional growth throughout your journey at Gcore: Competitive salary Flexible working hours Remote, hybrid, or office work options depending on your role Work from anywhere in the world for up to 45 days per year Private medical insurance for you and your family* 5 additional vacation days* Additional fully paid sick leave days* Allowance for significant life events and birthdays Language classes Modern office space with free snacks, drink and entertainment options* Team sports activities* *Please be aware that this benefit may vary depending on your country. About the Company Gcore is an international cloud and edge leader in providing first-class web performance, content delivery, and security. Headquartered in Luxembourg, with offices around the world, the company provides its solutions to global leaders in numerous industries. Millions of people worldwide use apps and play games based on our infrastructure and services: we are trusted by World of Tanks, Albion Online, Avast, Photon, Unity, Sandbox Interactive, and others. Equal Opportunity Employer We provide equal opportunity to all applicants without regard to race, color, religion, sex, sexual orientation, age, gender identity, gender expression, national origin, disability, or any other legally protected characteristics.

Responsibilities

Contribute to the development of the Everywhere Inference platform, focusing on scalable AI inference. Design APIs and tools for managing AI applications and optimize workflows for performance and scalability.