Director AI Engineer/ Forward Deployed Engineer at Kyndryl Deutschland GmbH

Munich, Bavaria, Germany -

Full Time

Start Date

Immediate

Expiry Date

04 Mar, 26

Salary

0.0

Posted On

04 Dec, 25

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Python, AI Engineering, MLOps, LLMOps, Microservices, API Development, Containerization, Cloud Infrastructure, RAG Pipelines, Vector Databases, LLM Orchestration, Model Evaluation, Model Fine-Tuning, Quantization, FastAPI, Flask

Industry

IT Services and IT Consulting

Description

Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The Role Are you passionate about the mechanics of modern Intelligence? Do you look beyond the hype of Generative AI and see the engineering challenges involved in latency, token optimization, and context management? Then there’s a good chance you will love being a part of our AI Engineering team at Kyndryl, where you will build the engines that power our next-generation services. As an experienced AI Engineer at Kyndryl, you will be at the forefront of designing, developing, and operationalizing complex AI architectures. While others write prompts, you will build the systems that manage them. Your work will serve as the backbone for our AI offerings, ensuring that our solutions are not only intelligent but also secure, observable, and capable of handling enterprise-scale workloads. You will be responsible for designing and implementing advanced RAG pipelines, orchestrating Large Language Model (LLM) interactions, and optimizing vector search strategies. Using Python and advanced AI frameworks, you will develop microservices that integrate various models (Open Source and Proprietary), managing the trade-offs between performance and cost. You will play a key role in establishing MLOps standards, building evaluation harnesses to test model accuracy, and implementing guardrails to ensure safe and reliable AI responses. As a valued member of our team, you will provide deep technical expertise to other engineers, guiding architectural decisions regarding model selection, fine-tuning strategies, and infrastructure design. You will have the freedom to drive innovation, experimenting with the latest developments in the field—from agentic workflows to quantization techniques—while maintaining a relentless focus on production stability. Your Future at Kyndryl The career path ahead is full of exciting opportunities to grow and advance within the job family. With dedication and hard work, you can climb the ladder to higher bands, achieving coveted positions such as Principal Engineer or Vice President of AI Software. These roles not only offer the chance to inspire and innovate, but also bring with them a sense of pride and accomplishment for having reached the pinnacle of your career in the software industry. Who You Are You’re good at what you do and possess the required experience to prove it. However, equally as important – you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused – someone who prioritizes customer success in their work. And finally, you’re open and borderless – naturally inclusive in how you work with others. Required Technical and Professional Experience 10+ years of experience working as a Software Engineer or ML Engineer, with a strong focus on backend systems. Deep proficiency in Python and the modern AI stack (e.g., PyTorch, TensorFlow, Hugging Face). Proven experience architecting and deploying RAG (Retrieval-Augmented Generation) pipelines and working with Vector Databases (e.g., Milvus, Pinecone, Weaviate). Strong understanding of LLM orchestration frameworks (e.g., LangChain, LlamaIndex) and state-of-the-art agentic design patterns. Experience with MLOps and LLMOps practices: model evaluation, versioning, monitoring (e.g., MLflow, Arize), and deployment. Solid background in API development (FastAPI/Flask) and microservices architecture. Familiarity with containerization (Docker/Kubernetes) and cloud infrastructure for ML workloads. Preferred Technical and Professional Experience Master’s degree or PhD in Computer Science, Artificial Intelligence, or related technical field. Experience with fine-tuning open-source models (Llama, Mistral) and techniques like LoRA/QLoRA. Knowledge of optimized inference engines (e.g., vLLM, TGI) and quantization. Certification in one or more of the hyperscalers (Azure, AWS, and Google GCP) - otherwise, you can obtain certifications with Kyndryl. Experience contributing to open-source AI projects or research papers. Being You Diversity is a whole lot more than what we look like or where we come from, it’s how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we’re not doing it single-handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you – and everyone next to you – the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That’s the Kyndryl Way. What You Can Expect With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter – wherever you are in your life journey. Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations. At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed. Get Referred! If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address. We’re glad you’re here. Take a look around at the many exciting career opportunities we have available and apply today! Can’t find a suitable job opening? Drop off your CV/Resume Drop off your CV/Resume and a Recruiter will reach out with related career information that match your experience and expertise. Sign up for Job Alerts Create your account and then sign up for job alerts. When new jobs become available that meet your criteria, you’ll be alerted right away! At Kyndryl, we achieve progress the world depends on, with purpose. Beginning with the purpose that matters to you. Because here, you will be part of a culture designed with purpose. One that is restless, empathetic and devoted. Where we are committed to sustainable progress for our customers and supporting the communities where we work and live. All of you is what we want. And what we need. Join us, and together, we can advance the vital systems that power human progress.

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities

You will design, develop, and operationalize complex AI architectures, ensuring solutions are intelligent, secure, and capable of handling enterprise-scale workloads. Your work will involve building advanced RAG pipelines and optimizing interactions with Large Language Models.