Backend Engineer – LLM Integration at Luxoft Germany
Berlin, Berlin, Germany -
Full Time


Start Date

Immediate

Expiry Date

05 Jan, 27

Salary

65000.0

Posted On

07 Oct, 26

Experience

6 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Yes

Skills

Industry

Information Technology & Services;IT Consulting & System Integration

Description

ResponsibilitiesBackend Engineers in this stream own the integration layer between the AI/ML components and the vehicle/cloud communication backbone. The stack is Python-first, event-driven via Kafka, and exposed through FastAPI services running on AKS. You will work inside the joint product team, picking up S/M/L backlog tickets and shipping production-ready code.

  • Build and maintain FastAPI microservices that orchestrate LLM calls, tool use, and agentic workflows using LangChain / LangGraph.
  • Implement Kafka producers and consumers for real-time voice session data, telemetry, and event-driven AI triggers.
  • Integrate with Azure OpenAI endpoints via LiteLLM abstraction; manage prompt versioning and A/B routing.
  • Write unit, integration, and contract tests (pytest, Pact); maintain coverage and quality gates in Azure DevOps.
  • Containerise services with Docker; deploy and operate on AKS; contribute to Helm chart and Terraform configuration.
  • Participate in code reviews with Audi engineers and contribute to joint architectural decisions.
  • Monitor service health using Azure Monitor / Application Insights; triage and resolve production incidents.
  • Document APIs (OpenAPI) and maintain ADR entries for significant implementation decisions.


  • SkillsMust have3+ years professional Python development, including production web services
  • Experience with FastAPI (or Flask/Django) for REST API design
  • Familiarity with at least one LLM orchestration framework: LangChain, LangGraph, or LiteLLM
  • Apache Kafka — producer/consumer implementation; at-least-once vs exactly-once semantics
  • Docker and Kubernetes basics (deployment manifests, service configuration)
  • English B2 or above.


How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities
Loading...