Senior Software Engineer (Backend/LLM Infrastructure) at Routinely
Berlin, Berlin, Germany -
Full Time


Start Date

Immediate

Expiry Date

10 Dec, 26

Salary

0.0

Posted On

11 Sep, 26

Experience

0 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Industry

Information Technology & Services

Description


  • Build and maintain Python/FastAPI services, SQLAlchemy/Alembic models, Redis caching, and background jobs (Celery/RQ).

  • Implement and optimize LLM orchestration pipelines: RAG flows, agent workflows, evaluation, tracing, retries, and feature flags.

  • Own CI/CD pipelines, environment promotion, schema migrations, canary/blue-green deployments, and operational reliability.

  • Add observability: structured logs, OpenTelemetry tracing, and RAG quality dashboards.

  • Integrate secure multi-tenant access with SSO (OIDC/SAML) and RBAC.

  • Participate in on-call rotations, incident response, and continuous improvement of production systems.


Requirements


  • 4–6+ years of backend or full-stack engineering experience with Python/FastAPI/LangGraph in production.

  • Hands-on experience with LLM systems, embeddings, vector stores, and performance/cost optimization.

  • Strong CI/CD and operations mindset: SLOs, monitoring, incidents, and rollbacks.

  • Solid SQL, Redis, and background job experience.

  • Experience integrating SSO (OIDC/SAML) and multi-tenant RBAC.

  • Nice addition: Playwright/Stagehands/pywinauto, Temporal/Kafka, feature flags (langfuse/Unleash), HIPAA/SOC2 exposure.

Responsibilities
Loading...