Staff Software Engineer at Runware
berlin, Berlin, Germany -
Full Time


Start Date

Immediate

Expiry Date

16 Feb, 27

Salary

50000.0

Posted On

18 Nov, 26

Experience

8 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Yes

Skills

Industry

Information Technology & Services

Description

What you’ll do

  • Build the core systems behind Runware’s serverless platform, including workload execution, routing, scheduling, isolation and scaling leveraging our inference engine
  • Make it simple for developers to deploy models and run AI workloads without managing GPUs, servers, queues or infrastructure through a simple SDK interface
  • Design and improve the control plane for serverless execution, including APIs, workers, lifecycle management, retries and failure handling
  • Work closely with our infrastructure and ML teams to improve workload startup time, GPU utilisation, model warm-up, caching and placement
  • Build observability that makes serverless workloads easy to monitor, debug and operate at scale globally
  • Lead the technical design, mentor other engineers and help define the engineering standards for a new product area

Requirements

  • Strong experience as a Staff Engineer, Senior Software Engineer, Backend Engineer, Platform Engineer or similar
  • Experience building backend services, distributed systems, developer platforms or workload orchestration systems
  • Strong understanding of async processing, queues, scheduling, retries, back pressure and failure handling
  • Comfortable working across APIs, control planes, workers, databases and observability systems
  • Strong engineering fundamentals in one or more backend languages ideally Go
  • Good judgement around trade-offs between reliability, latency, scale, cost and developer experience
  • Clear communication, strong ownership and the ability to lead technical direction in a fast-moving environment

Nice to have

  • Experience building serverless platforms, job execution systems, container platforms or compute orchestration systems
  • Experience with GPU-backed workloads, AI/ML inference, model serving, batch processing or high-performance compute
  • Familiarity with technologies such as vLLM, TensorRT, Triton, Kubernetes, Nomad or Knative
  • Experience improving workload performance through batching, autoscaling, model warm-up, caching, request routing or queue management
  • Experience with multi-tenant isolation, sandboxing, quotas, rate limits, resource accounting or usage-based billing


How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities
Loading...