Rust System Engineer - GPU Infrastructure at Orchestra

Heidelberg, Baden-Württemberg, Germany -

Full Time

Start Date

Immediate

Expiry Date

07 Sep, 26

Salary

0.0

Posted On

09 Jun, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Rust, Async Rust, Tokio, Data Structures, Algorithms, Distributed Software, Concurrent State, Deadlocks, System-Level Components, FFIs, Unsafe Components, Kubernetes, Linux Internals, CUDA, GPGPU Programming, GPU Performance Optimization

Industry

Description

Your mission To support our growing engineering team, we are looking for an experienced Rust Engineer to help build low-level infrastructure for next-generation AI workloads. In this role, you will work close to the system boundary, developing node-level daemons, dynamic library interceptors, async Rust services, Kubernetes integrations, lightweight HTTP/gRPC services, and performance-critical components for GPU workload co-location and checkpointing/restoration. This is a strong fit for someone who enjoys systems-level engineering, cares deeply about correctness, reliability, and performance, and has a strong desire to learn, improve, and explore new technologies across a cutting-edge AI infrastructure company. Your profile Bachelor’s or master's degree in computer science, Electrical Engineering, Data Science, or a related field (PhD is a plus) Strong programming skills in Rust, especially async Rust. Practical experience with Tokio or similar async runtimes. Proficiency in data structures and algorithms. Experience writing distributed software with asynchronous components, managing concurrent state, avoiding deadlocks. Proficiency in writing system-level components, FFIs, development of unsafe components. Nice to Have C++ background, especially in low-level or systems programming. Experience with Kubernetes APIs, operators, schedulers, or control plane components. Experience with Linux internals, dynamic linking, runtime interception, checkpoint/restore, or container runtimes. Prior work on AI infrastructure, distributed compute, HPC, or performance-sensitive backend systems. Experience with CUDA, GPGPU programming, or GPU performance optimization. Why us? Build something big: Help build and scale a fast-growing AI infrastructure startup Pay & perks: Competitive compensation with a performance-based incentive, subsidized Deutschlandticket, and access to a discount portal Work your way: Flexible hours with hybrid and remote-friendly options Fast lanes, no red tape: Flat hierarchies and rapid decision-making mean ideas ship quickly Global team: Work with a diverse, international team across Germany and the USA Modern headquarters: Well-stocked office near the Heidelberg Hauptbahnhof, available on a hybrid basis or as a place to connect during our quarterly team workshops Top setup: Your choice of high-quality hardware and equipment Relocation support: We’ll help make your move to join us as smooth as possible About us Turbalance GmbH is an innovative, emerging startup that transforms AI laws. We are a team of passionate problem-solvers who believe in what we’re building. We constantly push boundaries and embrace our inner nerds as we find new ways to tackle complex challenges. You will find a dynamic work environment here, with flat or even non-existent hierarchies and the chance to take on responsibility from day one. Turbalance is committed to providing a respectful, safe, and inclusive workplace. Diversity at Turbalance means fostering an environment where individual differences are recognized, valued, and respected, enabling everyone to fully contribute their talents and strengths. This commitment begins with our recruitment process. If you require any accommodations to support your application or interview, please let us know as we are happy to assist.

Responsibilities

The role involves developing low-level infrastructure for AI workloads, including node-level daemons and async Rust services. You will also work on performance-critical components for GPU workload co-location and checkpointing/restoration.