AI Inference Engineer - Large Language Models (f/m/d)

at  Aleph Alpha

OVERVIEW:

You will join our product team in a position that sits at the intersection of artificial intelligence research and real-world solutions. We foster a highly collaborative work culture where you can expect to work closely with your teammates and have a high level of communication between teams through methodologies such as pair or mob programming.

• Model Inference: Focus on inference optimization to ensure rapid response times and efficient resource utilization during real-time model interactions.
• Hardware Optimization: Run models on various hardware platforms, from high-performance GPUs to edge devices, ensuring optimal compatibility and performance.
• Experimentation and Testing: Regularly run experiments, analyze outcomes, and refine the strategies to achieve peak performance in varying deployment scenarios.
• Staying up to date with the current literature on MLSys