Senior LLMOps / AI Platform Engineer at Hire Rightt Executive Search
duabi, Dubai, United Arab Emirates -
Full Time


Start Date

Immediate

Expiry Date

07 Jan, 27

Salary

80000.0

Posted On

09 Oct, 26

Experience

8 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Yes

Skills

Industry

Information Services

Description

bout the job


Position: Senior LLMOps / AI Platform EngineerLocation: DubaiIndustry: Financial ServicesSalary: AED 25 - 30K/ month

Role Overview:The job holder will be responsible for building, deploying, optimizing, and operating production-grade LLM and Generative AI infrastructure. The role combines LLM inference, GPU optimization, Kubernetes, cloud infrastructure, observability, RAG, and AI platform engineering.

  • Responsibilities:Deploy and operate self-hosted LLMs using vLLM, SGLang, Ollama.
  • Optimize LLM inference for latency, throughput, concurrency, GPU memory, KV cache, and cost.
  • Manage GPU workloads across multiple NVIDIA GPUs.
  • Deploy and maintain AI services on Kubernetes / AWS EKS using Docker and Helm.
  • Implement LLM reliability mechanisms including health checks, monitoring, automated recovery, and model restart/refresh strategies.
  • Implement observability using Langfuse/LangSmith, OpenTelemetry, Prometheus, and Grafana.
  • Deploy and optimize RAG systems, embedding models, and vector databases such as Qdrant, Milvus.
  • Support AI agents and workflows built with LangChain and LangGraph.
  • Build and maintain CI/CD pipelines for AI services and infrastructure.
  • Troubleshoot production issues across LLMs, GPUs, Kubernetes, networking, and AI applications.


  • Requirements:Strong Python and FastAPI experience
  • vLLM, Hugging Face and self-hosted LLM deployment
  • Kubernetes, Docker, Helm and AWS
  • NVIDIA GPU inference and performance optimization
  • LangChain / LangGraph/LangSmith
  • RAG, embeddings and vector databases (Qdrant)
  • LLM observability and monitoring
  • PostgreSQL / Redis  GitHub Actions / CI/CD
  • Strong production troubleshooting skills


Email CVs to: mahin@hirerightt.com

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities
Loading...