Senior Software Engineer at Microsoft

Bengaluru, karnataka, India -

Full Time

Start Date

Immediate

Expiry Date

18 Feb, 26

Salary

0.0

Posted On

20 Nov, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Real-Time ETL, Feature Pipelines, OpenTelemetry, Prometheus, Grafana, Kafka, Pulsar, GPU Inference, Triton Inference Server, Performance Tuning, Kubernetes, Containers, Distributed Systems, Streaming Frameworks, Observability Stacks, Coding Languages

Industry

Software Development

Description

- Design & code real-time ETL/feature pipelines (e.g., Flink or Spark Structured Streaming) feeding online stores/caches with strict freshness. - Define and meet SLOs with OpenTelemetry/Prometheus/Grafana for metrics, tracing, and alerting. - Implement robust queuing/streaming with Kafka/Pulsar. - Optimized GPU inference services on Triton Inference Server (or ONNX Runtime/TensorRT). - Profile & optimize end-to-end: CPU/GPU utilization, memory, I/O, vectorization, caching etc. - Ship safely with CI/CD. - Collaborate with applied scientists on feature contracts, embedding pipelines, validation. - Code reviews, docs, and mentoring. Required Qualifications: - Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python - OR equivalent experience. - Production experience with streaming frameworks (Flink or Spark ) and messaging (Kafka). - Hands-on with Kubernetes and containers; comfort with service ops (logs, metrics, scaling). - Practical experience with GPU inference on Triton or ONNX - Runtime/TensorRT (model packaging, runtime tuning, batching). - Performance tuning (profilers/flamegraphs), concurrency, networked services. - Familiarity with observability stacks (Prometheus, Grafana, OpenTelemetry). - Tech stack: ML Sys| Flink | Spark | Kafka | Azure | Kubernetes | Triton | ONNX | OpenTelemetry | Prometheus | Grafana |GPU inference |OpenAI Models. Preferred Qualifications: - Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python - OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python - OR equivalent experience. - Experience with real-time feature stores or embedding pipelines. - Prior contributions to GPU batching, dynamic scheduling, or multi-model serving. - 6+ years building distributed systems in production.

Responsibilities

The Senior Software Engineer will design and code real-time ETL and feature pipelines, ensuring strict freshness for online stores and caches. They will also collaborate with applied scientists on feature contracts and implement robust queuing and streaming solutions.