Senior Software Engineer, Data Platform

at  Lyft

At Lyft, our mission is to improve people’s lives with the world’s best transportation. To do this, we start with our own community by creating an open, inclusive, and diverse organization.
We are seeking a talented Software Engineer to join our dynamic Streaming Compute Team. In this role, you’ll be instrumental in designing, developing, and maintaining our low latency and high throughput systems, which are critical to a lot of teams like driver, mapping, fraud etc. and almost all ML models at Lyft. Our systems and platform are used for a variety of use cases such as, persisting high volume service events, detecting issues with routes, computing prime-time, creating, storing and serving ML features for training and inference purposes for teams like payments, incentives etc. The majority of our streaming solutions run on Apache Flink and Apache Beam with support from reading and writing to various sources and sinks respectively.
As a Software Engineer, with your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance the platform offerings. Your work will have a major impact on several areas of the business.
We are looking for candidates who have prior experience working with near-real time streaming systems, are self starters and have a proven track record of delivering software solutions that can solve critical business needs. The candidate should be able to dive deep into problems with lots of ambiguity and build a technical solution to solve it. They should be willing to take ownership of a project or a feature and be able to drive it from design to implementation.

EXPERIENCE:

• 5+ years of experience with building, deploying and maintaining low latency, high throughput services
• 5+ years of experience building and developing large-scale infrastructure, distributed systems or networks, and/or experience with compute technologies
• 3+ years of software engineering industry experience and with distributed streaming solutions like Apache Flink, Apache Samza, Spark streaming etc.
• Experience working with kubernetes and container technologies (e.g. Docker, cri-o, etc)
• Familiar with a cloud-based environments such as AWS/GCP/Azure

• Design, develop, deploy, monitor, operate and maintain scalable streaming solutions that constitute our streaming platform
• Work with technologies such as Apache Kafka, Apache Flink, Apache Beam etc. to enhance our data platform’s streaming offerings
• Collaborate with cross-functional teams to integrate streaming solutions into the broader data architecture
• Analyze our internal systems and processes and locate areas for improvement/automation
• Collaborate with product org stakeholders to address and prioritize custom edge cases
• Help lead large projects from inception to positive execution