Software Engineer - Systems PhD Candidates

at  Databricks

At Databricks, we are passionate about helping data teams solve the world’s toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world’s best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we’re only getting started.
We’re radically simplifying the entire data lifecycle, from ingestion to generative AI and everything in-between. We’re doing it cross-cloud with a unified platform, currently serving over 10k customers, processing exabytes of data/day on 15+ million VMs, and growing exponentially.
To make it happen we’re building multi-cloud systems at every corner of the data ecosystem, from query engines, vector databases, training pipelines, and storage systems, down to the infrastructure that allows them to scale like auto-sharders, caches, and load balancers, just to name a few. We also build and support the tooling, languages, and stacks that bring it together. Basically, we do it all.
The space we work in and the problems we solve are massive, complex, and very deep (our published work on Lakehouse, Delta lake, and Photon are a testament to that). We’re looking for practitioners who are eager to work with the best in industry to push the boundaries of what’s possible for our customers. If you’re truth seeking, data driven, and love to operate from first principles (head fake: our core values), then Databricks is the place for you.

As a part of the Database Engine team, there are opportunities to design and implement in many areas that leapfrog existing state-of-the-art systems:

• Query compilation & optimization
• Distributed query execution and scheduling
• Vectorized engine execution
• Data security
• Resource Management
• Transaction coordination
• Efficient storage structures (encoding, indexes)
• Automatic physical data optimization

OUR COMMITMENT TO DIVERSITY AND INCLUSION

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.