Senior Software Engineer - Distributed Data Systems

Databricks is the Data and AI company. More than 20,000 organizations worldwide rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents.

As a software engineer on the Runtime team, you will build the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance, while providing the expressiveness and programming abstractions to support diverse workloads ranging from ETL to data science.

Example projects include: Apache Spark (the de facto open source standard framework for big data), Data Plane Storage (services and client libraries for storing and accessing data on cloud storage backends such as AWS S3 and Azure Blob Store), Delta Lake (storage management system with ACID transactions and time travel), Delta Pipelines (orchestration and operation of tens of thousands of data pipelines), and Performance Engineering (next generation query optimizer and execution engine).

• BS (or higher) in Computer Science, related technical field, or equivalent practical experience
• 5+ years of production level experience in Java, Scala, or C++
• Strong foundation in algorithms and data structures and their real-world use cases
• Experience with distributed systems, databases, and big data systems (Apache Spark, Hadoop)
• Comfortable working towards a multi-year vision with incremental deliverables
• Motivated by delivering customer value and impact

Local pay range: $166,000—$225,000 USD. Total compensation may include eligibility for annual performance bonus, equity, and benefits.