Senior Software Engineer

As a Senior Software Engineer on the Runtime team at Databricks, you will build next-generation distributed data storage and processing systems that outperform specialized SQL query engines in relational query performance while providing expressiveness and programming abstractions for diverse workloads from ETL to data science.

• Apache Spark: Develop the de facto open source standard framework for big data.
• Data Plane Storage: Provide reliable and high-performance services and client libraries for storing and accessing large amounts of data on cloud storage backends (e.g., AWS S3, Azure Blob Store).
• Delta Lake: A storage management system combining data lake scale and cost-efficiency with data warehouse performance and reliability, and low-latency streaming, including ACID transactions and time travel.
• Delta Pipelines: Orchestrate and operate tens of thousands of data pipelines with higher-level abstractions for expressing, deploying, testing, and upgrading pipelines.
• Performance Engineering: Build the next-generation query optimizer and execution engine that is fast, tuning-free, scalable, and robust.

• BS (or higher) in Computer Science, related technical field, or equivalent practical experience.
• Comfortable working towards a multi-year vision with incremental deliverables.
• Motivated by delivering customer value and impact.
• 5+ years of production-level experience in Java, Scala, or C++.
• Strong foundation in algorithms and data structures and their real-world use cases.
• Experience with distributed systems, databases, and big data systems (Apache Spark, Hadoop).

Local Pay Range: $166,000—$225,000 USD. Total compensation may include annual performance bonus, equity, and benefits. Databricks offers comprehensive benefits and perks; specific details vary by region.