Staff Software Engineer, Lakeflow Pipelines DR

As a Staff Engineer on the Lakeflow Disaster Recovery team, you will design and implement distributed systems that replicate and recover pipelines across regions. You will solve challenging problems involving consistency, idempotency, causal ordering, failover, failback, and safe recovery without silent data loss or duplication.

• Work on cross-region replication and recovery for Lakeflow pipelines, streaming tables, and materialized views
• Ensure distributed consistency across pipeline dependencies, table versions, and transaction logs
• Build failover and failback workflows with conservative correctness guardrails
• Implement deep clone, metadata reconciliation, observability, and failure-injection testing
• Conduct high-fidelity recovery simulations, game-day testing, and formal reasoning about failure modes

• Passion for distributed systems, databases, storage systems, streaming systems, or reliability engineering
• Strong software engineering skills in Java, Scala, C++, Go, Python, or a similar production language
• Understanding of consistency, transactions, idempotency, replication, checkpointing, and data lineage
• Ability to define and work toward a multi-year technical vision with incremental, production-quality deliverables
• 8+ years of experience working on related systems preferred
• Optional: PhD or advanced research experience in databases, distributed systems, or storage

Local Pay Range: $192,000—$260,000 USD. The total compensation package may also include eligibility for annual performance bonus, equity, and the benefits listed above.