Site Reliability Engineer

Baseten powers mission-critical inference for AI companies like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. They unite applied AI research, flexible infrastructure, and developer tooling to help companies bring cutting-edge models into production. Recently raised a $1.5B Series F led by Altimeter Capital, Conviction Partners, and Spark Capital.

As a Site Reliability Engineer, you will define and codify gold standards for day 2 operations of the ML infrastructure platform. You will build robust systems, processes, automations, and observability tooling to keep the platform reliable at scale. You will work with engineering, forward-deployed, and product teams to learn from failure patterns, turn tribal knowledge into automated mitigations, and raise the operational floor.

• Own reliability of multi-cloud Kubernetes infrastructure, including incident response, post-mortems, and remediation tracking.
• Build and maintain observability infrastructure (metrics, logging, dashboards, alerting) as code.
• Author, validate, and improve runbooks for recurring failure patterns.
• Identify high-frequency failure patterns and convert them into automated mitigations or self-healing automations.
• Diagnose and resolve runtime issues related to latency, memory, GPU utilization, concurrency, and model lifecycle management.
• Define and instrument SLOs and SLIs across customer workloads and internal services.

• Extensive hands-on experience with Kubernetes (multi-cloud across EKS, GKE, or similar is a plus).
• Experience building and maintaining scalable infrastructure.
• Strong foundation in observability tooling: metrics (VictoriaMetrics, Prometheus), logging (Loki, ELK), dashboards (Grafana), alerting pipelines.
• Experience with infrastructure-as-code (Terraform, Helm) and GitOps workflows (Flux CD, ArgoCD).
• Experience writing runbooks, leading incident response, and doing post-mortem analysis.
• Comfort at the intersection of engineering and operations.
• Familiarity with incident management platforms (incident.io or similar) is a plus.
• No prior ML experience required, but curiosity about ML model deployment is valued.

Salary range: $165,000 – $330,000 USD, plus equity (U.S. only). Benefits include 100% coverage of medical, dental, and vision insurance for employee and dependents, flexible PTO with company-wide Winter Break, paid parental leave, fertility and family-building stipend (U.S. only), and company-facilitated 401(k).