Sr. Engineering Manager, Inference

CoreWeave is The Essential Cloud for AI™, a specialized cloud provider delivering GPU compute for AI and other compute-intensive workloads. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025.

As a Senior Engineering Manager for the AI/ML Platform team, you will lead the group responsible for productizing and operating our inference offering. You will guide engineers working on service reliability, observability, operational excellence, packaging, developer-facing tooling, and application-layer enhancements. You will partner with Product, engineering teams, Design, Support, and GTM stakeholders to ensure the inference experience meets the needs of practitioners deploying and scaling real-world AI workloads.

• Lead and grow the engineering team responsible for evolving and operating the W&B Inference product, focusing on service reliability, orchestration, operational maturity, and developer experience.
• Drive execution on roadmap initiatives in partnership with Product.
• Own engineering processes for the inference productization layer, including incident response, operational readiness, release management, observability, and engineering quality.
• Partner with CoreWeave’s infrastructure teams to integrate capabilities from the underlying inference platform.
• Guide the design and delivery of application-layer enhancements such as tracing and tool call handling.
• Ensure the inference offering meets high standards of reliability, usability, compliance, and performance.
• Create clarity in complex, cross-functional environments.
• Build a culture of ownership, technical excellence, and continuous improvement.

• 7+ years of experience in software engineering, including 3+ years managing or leading engineering teams responsible for distributed systems, developer platforms, or large-scale services.
• Fluent in concepts related to distributed compute services, including observability, autoscaling patterns, reliability engineering, API design, and service operations.
• Comfortable with competing priorities and making principled trade-offs among latency, reliability, cost, and development velocity.
• Skilled at leading engineering teams through ambiguous, multi-stakeholder projects.
• Deep empathy for ML practitioners and platform developers.
• Preferred background in high-scale systems, real-time APIs, or cloud infrastructure, ideally with exposure to model-serving or inference-adjacent domains.

The base salary range for this role is $188,000 to $303,000. Total rewards include a discretionary bonus, equity awards, and a comprehensive benefits program.

Benefits include medical, dental, and vision insurance (100% paid by CoreWeave), life insurance, short and long-term disability, tuition reimbursement, mental wellness benefits, family-forming support, paid parental leave, childcare support, 401(k) with employer match, flexible PTO, and catered lunch in offices.

Apply via the provided link.