Staff Software Engineer, Inference

Anthropic's mission is to create reliable, interpretable, and steerable AI systems. Our Inference team builds and maintains the critical systems that serve Claude to millions of users worldwide, including intelligent request routing, fleet-wide orchestration across diverse AI accelerators, and high-performance distributed systems.

• Design, build, and maintain distributed systems that serve Claude
• Develop resilient, flexible systems that adapt in real time
• Develop intelligent request routing, load balancing, and traffic management across thousands of accelerators
• Maximize compute efficiency via autoscaling and orchestration
• Build production-grade deployment pipelines for releasing new models
• Integrate new AI accelerator platforms and support inference for new model architectures

• Proficiency in Python or Rust
• Experience building and operating distributed systems in production
• Working knowledge of containerized infrastructure (e.g., Kubernetes) and at least one major cloud platform (AWS, GCP, or Azure)
• Results-oriented, with a bias towards flexibility and impact
• Desire to learn about machine learning systems and infrastructure

• Significant experience with high-performance, large-scale distributed systems
• Experience implementing and deploying machine learning systems at scale
• Experience building load balancing, request routing, or traffic management systems
• Familiarity with LLM inference optimization, batching, and caching strategies
• Deep experience operating Kubernetes and cloud infrastructure at scale
• Experience with AI accelerator platforms (GPUs, TPUs, or emerging hardware)

Compensation: Annual salary of £325,000—£390,000 GBP.

Location: Hybrid - London, UK, with at least 25% time in office.

Visa sponsorship: Anthropic sponsors visas and will make every reasonable effort to get you a visa if an offer is made.

Applications are reviewed on a rolling basis with no deadline.