Staff / Principal

Anthropic's Inference organization serves Claude to millions of users and enterprise customers. We're looking for a Staff engineer to be the technical lead for Inference Developer Productivity: the team that makes every engineer in the org dramatically more effective at building, testing, and shipping inference software. This is a senior IC role with broad technical ownership.

• Set technical direction for Inference Developer Productivity, owning the architecture and roadmap for toolchains, dev environments, and CI/CD across GPU (CUDA), TPU, and Trainium platforms.
• Be the technical owner of accelerator toolchain management: compilers, drivers, libraries, frameworks, kept current, compatible, and well-tested.
• Design and build infrastructure for efficient accelerator usage during development, including devbox environments, pre- and post-land validation automation, and shared tooling.
• Define and instrument productivity metrics for the Inference org, building dashboards and alerting that surface regressions early.
• Proactively hunt down bottlenecks, toil, and friction across Inference engineering workflows.
• Act as the technical counterpart to Anthropic's central Infrastructure org.
• Mentor engineers on the team through design review, code review, and direct collaboration.

• 8+ years of software engineering experience, with significant time as the technical lead or anchor on an infrastructure, platform, or developer productivity team.
• Deep background in systems engineering, build/test infrastructure, or ML infrastructure.
• Experience owning toolchains or development environments for compute-intensive workloads.
• Real depth in at least one accelerator ecosystem (CUDA/GPU, TPU, or Trainium/AWS Neuron).
• A track record of defining and using engineering metrics to drive improvement.
• Experience driving technical alignment across organizational boundaries.
• Strong written and verbal communication.

• Experience with ML compiler toolchains (XLA, Triton, NeuronX) or accelerator driver/firmware management at scale.
• Background building or running shared development environments (devboxes, remote development, ephemeral environments).
• Experience with CI/CD systems at scale, particularly for workloads involving accelerator hardware.
• Familiarity with Kubernetes-based development and job scheduling environments.
• Prior tech lead experience on a developer productivity or platform engineering team at a fast-growing AI/ML company.

Annual Salary: $405,000—$485,000 USD. Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space.

Apply through the Greenhouse job posting. Anthropic recruiters only contact you from @anthropic.com email addresses.