Pre-training Distributed Systems Tech Lead / Manager
Anthropic- Compensation
- $500k–$850k Published range · Top quartile for Engineering (529 listings)
- Location
- Hybrid - San Francisco, CA, at least 25% in office Remote eligibility
- Employment
- Full-time Lead / Manager
About the job
About the Role
Anthropic is looking for an experienced tech lead to join our Evals Infrastructure team, building the systems that let us measure what our models can actually do. You'll own the infrastructure that makes those measurements fast, reliable, and trustworthy at scale, working at the intersection of inference, research and infrastructure engineering.
Responsibilities
- Lead the team building the distributed systems that schedule, orchestrate, and execute evals for our frontier model training.
- Own eval throughput and cost: compute allocation across suites, queueing against constrained accelerator pools, caching and reuse of eval work.
- Build and scale the harnesses researchers use to define, run, and iterate on evals.
- Make eval results trustworthy — determinism, reproducibility, and honest uncertainty quantification on reported metrics.
- Ensure eval signal reaches the dashboards and reviews where launch decisions actually get made.
- Contribute directly as an engineer while managing and growing the team.
Qualifications
- 1+ years managing engineers (or tech-lead-with-reports experience) and experience leading technical projects end-to-end on large-scale distributed systems.
- Strong in Python and Rust.
- Built high-throughput, fault-tolerant systems on cloud or on-prem accelerator fleets.
- Care about measurement quality, not just pipeline uptime.
- Communicate well with researchers and can translate research needs into infrastructure.
Strong candidates may have experience with LLM inference or training infrastructure, eval or benchmarking systems, statistical literacy, and observability.
Compensation
Annual Salary: $500,000—$850,000 USD.
Logistics
Minimum education: Bachelor’s degree or equivalent. Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. Visa sponsorship: We do sponsor visas.
Skills & tags
Compare the essentials before you leave: pay, remote scope, employment type, source, and the employer apply destination.