Evals Infrastructure Tech Lead / Manager at Anthropic
San Francisco, CA
$500,000–$850,000
Jul 21, 2026
San Francisco, CA
Jul 23, 2026
What this job asks for AI summary
A tech lead role on an evaluation infrastructure team, responsible for the distributed systems that schedule, orchestrate, and run model evaluations at scale. The work spans compute allocation, eval harness development, reproducibility, and surfacing results to decision-makers. Suited to someone with hands-on distributed systems experience, Python and Rust proficiency, and at least a year of engineering management or tech-lead-with-reports experience.
Staff level · San Francisco-Oakland-Berkeley, CA · Full-time
Posted 2 times — it's one opening, so apply once.
We read this from the posting text with AI. Skim the description below before ruling yourself out.
How this req sits in the market our data
Roughly 180 people in the San Francisco-Oakland-Berkeley, CA area plausibly meet what this posting asks for (computer and information systems managers). range 140–240
Applicant volume Moderate — A normal amount of company. The rare requirements below are what will separate a shortlisted application from the rest.
Rare in this occupation — lead with these, and say what you built with them.
Most people in this occupation already list these. Still required — just not what gets you shortlisted.
What the occupation pays Median $238,011 (middle half $208,323–$320,108).
Estimated from BLS employment for this occupation and area, per-skill prevalence across our listing corpus, and published wage benchmarks — as of Jul 28, 2026. It is a model, not a headcount.
Why we read it this way (8)
The role is titled 'tech lead' for the Evals Infrastructure team with explicit people-management duties (managing and growing the team, coaching reports, prioritizing work), which points to 11-3021. However, the JD strongly emphasizes hands-on individual-contributor engineering ('contribute directly as an engineer'), making 15-1252 a genuine runner-up.
Seniority is assessed as Staff rather than Senior: the role owns a cross-cutting infrastructure domain (eval infrastructure for frontier model training), sets technical direction for a team, and bridges research and infrastructure — scope that exceeds a typical Senior engineer — even though the title carries no explicit level word.
The 1+ years managing engineers requirement is stated under the 'You may be a good fit if you' section (the primary qualifications block), so it is treated as a hard gate on people-management experience, not just technical skills.
Location is not explicitly stated in the posting. Anthropic is headquartered in San Francisco, CA; the CBSA has been inferred accordingly. No remote or hybrid language appears.
LLM training infrastructure and eval/benchmarking systems experience appear under 'Strong candidates may have' (a preferred/nice-to-have block) and are marked preferred.
Observability and regression detection over time-series metrics also appear under 'Strong candidates may have' and are marked preferred.
Statistical literacy (variance, confidence intervals, sample-size sufficiency) is listed as a preferred qualification but names no specific tool or platform, so it is omitted from the skills list per the no-generic-concepts rule.
No compensation figures are provided in the posting.
Read the full posting
The employer publishes the full description on their own site — read it there ↗. Or sign in to read it here — it's free, and it also lets you track this application.