Seattle, WA

Salary
$171,000–$248,000from the description
Posted
Jul 16, 2026
Location
Seattle, WA
Last confirmed open
Jul 21, 2026

What this job asks for AI summary

A senior individual contributor role within a Trust and Safety team focused on creating first-of-their-kind evaluation frameworks for emerging AI products — including autonomous agents and foundation models — where no established testing standards yet exist. The work involves designing experiments, crafting prompt strategies, and conducting quantitative analyses to surface systemic risks, then collaborating with data science and engineering teams to turn those methods into automated, scalable infrastructure. Suits a researcher with strong hands-on technical skills in Python or SQL and a background in AI testing or related data-intensive fields.

Senior level · 10+ years · Washington-Arlington-Alexandria, DC-VA-MD-WV · Full-time

Must have (2)
AI testing · 10+ yrsdata analytics or Data Science
Nice to have (4)
SQL or Python · 5+ yrsexperimental designmachine learningLLMs

“or” means any one of them counts — you don't need all of them.

Posted 3 times — it's one opening, so apply once.

We read this from the posting text with AI. Skim the description below before ruling yourself out.

Why we read it this way (7)

The title 'Novel AI Lead Methodologist' carries no standard seniority level word, so the title states no level; however, the 10-year minimum experience requirement, executive advisory responsibilities, and cross-functional leadership scope firmly support a Senior classification.

The minimum qualification accepts a Bachelor's degree OR equivalent practical experience, so the degree requirement is set to None.

The role is offered across five US locations (Washington D.C., Atlanta, Austin, Kirkland, Seattle); Washington D.C. is listed first and is the primary CBSA used here.

SQL and Python appear together in the preferred qualifications section with a 5-year data analysis experience requirement; they are listed as alternatives to each other per the JD's phrasing ('SQL or Python'). Both are preferred, not required.

Experimental design, machine learning, LLMs, and prompt engineering all appear under preferred qualifications or in the role narrative/responsibilities — none are hard-gated in the minimum qualifications block.

The compensation of $171,000–$248,000/year is stated explicitly, plus a 20% bonus target and equity; bonus and equity are not captured in the comp fields.

The SOC classification is a judgement call: the role is primarily a research/data-science function (designing evaluation frameworks, quantitative analysis, ML risk assessment) rather than pure BI/reporting, supporting 15-2051; 15-2031 is the runner-up given the analytical and operational research elements.

Read the full posting

The employer publishes the full description on their own site — read it there ↗. Or sign in to read it here — it's free, and it also lets you track this application.

Apply

Apply on employer site ↗