24-MAG · New York, NYremote

Salary
$55–$85/hrfrom the description
Posted
Jul 25, 2026
Location
New York, NY
Last confirmed open
Jul 26, 2026

What this job asks for AI summary

A full-time remote contract role focused on building and evaluating benchmarks for frontier AI models, specifically around data analysis tasks. Day-to-day work involves designing realistic statistical challenges, producing reproducible reference notebooks in Python, and reviewing AI-generated analyses for methodological accuracy and sound interpretation. Best suited to experienced data scientists or quantitative analysts comfortable with hypothesis testing, data cleaning, and evidence-based reporting.

Mid level · 1+ years · Remote · Contract

Must have (7)
PythonpandasNumPyJupyter Notebook or Google ColabGitstatistical analysishypothesis testing
Nice to have (3)
anomaly detectionmachine learningexperimental design

“or” means any one of them counts — you don't need all of them.

We read this from the posting text with AI. Skim the description below before ruling yourself out.

Why we read it this way (9)

The posting is classified as a W-2 contingent (contract) engagement, not a permanent full-time role, despite the 'full-time' framing — the Contract type reflects the W-2 contingent language and hourly pay structure.

A master's or PhD in a quantitative discipline is described as 'highly relevant' and equivalent practical experience 'may also be considered', so no formal degree is hard-gated.

The role sits between Data Scientists (15-2051) and Operations Research Analysts (15-2031): the work is heavily statistical analysis and reproducible research rather than ML/modeling, but the posting explicitly calls for 'data scientists and quantitative analysts' and includes Python/pandas/ML context, making 15-2051 the stronger fit.

Statistical analysis and hypothesis testing are listed as core required competencies throughout the required-qualifications section; they are retained as skills because the posting names them as concrete professional methods central to the role, not merely soft descriptors.

Anomaly detection, machine learning, and experimental design appear only under the 'Nice to Have' section.

The role is fully remote within the United States; no specific metro or state is specified.

The 1-year minimum experience figure comes from the 'Ideal Profile' section ('At least 1 year of experience'); the seniority band is Mid given the low experience floor and the nature of the work, despite the 'specialised' framing.

Engagement scope and duration are noted as potentially evolving, consistent with a contingent/contract arrangement.

Posting is for a contract engagement — the market benchmarks below price full-time roles, so read the comp comparison with that in mind.

Read the full posting

The employer publishes the full description on their own site — read it there ↗. Or sign in to read it here — it's free, and it also lets you track this application.

Apply

Apply on employer site ↗