New York City, NY

Salary
$200,000–$230,000
Posted
Jul 27, 2026
Location
New York City, NY
Last confirmed open
Jul 29, 2026

What this job asks for AI summary

A founding ML Infrastructure Engineer role at a healthcare AI startup, responsible for building and scaling the cloud infrastructure behind model training, inference, and data pipelines. The position owns observability, reliability, and production operations across the ML stack, and collaborates closely with ML and backend engineers. Deep ML expertise is not required — the role suits a strong distributed-systems or cloud infrastructure engineer who wants to grow into MLOps.

Senior level · 4+ years · New York-Newark-Jersey City, NY-NJ-PA · Full-time

Quick apply — this platform usually takes a CV and a few fields.

Must have (4)
PythonTypeScriptAWSPostgreSQL
Nice to have (2)
vLLM, Sglang or TensorrtKubernetes

“or” means any one of them counts — you don't need all of them.

Posted 2 times — it's one opening, so apply once.

We read this from the posting text with AI. Skim the description below before ruling yourself out.

How this req sits in the market our data

Roughly 2,150 people in the New York-Newark-Jersey City, NY-NJ-PA area plausibly meet what this posting asks for (software developers). range 1,600–2,800

Applicant volume Moderate — A normal amount of company. The rare requirements below are what will separate a shortlisted application from the rest.

What won't set you apart
Python51%

Most people in this occupation already list these. Still required — just not what gets you shortlisted.

What the occupation pays Median $170,499 (middle half $133,523–$210,499).

Estimated from BLS employment for this occupation and area, per-skill prevalence across our listing corpus, and published wage benchmarks — as of Jul 29, 2026. It is a model, not a headcount.

Why we read it this way (5)

The role is titled 'Sr. ML Infrastructure Engineer' but the JD explicitly states prior ML ops/infra experience is not required — the core gate is distributed systems and cloud infrastructure engineering, which is why this is classified as Software Developers (15-1252) rather than a pure ops/admin role.

The alt SOC 15-1244 (Network and Computer Systems Administrators) is noted as a runner-up given the infrastructure operations emphasis, but the JD's focus on architecting and building pipelines and systems from scratch points more strongly to 15-1252.

Inference engines (vLLM, SGLang, TensorRT) and Kubernetes are listed under 'Nice to have' and are marked preferred accordingly.

No compensation figures are provided in the posting.

The role requires 4 days/week in the Hudson Square (New York City) office; it is not fully remote.

Read the full posting

The employer publishes the full description on their own site — read it there ↗. Or sign in to read it here — it's free, and it also lets you track this application.

Apply

Apply on employer site ↗