Principal AI Ops Engineer
RxSense
$190,000–$225,000from the description
Jul 12, 2026
—
Jul 21, 2026
What this job asks for AI summary
A hands-on platform engineering role focused on building and owning the shared AI infrastructure that all AI-powered products at the company depend on. Day-to-day work spans CI/CD pipelines for AI services, production agent runtime, LLM API key management and cost attribution, self-hosted model serving, eval frameworks gating deployments, and a shared developer harness for prompt management and model routing. Best suited to a senior engineer with a strong background in both platform/infrastructure work and production LLM systems.
Senior level · 6+ years · Remote · Full-time
Advertised as Principal, but the requirements read as Senior.
“or” means any one of them counts — you don't need all of them.
We read this from the posting text with AI. Skim the description below before ruling yourself out.
How this req sits in the market our data
Roughly 16,500 people nationally plausibly meet what this posting asks for (software developers). range 6,900–24,700
Applicant volume Moderate — A normal amount of company. The rare requirements below are what will separate a shortlisted application from the rest.
Most people in this occupation already list these. Still required — just not what gets you shortlisted.
What the occupation pays Median $138,970 (middle half $107,524–$175,762). This posting is about at that midpoint.
Estimated from BLS employment for this occupation and area, per-skill prevalence across our listing corpus, and published wage benchmarks — as of Jul 28, 2026. It is a model, not a headcount.
Why we read it this way (7)
The title says 'Principal' but the actual scope — 6+ years required, a single-team platform role reporting to a Director — is consistent with a Senior individual contributor. The 'Principal' label appears to be a title choice rather than an org-wide technical authority designation, so seniority is assessed as Senior.
The JD accepts a BS or equivalent technical experience in lieu of a degree, so no minimum degree is hard-gated.
AI/ML infrastructure experience is stated as 'at least 2 years' within the 6+ year overall requirement; the years demanded on that skill reflects the explicit 2-year sub-requirement.
Python and TypeScript are listed together as a required coding fluency ('ideally both'); Python is named first and is the primary language of the AI stack, with TypeScript as the named alternative.
Anthropic API, OpenAI API, vLLM/TGI/SGLang, LangGraph/Claude Agent SDK, .NET, Kubernetes operator experience, and Agile/Scrum/Kanban all appear under the 'Bonus Qualifications' section and are treated as preferred.
Self-hosted model serving and eval framework experience are described as core responsibilities but no specific named tool is required for them in the required-qualifications section; the specific tools (vLLM, TGI, SGLang) appear only under Bonus Qualifications.
Caller marked this a fully-remote role — scored against the national candidate pool.
Read the full posting
The employer publishes the full description on their own site — read it there ↗. Or sign in to read it here — it's free, and it also lets you track this application.