System Architect - AI Reliability Engineer at Virtusa
New York, NY
—
Jun 28, 2026
New York, NY
Jul 20, 2026
What this job asks for AI summary
This role focuses on building and maintaining reliability infrastructure for production AI agents — including automated evaluation frameworks, an LLM-as-judge system, adversarial and red-team testing, and multi-agent chain tests. The engineer integrates these checks into CI/CD pipelines with cost regression, observability instrumentation, and audit logging. It suits an experienced architect with a background in production support and AI system validation.
Senior level · New York-Newark-Jersey City, NY-NJ-PA · Full-time
We read this from the posting text with AI. Skim the description below before ruling yourself out.
How this req sits in the market our data
Roughly 1,550 people in the New York-Newark-Jersey City, NY-NJ-PA area plausibly meet what this posting asks for (software developers). range 640–2,300
Applicant volume Moderate — A normal amount of company. The rare requirements below are what will separate a shortlisted application from the rest.
Most people in this occupation already list these. Still required — just not what gets you shortlisted.
What the occupation pays Median $166,830 (middle half $130,650–$205,970).
Estimated from BLS employment for this occupation and area, per-skill prevalence across our listing corpus, and published wage benchmarks — as of Jul 28, 2026. It is a model, not a headcount.
Why we read it this way (7)
The title 'System Architect - AI Reliability Engineer' carries no standard seniority level word, so advertised seniority is Unspecified; the scope and responsibilities (production architecture, team leadership, senior management reporting) support a Senior classification.
The role sits at the intersection of AI/ML evaluation engineering and software development (building evaluation harnesses, CI pipelines, observability tooling). 15-1252 Software Developers was chosen as the primary SOC because the core deliverables are building and shipping automated systems; 15-1299 (Computer Occupations, All Other) is the runner-up given the novel 'AI Reliability Engineer' framing that doesn't map cleanly to any single standard occupation.
Skills were extracted from the detailed responsibilities section, which functions as the de facto requirements block. No explicit 'Required' vs. 'Nice to have' sections are present, so skills central to the stated deliverables are marked required and more peripheral/specific tooling (MCP, canary deployments, drift detection) are marked preferred.
MCP (Model Context Protocol) appears as a specific multi-agent communication mechanism mentioned in context; it is marked preferred as it is a narrow implementation detail rather than a gating requirement.
No compensation range is stated in the posting.
No minimum years of experience is explicitly stated at the role level.
Ignored 2 non-technology phrase(s) as skills (responsibilities/concepts, not named tools): AI agent evaluation frameworks, prompt injection / adversarial testing.
Read the full posting
The employer publishes the full description on their own site — read it there ↗. Or sign in to read it here — it's free, and it also lets you track this application.