Secret Data Engineer - Apache & NiFi at Insight Global
Hanahan, SC
—
Jul 9, 2026
Hanahan, SC
Jul 21, 2026
What this job asks for AI summary
A data engineering role focused on tactical network data pipelines for a federal program, requiring a Secret clearance. Day-to-day work involves building and maintaining ETL pipelines, designing data architectures such as data lakes and warehouses, and developing infrastructure-as-code and automated deployment tooling. The role suits engineers with hands-on experience in Apache Kafka, NiFi, containerization, and open-source observability and storage technologies.
Mid level · 3+ years · Charleston-North Charleston, SC · Secret clearance
“or” means any one of them counts — you don't need all of them.
We read this from the posting text with AI. Skim the description below before ruling yourself out.
How this req sits in the market our data
Rare in this occupation — lead with these, and say what you built with them.
What the occupation pays Median $132,491 (middle half $104,499–$170,233).
Estimated from BLS employment for this occupation and area, per-skill prevalence across our listing corpus, and published wage benchmarks — as of Jul 28, 2026. It is a model, not a headcount.
Why we read it this way (8)
The posting lists a 3–5 year experience range in the main Skills and Requirements block, then separately lists '5+ years of experience in data engineering roles' further down in what appears to be a secondary or extended requirements section. The lower bound of 3 years is used for the overall years minimum as the primary gate; the 5+ figure is noted here for reference.
Secret clearance is explicitly required ('Possession of and the ability to maintain a Secret Security Clearance').
A Bachelor's degree is listed as 'preferred or equivalent experience' in one line, then restated as a flat requirement in the next line — the 'or equivalent experience' qualifier in the first mention is treated as controlling, so the degree requirement is set to None.
Docker and Kubernetes are listed together as 'highly valued' (preferred), not as hard gates. They are listed as separate skills given they are distinct technologies, but both are marked preferred.
The Grafana LGTM+ Stack and Elastic (ELK) Stack, Nginx/Apache APISIX, Postgres/Redis/MinIO, and CI/CD tools all appear in the Skills and Requirements section without explicit 'required' framing and are listed alongside clearly preferred items — they are treated as preferred given the mixed, list-style presentation and the absence of firm gating language.
Apache Kafka and Apache NiFi are called out explicitly in the job title framing and the opening paragraph as the core experience sought, and are repeated in the requirements list — treated as hard gates.
This role is classified primarily as a Database/Data Architect (15-1243) given the emphasis on designing data pipelines, ETL architecture, data lakes/warehouses, and data infrastructure. Software Developers (15-1252) is a reasonable runner-up given the scripting, CI/CD, and IaC responsibilities.
Requires a Secret clearance — the cleared population is a small fraction of this occupation, so the real candidate pool is materially smaller than the estimate below, which does not model clearance.
Read the full posting
The employer publishes the full description on their own site — read it there ↗. Or sign in to read it here — it's free, and it also lets you track this application.