Secret Incident Response/Data Pipeline Engineer

Title: Secret Incident Response/Data Pipeline Engineer Hybrid: DC or NY Contract: W2 Ongoing 3 years Pay: $55-$90 per hour Required Skills & Experience • Active DoD Secret Security Clearance or higher • 5–10+ years of experience in incident response, site reliability, application support, or data engineering environments • Strong hands-on experience with data pipelines, ETL/ELT processes, and distributed data systems • Strong coding experience in Python, with PySpark highly preferred • Familiarity with debugging and optimizing Spark-based pipelines, including handling memory issues (e.g., OOM errors) • Experience performing root cause analysis and documenting production incidents • Understanding of relational databases, data ingestion patterns, and dataframe manipulation • Basic knowledge of networking concepts and REST APIs (for troubleshooting external data sources) Nice to Have Skills & Experience • Experience with Palantir Foundry or similar data platforms • Experience with distributed compute frameworks and large-scale data processing • Familiarity with visual ETL or pipeline tools (e.g., Microsoft Fabric, Informatica, Dataiku, etc.) • Prior experience supporting customer-facing data platforms or products • Background in government, defense, or cleared environments Job Description Insight Global is seeking a Data Pipeline Engineer to support Palantir Foundry implementations for U.S. Government customers. This role is a hybrid Data Engineer / Software Engineer / Incident Response position focused heavily on maintaining the health and reliability of production data pipelines across multiple customer environments. The day-to-day work is predominantly incident-driven, with engineers spending the majority of their time responding to data health failures, debugging pipeline issues, and identifying root causes across complex, large-scale data systems. While some development work is involved, it is primarily focused on patching, optimizing, and refactoring existing pipelines rather than building net-new solutions. This individual will support hundreds of pipelines across multiple customer stacks and must be comfortable navigating unfamiliar systems, diagnosing issues quickly, and collaborating with internal teams, data providers, and government stakeholders. Success in this role requires strong problem-solving skills, comfort working in production environments, and the ability to take ownership of incidents end-to-end. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.