Senior Data Engineer (Palantir)

This role supports OEIS compliance reporting by building auditable, Foundry native data pipelines and data checker frameworks. The engineer will be responsible for compliance transformations, validation logic, and traceable outputs that meet regulatory and audit requirements. Core Responsibilities: Design and maintain Palantir Foundry pipelines for OEIS compliance reporting Build and maintain data checker/validation frameworks within Foundry Develop PySpark and Spark SQL transformations for large scale datasets Implement compliance driven checks (completeness, consistency, reconciliation, exception flags) Ensure full data lineage, auditability, and reproducibility of compliance datasets Partner with compliance SMEs and stakeholders to validate logic and reporting outputs Support operational monitoring, issue triage, and data quality remediation Required Technical Skills Required Skills: Strong Python PySpark / Spark SQL Advanced SQL Hands on experience with Palantir Foundry Experience building data validation, QA, or data quality frameworks Understanding of compliance, audit, or regulatory reporting requirements Preferred / Nice to Have