Data Engineer

Key Responsibilities • Design and implement scalable data transformation and integration solutions using SQL based and programmatic patterns. • Strong experience building data pipelines, manipulating data, and working with coding (PySpark/ SQL), version control • Build and maintain batch data pipelines using Python and cloud native execution models. • Implement incremental data loading, idempotent processing, and recovery patterns to support reliable data refreshes. • Establish and manage control structures such as watermarks, run metadata, and monitoring. • Work across cloud environments (AWS and/or Azure) to enable secure and efficient data movement. • Contribute to the design and implementation of strategic data platform solutions, including Palantir Foundry, following delivery of tactical solutions. • Collaborate with data architects to ensure alignment between near term delivery and long term platform direction. • Support data quality validation, reconciliation, operational readiness, and production support. • Produce clear technical documentation and contribute to standards, best practices, and knowledge sharing. Skills & Experience • Strong experience with SQL and relational databases (e.g. PostgreSQL). • Hands on experience with Python for data processing and orchestration. • Experience working with cloud platforms (AWS and/or Azure). • Practical understanding of incremental loading, data quality, and operational resilience patterns. • Experience with, or strong exposure to, Palantir Foundry (pipelines, data integration, transformations, or ontology concepts). • Comfortable working in regulated or public sector environments. • Proven ability to deliver under time bound and evolving requirements.