Data Engineer

Data Engineer (SC / NPPV Clearance) - Contract - Hybrid/London - £competitive Synergize Consulting are now hiring for a Data Engineer to work at a leading consultancy client on a contract basis. The successful candidate will support the development of secure, scalable and reliable data engineering solutions within a complex operational environment on behalf of a public sector body, working on pipelines that enable data to be securely processed, mapped and made available for downstream analysis and intelligence use. Responsibilities include: • Designing, developing and maintaining data ingestion and ETL/ELT pipelines. • Developing robust Python-based data engineering solutions. • Profiling, transforming and validating structured and semi-structured data. • Working with XML and JSON data and developing schema mapping and transformation processes. • Implementing data conversion and integration routes to support the movement of data between systems. • Developing and supporting data pipelines within secure environments. • Developing synthetic data to support testing, development and integration activities. • Building automation to improve data processing and engineering workflows. • Supporting the testing and validation of data pipelines and integrations. Experience required: • A solid background in data engineering and pipeline development. • Strong, hands-on Python development experience. • Experience developing ETL/ELT, ingestion or data integration pipelines. • Experience with data transformation, including XML and JSON. • Experience with Elasticsearch and/or Kibana. • Previous experience of working within a highly regulated environment, for example the public sector or areas of law enforcement. • Understanding of data profiling, validation and quality. • Experience implementing data ingestion, conversion and integration processes. • Experience supporting testing and development through synthetic data generation. • Ability to work effectively across technical and operational teams. • Strong communication skills, both written and verbal • Due to the nature of the client, it would be an advantage for candidates to hold, or be eligible and willing to undergo, a certain level of security clearance (SC / NPPV3) If you are looking to take the next exciting step in your IT career, please send in your CV for immediate consideration.