Data Engineer

Data Engineer (Inside IR35) £425 Per day SC Cleared - A must to be considered for this opportunity London To support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data is dispersed across multiple systems with inconsistent formats and limited automation. A Data Engineer will play a key role in designing and implementing the pipelines, architecture, and tooling required to enable reliable data ingestion, transformation, and delivery. Key Responsibilities • Design, build, and maintain scalable data pipelines to ingest, transform, and store data from multiple sources. • Develop and manage data models, schemas, and metadata to support analytics and reporting needs. • Collaborate with Data Analysts, Data Scientists, and Business Analysts to ensure data availability, accessibility, and usability. • Implement data quality checks, validation routines, and monitoring to ensure data integrity and reliability. • Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). • Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). • Ensure adherence to data governance, security, and privacy policies. • Document data architecture, pipelines, and processes to support transparency and knowledge sharing. • Contribute to the development of a modern data platform that supports both real-time and batch processing.