Interim Lead Data Engineer

Lead Data Engineer – Platform Reset & Build Location: North London (hybrid) Contract: Interim Rate:£800 per day (outside IR35) A North London–based organisation is seeking an Interim Lead Data Engineer to reset the data engineering function and build a new, best-in-class data engineering capability. This role is for a hands-on engineering leader. You will not be inheriting a greenfield environment, nor simply “running what exists”. The mandate is to review, fix, and rebuild data pipelines, engineering standards, and ways of working. The Role You will take ownership of the data engineering layer end to end, setting direction while remaining close to the code. The role combines technical depth, engineering leadership, and delivery discipline. Key responsibilities include: • Reviewing the current data engineering landscape and identifying structural weaknesses • Resetting and rebuilding data pipelines, orchestration, and transformation layers • Implementing engineering best practices across quality, testing, monitoring, CI/CD, and deployment • Defining standards for scalability, reliability, performance, and cost control • Working closely with data architects and stakeholders to translate designs into working pipelines • Leading by example, remaining hands-on where needed to unblock delivery • Uplifting the capability of existing engineers through clear standards and coaching Required Experience • Proven experience as a Lead or Principal Data Engineer on complex data platforms • Strong background in resetting or remediating underperforming data estates • Deep experience with modern cloud data engineering stacks (Azure preferred) • Strong SQL, Python and data transformation experience • Experience implementing engineering best practices rather than just delivering pipelines • Confident communicator able to explain technical decisions to non-technical stakeholders Why This Role • Genuine mandate to fix and rebuild, not patch • High visibility and real ownership over the data engineering function • Opportunity to leave behind a sustainable, well-run engineering platform