Senior Data Engineer – Databricks (Delta Live Tables)

Senior Data Engineer – Databricks (Delta Live Tables) A global risk consulting firm is supporting multiple enterprise clients due to a sustained increase in delivery demand and fully utilised permanent teams. We are seeking a senior, delivery-led Data Engineer to join as an associate, focused on building production-grade data pipelines using Databricks with deep, hands-on Delta Live Tables (DLT) experience. This is a hands-on build role. It is not discovery, not architecture-only, and not BI-led. Assignment Details • Initial Duration: 3-6 months (MVP delivery, extensions possible) • Location: London, UK (1–2 days per week on site) • Engagement: Associate / Contract • IR35 Status: Outside IR35. Day Rate: Competitive, aligned to deep Databricks DLT experience • Start Date: ASAP / February 2026 The role covers the full lifecycle: • Sourcing data from APIs and non-API sources • Engineering and productionising pipelines in Databricks using DLT • Delivering curated datasets for downstream Power BI consumption • Producing clear documentation and completing a clean handover to internal data teams You will operate independently, engage confidently with stakeholders across the business, and deliver a solution that can be owned internally once the engagement ends. Mandatory Experience(Non-Negotiable) • Senior Data Engineer with proven experience owning end-to-end delivery in enterprise environments • Deep, hands-on Delta Live Tables (DLT) experience in production – candidates must be able to demonstrate real-world use of DLT for orchestration, data quality, and pipeline management (not PoCs or theoretical exposure) • Expert-level Databricks experience for reporting pipelines, including: • Medallion architecture (Bronze / Silver / Gold) • CI/CD, DevOps practices, and environment promotion • Strong experience integrating complex or poorly documented APIs • Proven ability to automate manual data sources where APIs are unavailable (e.g. SharePoint and Excel ingestion) • Comfortable working independently, proactively engaging stakeholders across the business to resolve ambiguity • Strong documentation and handover discipline, with experience transitioning solutions to internal data teams Desirable (Secondary) • Prior Power BI exposure (analyst provided for dashboarding) • Experience in regulated or large enterprise environments Important Context • This is not a BI or dashboard developer role • This is not a junior or supported position • Candidates without demonstrable, production Delta Live Tables experience should not apply If you are a senior Databricks Data Engineer with genuine, hands-on Delta Live Tables delivery experience and can operate autonomously in a fast-moving enterprise environment, please get in touch.