Data Engineer

Lead Data Engineer (Databricks), 3 month contract, £600 p/d (outside IR35), remote We’re working with a major delivery partner on a high‑impact government data programme and are looking for an experienced Lead Data Engineer to help shape and standardise data product onboarding across a large‑scale data platform. This role is ideal for someone who thrives in Databricks, enjoys setting technical direction, and can deliver high‑quality solutions at pace. You’ll lead the design and validation of Databricks workspaces, develop a repeatable migration framework, and embed best practice for ingestion, transformation and serving using the Medallion Architecture. You’ll also guide governance setup through Unity Catalog and support integration with Microsoft Purview, working closely with internal engineering teams to ensure alignment with established data standards. What You’ll Do • Validate and configure Databricks workspaces across Dev, Test and Prod • Build best‑practice templates for onboarding data products • Deliver ingestion, transformation and serving pipelines using Medallion principles • Implement Unity Catalog for governance, lineage and metadata management What You’ll Bring • Strong experience delivering Databricks solutions at scale • Solid Azure Data Platform knowledge (ADLS, networking, security) • Expertise in PySpark, Delta Lake and Databricks SQL • Hands‑on experience with Medallion Architecture and Unity Catalog If this sounds like something that would interest you, please apply or send your CV directly to myself at Hollie.beattie@Adeptapartners.com