Senior Data Engineer

Data Engineer (Azure | Databricks | ETL Pipelines) Contract | Remote | UK Public Sector Project Ceox Services are seeking a Data Engineer to support delivery of key data components within our evolving data ecosystem. This role will work closely with architects, analysts, engineers, and wider delivery teams to implement pipeline builds, data models, and integration patterns aligned to the organisation’s new Target Operating Model for Data .You will contribute to the development of scalable dataflows, optimise ingestion & transformation activities, and ensure solutions meet technical standards, performance expectations, and security controls. This is a hands-on engineering role ideal for someone who enjoys building, shaping, and improving modern data platforms . Who We’re Looking F orA highly capable Data Engineer with hands-on experience building ETL pipelines, implementing Data Lake + Delta architectures, and working across Azure platform services. You will need strong problem-solving ability, a solid engineering mindset, and the ability to work collaboratively within a multi-disciplinary tea m.If you’re confident writing production-grade code, applying design patterns, and building scalable, high-performing data products, this role offers technical autonomy, ownership, and challeng e. Key Responsibilit • iesBuild and maintain physical data models, ETL pipelines and code in cloud data platfor • ms.Support ingestion activity and onboarding of new data sourc • es.Assist in design, development and deployment of Azure platform services (Fabric, Synapse, ADL • S).Work with Databricks, Delta Lake, Unity Catalogue, Delta Share for dataflows and collaborati • on.Construct curated, raw and refined data layers; catalogue assets appropriate • ly.Validate solutions against functional and non-functional requiremen • ts.Deliver datasets, transformations and performance-optimised data produc • ts.Improve processes, engineering patterns, and reusable tooli • ng.Monitor and measure pipeline performance; support incident resoluti • on.Ensure documentation meets acceptance standards and is approved central • ly.Actively engage in Agile ceremonies and governance foru ms. Mandatory Requirem • entsStrong experience with Python, PySpark & SQL for data engineer • ing.Hands-on experience with Azure Databri • cks.Strong knowledge of Fabric, Synapse, ADF & ADLS for ETL pipeli • nes.Experience with Delta Lake, Parquet FS, Unity Catalogue & MS Purv • iew.Familiarity with Event-driven data ingestion (Event Grid / Pub-S • ub).Understanding of SOLID principles, Async programming, Mediator/Factory patte • rns.Experience delivering unit + integration testing in Databri • cks.Knowledge of Secure ETL design with Entra IMID/SCIM integrat • ion.Understanding of Azure best practice, APIM, and platform governa • nce.Ability to build and serve Power BI models via Databricks data sour ces. Desi • rablePrior experience working within UK Public Sector environm ents. Soft • SkillsStrong stakeholder communication and cross-team collabor • ation.Analytical and solution-focused mi • ndset.Able to work independently, take ownership and drive pro • gress.Commitment to clean, scalable, well-documented engine • ering.Adaptable, proactive, and comfortable working in dynamic delivery environ ments. Contract • DetailsContract Type: Freelance / C • ontractLocation: Remote (UK-based candidates pre • ferred)Start Dat • e: ASAPClearance: Candidates must be eligible to work with UK Government departments / BPSS.