Data Engineer ( NPPV3 )

Senior Data Engineer ( NPPV3 ) Location: Fully Remote (UK) Security Clearance: NPPV3 required (or eligible) Contract Type: Outside IR35 Rate: Competitive (DOE) Start: ASAP / Flexible Overview We’re supporting a leading consultancy client delivering complex data platform and analytics programmes across regulated and public-sector environments. They’re looking to engage an experienced Senior Data Engineer to help design, build and scale modern cloud data platforms on Azure, with a strong focus on Databricks and modern lakehouse patterns. This is a hands-on delivery role within multi-disciplinary teams, supporting clients moving from legacy or fragmented data estates towards scalable, cloud-native platforms. Key Responsibilities • Design and build robust, scalable data pipelines and platforms on Microsoft Azure • Lead hands-on delivery using Databricks (PySpark / Spark SQL) for data engineering and transformation workloads • Develop and maintain ingestion frameworks (batch and streaming) from a variety of source systems • Contribute to lakehouse architecture patterns using ADLS Gen2, Delta Lake, and modern data modelling approaches • Work closely with solution architects, analytics engineers and stakeholders to translate requirements into technical solutions • Champion data quality, reliability, performance and security best practices • Support CI/CD, automation and infrastructure-as-code approaches within data engineering workflows • Provide technical leadership and mentoring within delivery teams where appropriate Required Skills & Experience • Strong commercial experience as a Senior Data Engineer on Azure • Proven hands-on delivery with Databricks (PySpark, Spark SQL, Delta Lake) • Experience with core Azure services such as: • Azure Data Lake Storage (ADLS Gen2) • Azure Data Factory / Synapse Pipelines • Azure DevOps (or similar CI/CD tooling) • Strong SQL and data modelling experience • Experience building production-grade data pipelines (batch and/or streaming) • Comfortable working in agile delivery teams within consultancy or complex enterprise environments Desirable • Experience working in public sector or regulated environments • Familiarity with lakehouse architectures and modern data platform patterns • Exposure to data governance, security and platform best practice • Experience operating in environments requiring NPPV3 or similar clearance Clearance • Active NPPV3 clearance is required (or candidates must be eligible and willing to go through the process).