Lead Data Engineer – Azure & Databricks_ Nottingham, Hybrid (Lead I - Data Engineering)

Role Description Lead Data Engineer – Azure & Databricks Nottingham (Hybrid – 3 days onsite) Start: July 2026 Employment Type: Permanent / Fixed Term We are seeking a Lead Data Engineer to play a critical role in designing and delivering enterprise-scale data platforms that power advanced analytics and business decision-making. This is an opportunity to lead from the front, shaping modern data architecture, building scalable data pipelines, and mentoring talented engineering teams within a cloud-first, data-driven environment. You will work closely with architects, data scientists, and senior stakeholders to deliver secure, high-performing data solutions aligned to strategic business outcomes. What You’ll Be Doing • Lead the design and delivery of scalable data platforms using Azure and Databricks • Architect and build batch and real-time data pipelines leveraging distributed processing frameworks • Develop and optimise ETL/ELT pipelines, data ingestion frameworks, and orchestration workflows • Drive adoption of Lakehouse architecture, Delta Lake, and modern data modelling practices • Implement robust data governance, quality, and performance optimisation strategies • Collaborate with cross-functional teams to translate business needs into technical solutions • Champion engineering excellence through code reviews, best practices, and reusable frameworks • Mentor and guide engineers, helping to build high-performing, scalable teams • Lead the implementation of CI/CD pipelines, DevOps practices, and Infrastructure as Code What You’ll Bring • Extensive experience in data engineering and cloud-based data platform delivery • Strong hands-on expertise with: • Databricks, PySpark, Spark SQL • Python and/or Scala • Real-time technologies such as Kafka / Event streaming platforms • Deep knowledge of Microsoft Azure services, including: • Azure Data Factory (ADF), ADLS, Synapse Analytics • Azure Functions, Event Hub • Proven experience designing large-scale, enterprise-grade data solutions • Strong understanding of: • Data warehousing, Lakehouse architecture, Delta Lake • Data modelling, governance, and quality frameworks • Experience with DevOps, CI/CD, and Infrastructure as Code (e.g. Azure DevOps, Git, Terraform) • A collaborative mindset with the ability to engage and influence technical and non-technical stakeholders Hurry & apply for a more detailed conversation! #UST Skills data engineering,microsoft azure services,azure platform,cloud computing,