Technical Lead – Azure Databricks Data Platform

Contract Role: Technical Lead – Azure Databricks Data Platform Contract Location: London Hybrid Contract Duration: 6 months Contract Start Date: Immediate Contract Classification: Inside IR35 Daily Rate breakdown Traditional Daily Rate: £700 Agreed Contract Rate (ACR): £540.09 Equivalent Annual Salary: £140,424.06 Payroll provider: Rockford Payroll Info for Contingent Workers - Rockford Pay Overview: We are seeking a highly experienced Technical Lead with deep expertise in the Azure Data Platform and Databricks ecosystem. The ideal candidate should have strong hands-on experience with Structured Streaming, Delta Live Tables (DLT), PySpark architecture, Python, and SQL, and a proven track record of delivering large-scale enterprise data platforms. Key Responsibilities • Leading the design, development, and implementation of scalable, high-performance data solutions on Azure and Databricks. • Defining and driving data strategy, data governance, data quality, and platform best practices. • Optimising platform runtime performance and managing overall cloud costs, with a strong focus on Databricks streaming workloads. • Providing end-to-end technical leadership, from solution architecture through delivery and production support. • Collaborating with business stakeholders to understand requirements and translate them into robust technical solutions. • Demonstrating strong ownership, accountability, and stakeholder management skills. Essential Skills & Experience • Strong hands-on experience with Structured Streaming, Delta Live Tables (DLT), PySpark architecture, Python, and SQL, and a proven track record of delivering large-scale enterprise data platforms • Experience within the financial trading domain, including knowledge of trading data models and related business processes • Ability to drive technical decision-making, mentoring engineering teams, and ensuring successful delivery of business outcomes. • Excellent communication skills, strong leadership capabilities, and the ability to influence technical direction while delivering complex data solutions from concept to implementation.