Azure Databricks Solution Architect

Role: Azure Databricks Solution Architect Milton Keynes, UK Contract & Hybrid model Job Description Seeking an experienced Azure Databricks Solution Architect to design, develop, architect, and deliver scalable cloud-native data platforms on Azure. The role requires strong expertise in Azure Databricks, PySpark, Delta Lake, Azure Data Factory, Azure Synapse Analytics, and enterprise data engineering, coupled with solution architecture and technical leadership capabilities. Key Responsibilities • Design and develop scalable data pipelines using Databricks for ETL processing across diverse data sources • Build and optimise large-scale data workflows using PySpark and Python • Ensure performance tuning, debugging, and optimisation of data pipelines • Collaborate with cross-functional teams to enable data integration and analytics solutions • Support implementation of data lake architectures leveraging Delta Lake and cloud platforms • Knowledge of CI/CD practices and Agile delivery models • Strong analytical and problem-solving capabilities Experience Requirements • Relevant experience in data engineering with strong exposure to Databricks and PySpark • Proven ability to handle large-scale structured and unstructured data pipelines • Experience working in cloud environments, preferably Azure • Exposure to performance optimisation and scalable data processing architectures Key Competencies • Solution Architecture • Databricks – Data Engineering • Azure Data Factory • Stakeholder Management • Technical Leadership • Agile Delivery • Problem Solving & Innovation Certification (Good to Have) • Databricks Developer / Data Engineering certifications • Azure Data Engineering certifications