GIOS Technology
Lead Azure Databricks Data Engineer (Databricks, ADF, Python) – Reinsurance / Lloyd’s Market
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Lead Azure Databricks Data Engineer in Manchester, UK, with a contract length of "unknown" and a pay rate of "unknown." Key skills include Azure, Databricks, PySpark, and experience in the reinsurance sector.
🌎 - Country
United Kingdom
💱 - Currency
£ GBP
-
💰 - Day rate
Unknown
-
🗓️ - Date
February 25, 2026
🕒 - Duration
Unknown
-
🏝️ - Location
Hybrid
-
📄 - Contract
Unknown
-
🔒 - Security
Unknown
-
📍 - Location detailed
Manchester, England, United Kingdom
-
🧠 - Skills detailed
#Vault #Data Governance #Azure Databricks #Delta Lake #SQL (Structured Query Language) #Azure #ADF (Azure Data Factory) #Cloud #Data Lake #Databricks #Data Pipeline #Security #Azure DevOps #Scala #DevOps #Spark SQL #PySpark #Automation #Spark (Apache Spark) #Python #Data Engineering #Leadership
Role description
I am hiring for Lead Azure Databricks Engineer - (ADF/Data Lake/Key Vault/Azure Functions/Databricks/Python/PySpark/Reinsurance)
Location: Manchester, UK (2 days onsite per week)
Job Description:
• Lead the design, development, and optimisation of enterprise-scale data platforms using Azure Data Services and Databricks.
• Build and manage scalable data pipelines using PySpark, Spark SQL, Delta Lake, and Lakehouse architecture.
• Collaborate with underwriting, actuarial, finance, risk, and reinsurance teams to deliver solutions aligned to Lloyd’s of London regulatory requirements.
• Implement data governance, lineage, security controls, and cloud best practices across the data platform.
• Drive CI/CD, automation, performance tuning, and cost optimisation using Azure DevOps and cloud-native engineering patterns.
• Provide hands-on technical leadership, mentoring engineers, and resolving complex data engineering challenges end-to-end.
Key Skills:
Azure, Databricks, PySpark, SparkSQL, Python, DeltaLake, AzureDataFactory, AzureDataLake, AzureFunctions, KeyVault, UnityCatalog, Lakehouse, MedallionArchitecture, DataGovernance, CI/CD, AzureDevOps, DataModelling, CloudSecurity, FinOps, LloydsMarket
I am hiring for Lead Azure Databricks Engineer - (ADF/Data Lake/Key Vault/Azure Functions/Databricks/Python/PySpark/Reinsurance)
Location: Manchester, UK (2 days onsite per week)
Job Description:
• Lead the design, development, and optimisation of enterprise-scale data platforms using Azure Data Services and Databricks.
• Build and manage scalable data pipelines using PySpark, Spark SQL, Delta Lake, and Lakehouse architecture.
• Collaborate with underwriting, actuarial, finance, risk, and reinsurance teams to deliver solutions aligned to Lloyd’s of London regulatory requirements.
• Implement data governance, lineage, security controls, and cloud best practices across the data platform.
• Drive CI/CD, automation, performance tuning, and cost optimisation using Azure DevOps and cloud-native engineering patterns.
• Provide hands-on technical leadership, mentoring engineers, and resolving complex data engineering challenges end-to-end.
Key Skills:
Azure, Databricks, PySpark, SparkSQL, Python, DeltaLake, AzureDataFactory, AzureDataLake, AzureFunctions, KeyVault, UnityCatalog, Lakehouse, MedallionArchitecture, DataGovernance, CI/CD, AzureDevOps, DataModelling, CloudSecurity, FinOps, LloydsMarket
