Opus Recruitment Solutions

Senior Data Engineer

⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Senior Data Engineer on a major Liquidity Reporting programme, focused on Databricks and PySpark. Contract length is unspecified, with a pay rate of £450-£550 per day. Key skills include Azure experience, code quality leadership, and regulatory reporting knowledge.
🌎 - Country
United Kingdom
💱 - Currency
£ GBP
-
💰 - Day rate
592
-
🗓️ - Date
June 11, 2026
🕒 - Duration
Unknown
-
🏝️ - Location
Hybrid
-
📄 - Contract
Outside IR35
-
🔒 - Security
Unknown
-
📍 - Location detailed
London Area, United Kingdom
-
🧠 - Skills detailed
#Spark (Apache Spark) #Data Engineering #"ETL (Extract #Transform #Load)" #Libraries #Data Ingestion #Leadership #Code Reviews #Azure #Metadata #Databricks #PySpark #Scala
Role description
We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks-based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: • Strong experience with Databricks and PySpark • Solid Azure data platform experience • Proven ability to build reusable frameworks and libraries • Experience leading code quality and working with offshore teams Desirable: • Experience in regulatory reporting or financial services • Exposure to Tagetik or similar reporting tools • Knowledge of metadata-driven or configurable data models This is an opportunity to play a key role in a large-scale data transformation programme with a strong focus on engineering best practice and regulatory delivery. Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London