Data Engineer – Azure Databricks / Python / Insurance - Outside IR35 - Remote - 2-3 Month Contract

Data Engineer / Data Engineering / Azure / Databricks / Ingestion / Pipelines / Insurance / Financial Services / 2-3 month contract / Outside IR35 / Fully remote One of our leading clients is looking to recruit a Data Engineer. Location – fully remote / home based Duration – 2-3 months plus possible extension Outside IR35 Role / Responsibilities: • Define and build a data lake architecture on Azure (ADLS + Databricks) • Implement layered data model (bronze / silver / gold) for ingestion, processing, and reporting • Develop ingestion patterns from API sources (batch and streaming) • Establish data governance, metadata, and access controls • Define storage structures, naming conventions, and schema design • Develop API connectors and ingestion pipelines using Python • Implement integration services feeding into the Databricks environment • Build data transformation logic using PySpark / Python (data cleansing, standardisation, validation) • Configure monitoring, logging, and alerting • Execute unit and integration testing across pipelines Experience: • Azure • Databricks • Python • Financial Services sector experience – Ideally Insurance / General or Life Insurance