AI Data Engineer (Azure)

Job Title: AI Data Engineer (Azure) Location: London Hybrid. Travel to the London office 2 days a week Duration: 6 months Contract Start Date: ASAP Deloitte Working with the Deloitte Associate (Contractor) Programme means we can offer you the opportunity to work on a variation of industry and client related projects. Our aim is to retain the best talent and so when your project end date nears our team of Talent Community Advisors will be working with you to look at alternative projects within the firm that suit your experience should you wish to continue with Deloitte. The Role We are looking for a highly skilled AI Data Engineer (Contractor) specialising in Azure to join our Digital Innovation team, supporting cutting-edge data and analytics use cases across Tax & Legal. This role is ideal for someone who combines strong AI/GenAI data pipeline expertise with hands-on Azure, data discovery and analysis. You will be comfortable working with unstructured data and modern Azure-native architectures. You will play a key role in transforming complex datasets into meaningful insights, working closely with Tax domain specialists to understand requirements, shape solutions, and clearly present outputs that drive business value. We're looking for a strong communicator with problem solving skills who can bridge technical data engineering and business understanding. A proactive, delivery-focused engineers who is comfortable working at pace. Deliverables: Responsibilities but not limited to: 1. Data Engineering & Azure Platform Delivery • Design and build end-to-end data pipelines using Azure (ADF, Synapse, Fabric) • Develop scalable frameworks for ingesting structured, semi-structured, and unstructured data • Implement modern architectures (e.g. Lakehouse, medallion – bronze/silver/gold) • Build and optimise storage solutions across ADLS Gen2, Cosmos DB, and Azure SQL/Synapse • Deliver scalable, maintainable, production-ready solutions 1. Unstructured Data & NoSQL Engineering • Design pipelines to process, transform, and enrich unstructured data. • Leverage Cosmos DB for high-throughput, low-latency, schema-flexible workloads • Optimise partitioning, indexing, and query performance • Enable downstream analytics and AI use cases (e.g. reporting, search, RAG) 1. Data Discovery, Analysis & Business Engagement • Conduct data discovery, profiling, and exploratory analysis • Collaborate with Tax & Legal stakeholders to translate business needs into data solutions • Identify trends, anomalies, and data quality issues • Present insights clearly to non-technical and senior stakeholders • Support development of curated datasets and semantic layers 1. Collaboration & Delivery • Work with data scientists, AI engineers, architects, and domain specialists • Enable data consumption via reporting tools, APIs, and data services • Contribute to best practices in governance, lineage, and data cataloguing • Deliver high-quality solutions in agile environments Essential Skills and Experience • Proven experience as an Azure Data Engineer in end-to-end data platforms • Exposure to AI/GenAI data pipelines (e.g. RAG, embeddings, search) • Knowledge of Azure AI Search or vector-based retrieval systems • Strong hands-on experience with: • Azure Data Factory / Synapse / Microsoft Fabric • Azure Data Lake Storage (ADLS Gen2) • Azure Cosmos DB (Core/SQL API, NoSQL modelling) • Experience working extensively with unstructured and semi-structured data • Proficiency in Python and SQL • Demonstrated experience in: • Data discovery, profiling, and exploratory analysis • Data transformation and data quality frameworks • Strong understanding of: • NoSQL vs relational data modelling • Data partitioning and performance tuning • Experience building scalable, production-grade data pipelines • Familiarity with CI/CD and DevOps practices in Azure Desirable: • Azure Data Engineering Associate certification (DP-203) or equivalent • Experience with Microsoft Fabric and Lakehouse architectures • Experience integrating Cosmos DB with analytical platforms • Familiarity with data governance frameworks IR35 As a means of managing tax, commercial and reputational risks, Deloitte prohibits the use of Associates through Personal Service Companies (‘PSCs’). All Associates must contract under PAYE arrangements through a Deloitte approved ‘Employment Company’ (aka ‘umbrella company.’)