Azure Data Engineer

Azure Data Engineer Location: Coventry - Hybrid - 3 days per week onsite Start Date: ASAP Contract Rate: £420 per day inside IR35 Duration: 6 to 12 months initially Role Overview Our client is seeking a highly skilled Azure Data Engineer to design, develop, and execute enterprise-scale data migration and transformation solutions within the Microsoft Azure ecosystem. The successful candidate will play a key role in building high-performance data pipelines, enabling scalable data processing, and supporting critical business data initiatives. Key Responsibilities • Design and build scalable ETL/ELT pipelines using Azure Data Factory and Synapse Pipelines • Develop structured data migration payloads, including schema mapping and transformation logic • Implement Change Data Capture (CDC) for efficient incremental data loads • Develop and maintain PySpark notebooks for data transformation, cleansing, and partitioning • Build reusable Python utilities for data validation and API integrations • Create and optimise SQL queries, stored procedures, and analytical data models • Manage and integrate data across Azure Data Lake (ADLS Gen2), Synapse Analytics, and Azure SQL • Design solutions for handling structured and semi-structured data formats such as JSON and Delta Lake • Ensure performance optimisation, scalability, and reliability of data pipelines • Support data quality, governance, and security best practices Skills & Experience Essential • 5+ years’ experience in cloud data engineering, ideally within Azure • Strong hands-on expertise with Azure Data Factory and Azure Synapse Analytics • Advanced programming skills in Python, PySpark, and SQL (T-SQL / Spark SQL) • Experience designing and implementing data pipelines and migration solutions • Strong understanding of data modelling, transformations, and optimisation techniques • Experience working with Azure Data Lake Storage (ADLS Gen2) Desirable • Experience with Azure Databricks • Familiarity with Cosmos DB, Oracle DB, and Delta Lake • Knowledge of event-driven architectures (Event Hub, Kafka, IoT Hub) • Exposure to Microsoft Fabric / OneLake • CI/CD experience with Azure DevOps or GitHub • Understanding of data governance, data quality, and security frameworks • Experience working with unstructured data and large-scale datasets If you have the relevant skills and experience, please do apply promptly to be considered