Senior Data Engineer

Senior Data Engineer 💰 £450/day (Inside IR35) 📍 Warwick, UK (3 days onsite) 📅 6-Month Contract A leading organization is seeking a Senior Data Engineer to join their cloud data platform team on a hybrid basis (3 days in office, Warwick). This is a 6-month contracting role offering competitive daily rates and the opportunity to contribute to a modern, cloud-native data platform. The Role You will be responsible for driving the design and implementation of scalable, high-performing data architectures and pipelines. Working with the Interconnectors Data Platform (ICDP), you will provide both technical leadership and hands-on development, supporting the transition to modern Azure-based ingestion patterns and Medallion Architecture. Key Responsibilities • Lead the design and implementation of scalable data architectures and layered models (Bronze/Silver/Gold). • Develop robust, secure, and observable ingestion and transformation pipelines using Azure-based tools. • Lead the migration from legacy ETL tools to modern cloud pipelines (ADF, Azure Functions, event-driven frameworks). • Build performant SQL transformations and reusable data models. • Implement CI/CD, automated testing, version control, and observability in workflows. • Ensure data quality, validation, reconciliation, and auditability across platform layers. • Collaborate with business and product teams to deliver high-quality analytical outputs. • Mentor junior data engineers and contribute to team capability development. Required Skills & Experience • Strong hands-on experience with Python for production-grade pipelines. • Expert-level SQL, including optimization and data modelling. • Azure Cloud experience (ADF, Functions, Storage, Key Vault). • Deep understanding of data warehousing, dimensional modelling, and scalable architectures. • Proficiency in Git, CI/CD, automated testing, and modern engineering best practices. • Experience with API and SFTP ingestion and resilient pipeline design. • Strong problem-solving, communication, and stakeholder collaboration skills. Desirable • Experience with Medallion/Lakehouse patterns or Databricks-style ecosystems. • Experience in regulated or high-assurance data environments. • Collaboration with modeling teams in engineering-modelling interfaces