Senior Data Engineer - £450/day Outside - 6 Months Ext

Senior Data Engineer Rate: up to £450/day Outside IR35 Contract Length: 6 Months (with likely extension) Location: Hybrid - 1 day per week onsite in Central London Working hours: 9am - 5pm - Monday - Friday An established international organisation is seeking a Senior Data Engineer to join their growing Data & Middleware function, driving innovation and excellence across complex data ecosystems. This is a fantastic opportunity to shape the future of a large-scale data transformation programme, working on high-impact projects that enable data-driven decision-making. Responsibilities for the Senior Data Engineer: • Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance, and best-in-class engineering standards • Leverage Databricks, Spark, and modern cloud platforms (Azure/AWS) to deliver clean, high-quality data for analytics and operational insights • Lead by example on engineering excellence, mentoring junior engineers and driving adoption of DevOps and CI/CD best practices within the data function • Contribute to the evolution of a modern event-sourcing architecture, enabling efficient data modelling, streaming, and transformation across platforms • Collaborate with cross-functional teams - including Business Analysts, Product Owners, and fellow Senior Data Engineers - to translate business needs into robust technical solutions • Champion data governance, privacy, and security best practices, ensuring compliance and protection of customer data • Continuously improve existing systems, introducing new technologies and methodologies that enhance efficiency, scalability, and cost optimisation Essential Skills for the Senior Data Engineer: • Proficient with Databricks and Apache Spark, including performance tuning and advanced concepts such as Delta Lake and streaming • Strong programming skills in Python with experience in software engineering principles, version control, unit testing and CI/CD pipelines • Advanced knowledge of SQL and data modelling (dimensional modelling, fact/dimension structures, slowly changing dimensions) • Managing and querying data lakes or Lakehouse's • Excellent communication skills with the ability to explain complex technical concepts clearly and persuasively Desirable Skills for the Senior Data Engineer: • Experience with event sourcing, dbt, or related data transformation tools • Familiarity with PostgreSQL and cloud-native data services (Azure Event Hub, Redshift, Kinesis, S3, Blob Storage, OneLake, or Microsoft Fabric) • Understanding of machine learning model enablement and operationalisation within data architectures • Experience working within Agile delivery environments If you are an experienced Senior Data Engineer with strong expertise in Databricks, Azure, and data architecture design, looking for a hands-on role where you can influence technical direction and drive meaningful change, please apply in the immediate instance. Data Engineer, Senior Data Engineer