Senior Data Engineer

Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Job Title: Senior Data Engineer Location: Solihull - Hybrid Contract: 3 months with possible extension. Rate: £550 - £650 inside umbrella Purpose Design, build and assure scalable, secure data products and pipelines across Azure, AWS and Databricks. Lead data integration design, technical decisions and best practices, while mentoring engineers and enabling high-quality analytics, BI and data science outcomes. Reporting & Collaboration • Reports to Lead Data Engineer with oversight from Head of Data Operations & Engineering • Works across Data Science, Analytics, Architecture, Cyber, Product and Delivery teams • Acts as a senior technical lead, guiding engineers and influencing cross-team decisions Key Responsibilities • Lead design and delivery of scalable batch & streaming data pipelines and products • Define and assure enterprise-aligned data integration architectures • Optimise cloud platforms (Azure, AWS, Databricks) for performance and cost • Build and own ETL/ELT pipelines using PySpark, SQL and orchestration frameworks • Automate and modernise legacy data processes with reusable patterns • Design robust data models (Delta Lake, schema evolution, metadata, lineage) • Ensure data security, governance, and compliance (access control, encryption, lifecycle) • Provide technical leadership, mentoring and design reviews • Collaborate with stakeholders to translate complex technical decisions clearly • Support strategic roadmap, tooling and continuous improvement initiatives Core Skills & Expertise Data Engineering • Advanced PySpark and SQL, performance tuning and best practice coding • Data modelling (conceptual, logical, physical) and integration design • Data quality, testing frameworks and automated validation • Strong data analysis, profiling and insight delivery Cloud & Platforms • Azure: Data Factory, Synapse, Databricks, ADLS Gen2, Event Hub, Purview • AWS: S3, Glue, Athena, Kinesis, Lambda, EMR, Lake Formation • Databricks: Delta Lake, Unity Catalog, Structured Streaming, MLflow • SQL Server stack (SSIS, SSRS) Engineering Practices • CI/CD for data platforms and Infrastructure-as-Code (Terraform/Bicep) • Git, monitoring and alerting tools • Data governance, lineage and observability frameworks • Leading technical design assurance and reviews Qualifications & Experience • Degree (or equivalent) in Computer Science or related field • Experience in enterprise-scale data engineering • Relevant certifications (Azure, AWS, Databricks) desirable Adecco is a disability-confident employer. It is important to us that we run an inclusive and accessible recruitment process to support candidates of all backgrounds and all abilities to apply. Adecco is committed to building a supportive environment for you to explore the next steps in your career. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you. We use generative AI tools to support our candidate screening process. This helps us ensure a fair, consistent, and efficient experience for all applicants. Rest assured, all final decisions are made by our hiring team, and your application will be reviewed with care and attention.