On behalf of DWP, we are looking for a Senior Data Engineer for a 12 Month (Inside IR35) contract. Hybrid 2 days per week based in London, Manchester, Newcastle or Leeds. Note: SC Clearance is an essential requirement for this role, as a minimum you must be willing & eligible to undergo checks. Please note, due to the exceptional requirements of this position, (and speed at which we require a postholder in situ), preference may be given to candidates who meet all of the essential criteria and hold active security clearance Senior Data Engineer Data Engineers are responsible for the creation and maintenance of analytics infrastructure, providing the foundations for data needs. Data Engineers are responsible for developing, constructing, maintenance and testing of architectures, such as databases and large-scale processing systems, implementing data flows to connect operational systems, and writing and executing ETL scripts and codes. As a Senior Data Engineer you are responsible for leading, managing and delivering all aspects of data development activities to meet customer needs to agreed timescales. You own the overall Data Engineering Development process within Data Engineering along with setting the strategies for products and the wider community. As a Senior Data Engineer you will provide technical leadership to a team of Data Engineers along with providing oversight to the products they develop. You will be: • Responsible for leading, managing and delivering all aspects of development activities to meet customer need; • Lead the shaping of solutions, ensuring strategic fit, following the agreed principles and contribute to the continuous improvement of the Data Engineer Development lifecycle • Develop, own, maintain and ensure adherence to standards across the Data Engineering community; • Promote the development of reusable, robust and scalable products eg code, citizen centric data models, exploitation products • Quality assuring documentation for projects, including project plans, and resource estimates; • Designing and developing reusable metadata libraries and promote reuse across the department; • Work with other technologists, including Lead Data Engineers and Data Architects to investigate and develop solutions; • Developing, maintaining and continually improving data engineering, automation and scaling capabilities; • Providing technical leadership to individuals and building the Data Engineer community and capability. You will have: • Knowledge of data architecture concepts / technologies e.g. data warehouse, data lakes, big data • Expert level experience in the development of complex data routines and patterns • Experience of developing data solutions on Oracle, Cloudera or Horton Works platforms • Knowledge of database architecture, relational database diagrams, data warehousing principles and integrity constraints • Knowledge of API development • Experience of developing data solutions using cloud native services for collection, storage, processing, analysis, visualisation and security of data • Experience of leading teams and building sustainable, modern data engineering capability. • Experience of leading the design and development of complex data pipelines • Stakeholder Management in a large cross functional environment • Experience of modern engineering concepts and application in a data environment (devops/dataops/CI/CD) Please be aware that this role can only be worked within the UK and not Overseas. Disability Confident As a member of the Disability Confident Scheme, DWP guarantees to interview all candidates who have a disability and who meet all the essential criteria for the vacancy. In cases where we have a high volume of candidates who have a disability who meet all the essential criteria, we will interview the best candidates from within that group. This scheme encourages candidates with a disability and/or neurodivergence to apply. In exceptional circumstances, we may also need to apply the desirable criteria in our shortlisting process which may include holding active security clearance. Armed Forces Covenant DWP guarantees to interview veterans or spouses / partners of military personnel who meet all the essential criteria for the vacancy. In cases where we have a high volume of ex-military candidates / military spouses or partners, who meet all of the essential criteria, we will interview the best candidates from within that group. In exceptional circumstances, we may also need to apply the desirable criteria in our shortlisting process which may include holding active security clearance. In applying for this role, you acknowledge the following "this role falls in scope of the Off Payroll Working in the Public Sector legislation. Any rates of payment quoted will reflect the gross rate per day for the assignment and will be subject to appropriate taxes and statutory costs. As such the payment to the intermediary and your income resulting from this contract will be different".