Role: Senior Data Engineer Contracting Authority: Public Sector Contract Length: 6 Months Location: Hybrid - London IR35: Inside Pay Rate: Up to £500 per day Clearance: SC Clearance An exciting opportunity has become available with our prestigious client who is a prominent government department. The client is seeking an experienced Senior Data Engineer to join their welcoming team. The Senior Data Engineer Role: The client’s Data Modelling and Engineering Team is made up of Data Engineers and Analytics Engineers: our Data Engineers build and maintain pipelines to extract from operational systems and load data to our Analytical Platform and our Analytics Engineers model this data using dimensional modelling principles to provide useful and usable data to downstream users, including analysts, performance teams and data scientists. Over time, this supports migration towards robust, automated and maintainable downstream processes which deliver trusted analysis. Historically the legal aid data landscape is complex and there is a current ambition across the organisation and LAA to modernise and stabilise in this area. The client’s Data and Analytics Engineering is a key part of this, and we intend to deliver modelled legal aid data to the Analytical Platform to enable seamless data access for analysis, resulting in trusted data products and confident data-driven decision making to promote access to justice. In the short-term this will mean establishing connectivity with downstream data systems, exploring a new data layer for LAA, and conducting detailed analysis of user needs in a single area to feed into dimensional model design. By developing in a flexible manner with the right level of abstraction this will enable expansion to bring a full range of analytically useful legal aid data onto the platform and eventual migration towards modern API-based data extraction. We are looking for an experienced, collaborative Data Engineer to join the team to work with upstream teams to bring legal aid data onto the Analytical Platform and to develop a new data layer for LAA. What Senior Data Engineer Will Need: Excellent python, SQL and jinja skills Experience with cloud platforms, ideally AWS Experience of orchestrations tools, ideally airflow Experience of building CI/CD workflows, ideally with GitHub Actions Experience of ensuring practices are up to date with latest developments in data engineering Experience of designing and developing data pipelines Experience of working with business stakeholders and cross-functional teams Experience of infrastructure as code, ideally Terraform Experience of using dbt, including implementing dbt best practices (desirable) Minorities, women, LGBTQ+ candidates, and individuals with disabilities are encouraged to apply. Interviews will take place this week, so please apply immediately to be considered for this exciting contract opportunity.