Data Engineer (SC Cleared)

hackajob is collaborating with Solirius Reply to connect them with exceptional professionals for this role. Data Engineer (SC Cleared) - Inside IR35 - 1 day in London per week We're an independent digital transformation consultancy with clients across public and private sectors. We help our clients solve complex technical problems and provide human-centred solutions that lead to positive outcomes. We do this with multidisciplinary teams of strategists, architects, developers, designers and analysts working closely alongside client stakeholders and end users. The Role We're looking for a hands-on Data Engineer to work on a programme of improvement and remediation to close data gaps within a government department. You'll be a strong communicator, with experience of delivering products and services in a Government environment. This includes engaging with stakeholders, ensuring the right structures and processes are in place to effectively capture, monitor and remediate data issues. This is a hands on technical role as part of the project team. You'll be confident working with data on large and complex platforms with multiple data ingestion points. You'll access and query the data and be able to implement methods to transform and transfer data. You'll be able to discuss options and approaches with the project team. You'll have a strong understanding of data quality principles (accuracy, completeness, consistency, timeliness, validity) and the ability to work in an agile environment. Skills And Experience Required Experience and Competencies • GDS Standards: Recent experience working within the Government Digital Service framework, ensuring data services are accessible, secure, and user-centric. Providing technical input to use cases and problem statements is essential. • Agile Delivery: Experienced in Scrum/Kanban environments, participating in ceremonies (Dailies, Refinement, Retrospectives) and managing tasks via backlogs. • Data Engineering Best Practices: Knowledge of ETL/ELT patterns, data versioning, and building robust, automated pipelines. You'll ensure data security and compliance requirements are met with solutions you propose and build. • Streamlining Data Flows: Able to identify and implement process improvements for better data handling • Collaboration: Ability to work closely with Business Analysts, Data Analysts and business stakeholders to translate requirements into technical specifications. Technical Experience And Tooling • Cloud Platform: Proven experience working with AWS and data warehousing • Programming: Advanced proficiency in Python and R for data manipulation and automation. • Database: Expert-level SQL for complex querying and data modelling. Use of dbt to utilise SQL in a data warehouse • Orchestration & Containers: Practical experience with Kubernetes and use of pipelines for deploying and scaling data services. Working Arrangements • One day in the London office per week. Arrangements may vary based on project and team needs. • Active SC clearance required