Data Engineer

Data Engineer SC Cleared £500-550 per day, Outside IR35 Initial 3 Month engagement (likely to extend) Fully Remote! Start ASAP! Our exclusive Consulting partner urgently requires the services of an experience SC Cleared Data Engineer to join a project team, delivering a high profile Government program. You MUST hold Active Security Clearance! You MUST have experience working within Government departments and the Public Sector. Task: • Review the current processes & put together a proposal on what the team would need to do to improve priority areas within the tech stack (probably focussing on light-touch processes using Python). • Implement pipelines for 1-2 datasets or problematic processes, which they can then use as template to cover any other datasets / areas. Most data are stored as CSV files in a network drive of the businesses Data Analytics Platform (AWS workspace) with most data engineering & modelling work being carried out in Python or R in the businesses Data Analytics Platform (AWS workspace) or in MacBooks, while the front-end development is predominantly happening on MacBooks with deployment handled by central Data Science infrastructure. • The team are looking to scope out options to make the whole process more sustainable going forward, including the businesses Consolidated Data Store (using SQL server database) in the short term and Common Data Platforms (using Azure DataBricks) or Azure (again using DataBricks) team’s infrastructure platform in the medium/ longer term. Experience needed: • CSV • Data Analytics Platform (AWS workspace) • Python or R • SQL • Azure DataBricks The Data Engineer needs a strong consulting mentality and a self-starting approach; they will be required to work with data experts from other government departments and public bodies that provide data for the tool. Project Team: User Researcher, Interaction Designer, Data Scientist This is an Urgent Contract - Please apply by submitting your latest CV for immediate review by our Talent Team. Thank you!