Azure Data Engineer

• Azure Data Engineer (Government Digital Services) • 6-month contract • Remote working (UK) • Outside IR35 • £475 per day The Opportunity: We are supporting a major public sector organisation on the appointment of an experienced Azure Data Engineer to join a high-profile data and analytics programme on an initial 6-month contract basis. This is a backend-focused Data Engineering role centred on building and maintaining scalable data services, pipelines and platform capabilities using Azure Databricks within a containerised Docker environment. Working within a multidisciplinary data team across Agile delivery environments, you will play a key role in designing, developing and optimising modern cloud-based data solutions that support critical environmental, scientific and operational decision-making across the organisation. This role offers the opportunity to work with large-scale data platforms, geospatial datasets and advanced analytics capabilities, helping to drive innovation and improve access to trusted, high-quality data, consulting on modern engineering practices to deliver robust, secure and high-performing data solutions. Skills and Experience: • Proven commercial experience working as a Data Engineer within complex data environments • Strong experience designing and developing Azure-based data solutions • Hands-on experience with: Azure Databricks / Azure Data Lake / Azure Data Platform technologies • Experience developing solutions within containerised environments using Docker. • Strong SQL and data transformation skills • Experience building scalable ETL/ELT pipelines • Experience working with large and complex datasets • Understanding of data governance, data quality and metadata management principles Experience working with the following is highly-desirable: • Power BI / ArcGIS /QGIS / Geospatial or spatial data platforms • Experience contributing to enterprise data architecture initiatives • Familiarity with Sparx Enterprise Architect (EA Sparx) • Experience supporting cloud-based analytics and reporting platforms • Public sector, environmental, scientific or regulatory sector experience Role and Responsibilities: • Design, build and maintain scalable data pipelines and data engineering solutions. • Develop and optimise Azure-based data platforms and services. • Develop and deploy data engineering solutions within a containerised Docker environment. • Support the ingestion, transformation and management of structured and unstructured datasets. • Build robust ETL and ELT processes to support analytics and reporting requirements. • Work closely with data scientists, analysts, architects and business stakeholders to understand and deliver data requirements. • Support the development and enhancement of enterprise data models and data architecture artefacts. • Manage and optimise data storage solutions including cloud-based data lakes. • Ensure data quality, integrity, governance and security standards are maintained. • Support the delivery of geospatial and location-based data solutions. • Develop technical documentation and contribute to best practices across the data engineering function. • Assist with platform modernisation, automation and continuous improvement initiatives. NB: The successful candidate will be required to undergo a basic level of security clearance before undertaking the assignment (around two weeks’ lead-time). Applications: To learn more about this newly created opportunity consulting as an Azure-focused Data Engineer for an initial 6 month engagement, operating on a remote-working basis; please call and speak with Edward Laing here at ISR Recruitment on 07436 071 872 or please send through a copy of your latest online profile and/or CV (edward@isr.uk.com) for an immediate call back in the strictest confidence.