Data Engineer

Azure Databricks Analytics Solution Engineer Fully Remote 6 Months Contract - Inside IR35 Overview We are seeking an Azure Databricks Analytics Solution Engineer to join a high impact reporting and analytics team within the digital health domain. This is a position spanning Data Engineering, DevOps and Site Reliability Engineering, with a strong focus on Azure Databricks platform ownership and analytics infrastructure. You will be responsible for maintaining and enhancing a large scale data platform that supports critical reporting and insight capabilities. This role would suit someone who enjoys improving reliability, automating manual processes and taking full ownership of cloud based analytics environments. The Role This role combines hands on engineering with platform reliability and automation. You will ensure Azure Databricks and Palantir Foundry environments operate securely, efficiently and at scale, while continuously driving improvements in infrastructure and processes. Day to day responsibilities include: • Managing and resolving platform alerts, incidents and outages • Maintaining and optimising platform artefacts such as secrets, clusters and release processes across Databricks and Palantir Foundry • Supporting Data Engineers with pipeline creation and optimisation • Developing and maintaining Terraform to automate infrastructure provisioning and configuration • Conducting health checks and ensuring platform stability and scalability • Managing secrets and secure access controls • Owning release processes and contributing to GitHub peer reviews • Taking end to end ownership of software and platform components Site Reliability and DevOps Responsibilities • Providing Site Reliability Engineering for Azure Databricks and Palantir Foundry platforms, ensuring availability, performance and resilience • Building and maintaining analytics infrastructure to support reporting and data driven decision making • Improving processes across CI CD and platform operations • Managing immutable backups and data restore procedures • Supporting audit data analysis and governance requirements • Managing networking, access controls and cloud resource optimisation • Overseeing Power BI gateways, VM reservations, Event Hub throughput units and serverless compute clusters Skills and Experience • Strong experience with Azure Databricks • Hands on experience with Terraform for infrastructure as code • Solid DevOps experience within Azure environments • Experience with Git and Azure DevOps • Strong Python, PySpark and SQL skills • Experience with data streaming and analytics solutions • Experience working with Palantir Foundry • Knowledge of Azure Functions and broader Azure cloud services • Understanding of cloud operations, automation and infrastructure management • Experience supporting Power BI environments • Strong problem solving skills and ownership mindset • Understanding of software lifecycle management processes What We Are Looking For A proactive engineer who takes ownership of platforms and continuously looks for ways to improve reliability and scalability. Someone comfortable operating across Data Engineering, DevOps and SRE, who thrives in environments where analytics platforms are mission critical. If you are passionate about Azure Databricks, automation and building robust analytics infrastructure in a meaningful domain, we would be keen to speak with you.