Data Engineer

We are working with a company at the forefront of the energy sector, engaged in a high-profile programme to design, build, and support a modern Azure data platform. This platform is crucial for enabling secure, scalable, and governed data solutions, driving innovation and efficiency in a vital industry. The Role • Build, operate, and optimise an Azure data platform using Azure Databricks. • Design and support Azure infrastructure for data storage, processing, integration, and external data sharing. • Implement data governance, security, access controls, backup, retention, and monitoring to maintain a trusted data lake. • Develop and maintain data ingestion, transformation, and data product pipelines. • Collaborate with data architects and engineering teams to onboard new data sources and deliver business-critical data products. • Support the ongoing development and delivery of the ATLAS data roadmap, ensuring best practices for automation, Infrastructure as Code, and CI/CD. What You'll Need • 5+ years of experience as an Azure Data Engineer. • Strong experience with Azure Databricks, Azure Data Lake Storage (ADLS), and Azure Data Factory (ADF). • Proficiency in Python and SQL. • Experience with Azure DevOps and CI/CD pipelines. • Familiarity with Infrastructure as Code using Terraform and/or Bicep. • Expertise in data governance, security, and access control, along with experience designing and supporting enterprise-scale Azure data platforms. What's On Offer • The opportunity to play a key role in a high-profile programme within the energy sector. • Exposure to cutting-edge Azure data platform technologies. • A collaborative environment working with data architects and engineering teams. • Remote work with occasional travel to Mansfield. Apply via Haystack today!