Data Engineer

Location: Scotland (Edinburgh / Glasgow), remote with occasional in-person sessions Salary: £500-£600/day outside IR35 contractor Primary Stakeholder: Head of Data & AI Introducing hyble! Things move quickly at hyble! We're a team of passionate individuals who love what we do and are always striving for the best. If you're looking for a company that values your contributions and offers exciting challenges, this might be the place for you. We're a fast-growing marketing technology company serving customers in over 50 countries. Just six years ago, we were a tight-knit team of 12 crammed into a tiny office in a start-up incubator. Fast forward to today, and we’ve transformed into a dynamic team of over 90 passionate individuals spanning three continents partnering with some of the world's biggest alcoholic beverage brands. Right now, we’re expanding rapidly into North America as a result of signing a transformational contract with the largest Wine and Spirits Distributor in the USA, who also happens to be the 11th biggest privately owned company in the US. Our Purpose Our goal is to create a lasting positive impact by disrupting a traditional industry that’s operated the same way for over 50 years. It blows our minds that sales reps have to spend weeks creating something as simple as a poster. And we’re horrified by the amount of obsolete Point of Sale we see being sent to landfill. So, we're on a mission to solve these issues once and for all. Our technology platform “Hyble” empowers sales reps in the beverage industry to create on-demand marketing materials that are both brand-compliant and tailored for the specific account. Combined with our enterprise services, which enable the change management process and our cloud printing model that enables rapid turnaround print, we have a game-changing solution that the market is screaming out for. This innovative approach makes sales reps lives easier by allowing them to support more accounts in less time while also drastically reducing the production of generic marketing content that often ends up in landfill. What you’ll do We have kicked off a project to overhaul our data architecture and introduce proper data engineering practices for the first time via a MS Fabric architecture. This is a true greenfield project. We have chosen the Microsoft Fabric stack and are seeking an experienced contractor to bring independent expertise and offer guidance on key architectural decisions. The aim of this project is twofold: • Better and more consistent internal analytics (one version of the truth) • Getting our data into a state where it can support AI initiatives Day to day • Design, develop, and implement a greenfield data platform using Microsoft Fabric, Azure Synapse, and Azure Data Factory, emphasizing the medallion architecture (Bronze, Silver, Gold layers). • Build scalable data ingestion pipelines from diverse sources into Fabric using Data Factory capabilities and Python/Spark notebooks. • Implement robust data processing and transformation logic using Fabric’s Dataflow Gen2. • Ensure robust data governance and maintain high data quality standards throughout the medallion architecture. • Work with stakeholders to shape the technical approach based on business needs. • Draw on proven approaches and best practices to guide delivery for version control using GitHub, ensuring consistent collaboration and maintainability of data workflows. • Share knowledge and hands-on guidance to help build internal capability. • Establish monitoring, logging, and alerting frameworks using Fabric's built-in observability tools to maintain reliability and performance. • Document data architecture, pipeline processes, and best practices clearly for future scalability and knowledge sharing. • Lead on designing and automating CI/CD pipelines within the Fabric environment. What you’ll bring • Microsoft Fabric Expertise: Deep understanding of Fabric’s capabilities and experience delivering data solutions using the medallion architecture (Bronze, Silver, Gold layers). • Data Engineering Skills: Proven ability to build scalable data pipelines using Azure Data Factory, Synapse, and Python/Spark notebooks. • Data Transformation: Hands-on experience implementing robust data processing logic with Fabric’s Dataflow Gen2. • Governance and Quality: Familiarity with implementing data governance standards and maintaining high levels of data quality. • Technical Collaboration: Ability to work with business and technical stakeholders to shape data-driven solutions based on real-world needs. • Version Control Practices: Strong knowledge of GitHub workflows and best practices for collaborative and maintainable development. • Knowledge Sharing: Passion for capability-building through mentoring, documentation, and practical knowledge transfer. • Monitoring and Observability: Experience setting up monitoring, alerting, and logging frameworks using Fabric's built-in tools. • Documentation and Process Clarity: Skilled in producing clear, scalable documentation to support long-term data platform success. • CI/CD Automation: Confidence leading on CI/CD pipeline design and implementation within a Microsoft Fabric ecosystem For more information about us visit: https://www.hyble.tech/ or check out our socials.