Data Engineer

Data Integration Developer | United Kingdom | Remote | £500 - £525 We're working with Hays Technology on this exciting opportunity. Are you a seasoned Data Integration Developer ready to make a significant impact? Join our public sector client through Hays Technology and build a cutting-edge integrated data platform. This is your chance to shine, leveraging your expertise in API development, data transformation, and SQL to unify critical workforce and learning data. The Role • Deliver an integrated data platform combining workforce, learning, and performance data from diverse systems like Unit4, Learning Pool, and existing Data Lake assets. • Develop robust API integrations with Learning Pool's Extended API for automated CRUD operations of LMS accounts, including organization and position hierarchies. • Implement sophisticated data transformation logic to unify data from Unit4 and Learning Pool feeds, utilizing Slowly Changing Dimensions (SCDs Type-1 and Type-2). • Design schemas optimized for Power BI and semantic modeling, ensuring efficient data consumption and insightful reporting. • Resolve identity across disparate systems using email as a primary key, with fallback fuzzy matching for comprehensive data integrity. What You'll Need • Proven expertise in Data Integration, with a strong focus on building ingestion pipelines and operational components. • In-depth experience with API development, particularly integrating with external APIs and handling complex schema attributes and error management. • Strong proficiency in SQL and database technologies such as SQL/MariaDB, coupled with solid understanding of data warehousing concepts. • Demonstrated ability to implement advanced data transformation techniques, including Slowly Changing Dimensions (SCDs Type-1 and Type-2). • Experience with Power BI consumption layer and designing data models optimized for business intelligence. What's On Offer • Competitive daily rate of £500 - £525. • Remote working flexibility, allowing you to excel from anywhere. • An initial contract until the end of March with strong potential for extension. • Opportunity to work on a high-impact public sector project with significant data integration challenges. Apply via Haystack today!