AI Data Engineer 2 (contract)

Please note that this is a contract role providing services to Microsoft through external staffing partners of Allegis Global Solutions (AGS). If you are selected for this role, you will be employed by AGS and will not be an employee of Microsoft. Role Summary This is a hands-on Data Engineer role focused on building a reliable and trusted data platform using Microsoft Fabric and OneLake. The person will take messy, inconsistent data coming from multiple systems and transform it into accurate, governed, analytics-ready datasets. They will own the end-to-end health of data pipelines, proactively troubleshoot issues, and work directly with source system teams to resolve data problems. This role requires someone who takes initiative, enjoys solving complex data challenges, and can operate independently with minimal direction. Key Responsibility Data Engineering & Architecture • Build and maintain data pipelines in Microsoft Fabric. • Design and implement Bronze, Silver, and Gold data layers. • Ingest data from multiple source systems into OneLake. • Create scalable ETL/ELT solutions. • Develop advanced SQL-based transformation logic. • Optimize pipeline performance and reliability. • Build semantic models that support governed self-service reporting. Data Quality & Reliability • Implement automated data quality validations. • Create reconciliation and audit checks. • Monitor pipeline performance and failures. • Troubleshoot data issues caused by schema or source-system changes. • Reduce manual intervention through automation. Stakeholder Collaboration • Partner with application owners and data producers. • Investigate root causes of data inconsistencies. • Drive resolution of ambiguous data issues. • Act as the technical owner of data-related problems. Security & Governance • Configure Row-Level Security (RLS). • Maintain dataset lineage and documentation. • Implement data governance standards. • Ensure secure and compliant data access. Must Have Skills Technical • Microsoft Fabric (minimum 1-2 years hands-on) • OneLake • Medallion Architecture (Bronze / Silver / Gold) • Advanced SQL • Data Pipeline Development • ETL / ELT Design • Data Quality Frameworks • Data Validation & Reconciliation Controls • Monitoring & Alerting Implementation • Semantic Modeling • Microsoft Power Query / M Query Functional • Strong troubleshooting skills • Root cause analysis experience • Experience working with changing source systems • Ability to work independently • Proactive ownership mindset Nice-to-Have Skills • Power BI Semantic Models • Data Warehouse Design • Lakehouse Architecture • Azure Data Engineering ecosystem • Data Governance platforms • CI/CD for data pipelines • DataOps practices • Metadata management • Dataset certification and lineage tools Experience Level Guidance Ideal Experience • 4-8 years total Data Engineering experience • 1-3 years actively working in Microsoft Fabric • Experience supporting production-grade enterprise data platforms • Experience dealing with multiple source systems and frequent schema changes Additional Details • Location: Remote (United Kingdom) • Duration: 6 months • Shift Timings: Monday – Friday (Business Hours) • Pay Range: £303 - £341 /day (PAYE) • Weekly Schedule: 40 hours As a workplace, Allegis Global Solutions focuses on relationships – with each other, our clients and our candidates. In fact, serving others is one of our core values. We support open communication and recognize that giving constructive criticism can be even harder than receiving it. We appreciate the fearless and the passionate, who force us to be better. Everything we do sits on a pillar of diversity, equity and inclusion - diverse perspectives, backgrounds and ideas achieve innovation and make us successful. Please note that we may use artificial intelligence (AI) tools to screen, assess, or select applicants for this position. These tools may analyse application materials and assist our team in identifying candidates whose qualifications best match the requirements of the role. If you have questions about our use of AI in the hiring process, or would like more information, please contact us. Pay Rate Range 303 - 341 GBP daily