Senior Data Engineer (Databricks)

Senior Data Engineer – Databricks / Data Platforms Robert half is supporting a global risk consulting firm for multiple enterprise clients due to a sustained increase in delivery demand and fully utilised permanent teams. We are seeking an experienced Senior Data Engineer to join as an associate, delivering hands-on data engineering solutions across client environments. This role is delivery-focused, working closely with internal analysts, engineers, and business stakeholders to build robust, production-grade data pipelines. Assignment Details • Initial Duration: 3 months (extensions likely) • Location: London (1–2 days per week on site) • Day Rate: £450–£500 per day via LTD Company (Outside IR35) • Start Date: ASAP/January 2026 Key Skills and Experience Required • Senior, experienced Data Engineer with strong stakeholder and light project management capability • Comfortable working independently and proactively engaging different parts of the business to source information and resolve ambiguity • Very strong experience integrating systems and working with complex or poorly documented APIs, which will be a core part of the engagement • Proven experience building and automating manual processes where APIs are not available, including SharePoint and Excel-based data ingestion into reporting pipelines • Expert-level Databricks experience for building reporting pipelines, including deep understanding of Medallion architecture, Delta Live Tables (DLT), and DevOps procedures • Strong documentation and handover discipline, with experience transitioning solutions to internal data teams for ongoing ownership • Does not need to be a Power BI specialist, as dashboarding and visualisation will be supported by an internal analyst; prior Power BI exposure is advantageous Role Overview • You will join an associate delivery pool supporting high-priority client engagements. • The role involves building automated data pipelines for operational, technology, and financial metrics, with a strong focus on reliability and maintainability. • You will work independently, shape technical solutions, and ensure clean handover to internal data teams. • This is not a strategy-only or BI-led role. You will actively deliver, solve integration challenges, and support teams through to completion. Screening: All candidates must pass standard screening, including Right to Work, employment verification, and credit/criminal checks. If you are a seasoned Databricks-focused Data Engineer looking to operate as an associate on high-impact enterprise engagements, get in touch.