Databricks Consultant

Databricks Consultant / Databricks Engineering Architect Contract Length: Initial 7 weeks (immediate start) with strong potential for extension Location: London (Victoria) Hybrid - 1–2 days per week onsite Outside IR35 We are looking for an experienced Data Engineering Architect / Consultant with strong Databricks expertise to support a private equity–backed international organisation in shaping the early-stage architecture of a federated data platform. The organisation is building a centralised data capability to demonstrate value against investment and performance metrics as part of a broader strategic journey that could include future IPO readiness. This role is less about heavy hands-on development and more focused on defining the architecture, data models, and engineering KPIs, while helping create a clear delivery blueprint and roadmap for the platform. You will work closely with stakeholders across London and international teams, helping translate business and investment objectives into data architecture, transformation logic, and measurable platform value. This organisation are a global management consulting firm that helps organisations address complex business challenges and deliver large-scale transformation programmes. It partners closely with clients to design and implement technology and data platforms, drive digital transformation, and deliver measurable business outcomes, supporting organisations as they navigate change and pursue long-term growth. Key Responsibilities • Define the architecture and blueprint for a federated data platform built on Databricks • Design and shape a centralised data lake architecture • Translate business and PE investment metrics into measurable data engineering KPIs • Identify data gaps, data availability issues, and required datasets • Develop data models and transformation logic to support reporting and analytics • Provide a strategic roadmap and operating model for the data platform • Shape the skills, tooling, and platform capabilities required • Work closely with stakeholders to build a clear narrative and plan for data delivery • Support data cataloguing and governance within the Databricks ecosystem • Enable downstream reporting using Power BI or Tableau • Run workshops with engineering and business teams to define requirements and architecture Required Skills & Experience • Experience defining the architecture and blueprint for a federated data platform • Strong experience with Databricks • Deep understanding of data transformation, modelling, and engineering logic • Experience designing data lake / lakehouse architectures • Ability to translate business objectives into data architecture and KPIs • Experience building data platform roadmaps and delivery blueprints • Strong stakeholder management and consulting-style communication • Familiarity with data cataloguing and governance • Experience enabling reporting via Power BI or Tableau Desirable Experience • Experience with Databricks Catalyst (sales/analytics optimisation layer) • Experience building federated data platforms • Exposure to private equity environments or IPO readiness programmes • Experience working with international teams Interview Process Stage 1: 60-minute interview