Data Engineer

Contract Data Engineer (Databricks) – AI Applications 6 Months – Inside IR35 We are seeking an experienced Data Engineer to join a multidisciplinary team delivering AI-powered client-facing applications. The role will focus on building and optimising data pipelines and platforms that enable advanced analytics and AI capabilities. You will work within an Agile/Scrum delivery team, collaborating with engineers, analysts, and product stakeholders to support the development of scalable, high-quality data solutions. The role is primarily remote, with occasional travel to London as required. Key Responsibilities • Design and build scalable data pipelines and data engineering solutions to support AI-driven applications. • Develop and optimise data workflows using Databricks. • Automate processes and operational tasks using PowerShell. • Support data ingestion, transformation, and integration across multiple sources. • Work closely with data scientists and developers to enable AI and analytics capabilities. • Contribute actively to Agile/Scrum ceremonies and collaborative delivery practices. • Ensure high standards of data quality, reliability, and performance. Essential Skills & Experience • Strong experience working as a Data Engineer. • Hands-on experience with Databricks. • Proficiency in PowerShell scripting and automation. • Strong SQL and experience building ETL/ELT data pipelines. • Experience working in Agile/Scrum delivery teams. • Experience with cloud data platforms (Azure preferred). Desirable Skills • Experience with Excel automation and VBA. • Experience supporting AI / machine learning data pipelines. • Familiarity with CI/CD for data platforms. Personal Attributes • Strong team player with collaborative working style. • Comfortable working in fast-paced Agile environments. • Strong problem-solving and communication skills. • Delivery-focused and proactive. Contract: 6 months IR35: Inside IR35 Location: Mostly remote with occasional travel to London