Databricks Engineer

Venturi are partnered with a leading data & analytics consulting firm who are delivering into a well-known global car manufacturer. The project sits within a large-scale AI and data transformation programme, and we’re looking for an experienced Azure Databricks Engineer to join the team. This is an opportunity to work on a high-impact, enterprise-level data platform with complex pipelines, advanced analytics use cases, and modern Azure engineering practices. Responsibilities • Build, optimise and maintain scalable ETL/ELT pipelines using Databricks (PySpark, Spark SQL). • Design Delta Lake architectures and ensure high-quality, production-ready data models. • Support the integration of data into AI & ML workflows across the programme. • Implement engineering best practices including CI/CD, version control and testing. • Collaborate with analytics teams and client stakeholders to shape technical requirements. • Troubleshoot performance issues and drive cluster and job optimisation. • Produce clear technical documentation and contribute to architectural decisions. Required Experience • Strong hands-on experience with Azure Databricks and the wider Azure data ecosystem. • Excellent working knowledge of PySpark, Spark SQL, and distributed data processing. • Experience with Azure Data Lake, Delta Lake, Data Factory or Synapse Pipelines. • Proven background in designing and delivering large-scale data engineering solutions. • Solid understanding of CI/CD (Azure DevOps preferred), governance and environment separation. • Ability to work in fast-paced consulting environments with complex stakeholder groups. If this role sounds interesting, click apply and we’ll reach out to discuss the project in more detail.