Staff Data Engineer

Job Title: Team Leader Location: London - Hybrid About The Role: My client is looking for a Data Engineering Team Leader to join their growing data team. This is a hands on technical role with a small people management involved. The ideal candidate will bring strong expertise in data engineering, experience with Python or Scala, and hands on work with Databricks, Apache Spark, and Kafka. You will lead by example, guiding a small team of engineers while contributing directly to the design and delivery of data solutions. Key responsibilities • Lead and mentor a small team of data engineers, fostering a collaborative and high performance culture • Design, build, and maintain scalable data pipelines and streaming solutions using Spark, Kafka, and Databricks • Write high quality, efficient, and maintainable code in Python or Scala • Collaborate with stakeholders to understand requirements and deliver reliable, high impact data solutions • Ensure best practices in coding, testing, version control, and CI/CD are followed across the team • Monitor and optimise data workflows for performance, scalability, and cost-effectiveness • Support the professional development of team members, providing coaching and feedback Key requirements • Proven background in data engineering, with strong knowledge of Python or Scala • Handson experience with Databricks, Apache Spark, and Kafka • Strong understanding of distributed data processing and data pipeline design • Experience in building and optimising large scale data platforms in cloud environments • Excellent problem-solving skills and a strong technical mindset • Previous experience mentoring or leading engineers is desirable, though this will be a small part of the role • Strong communication and collaboration skills, with the ability to work effectively with technical and non-technical stakeholder Job Title: Team Leader Location: London - Hybrid About The Role: My client is looking for a Data Engineering Team Leader to join their growing data team. This is a hands on technical role with a small people management involved. The ideal candidate will bring strong expertise in data engineering, experience with Python or Scala, and hands on work with Databricks, Apache Spark, and Kafka. You will lead by example, guiding a small team of engineers while contributing directly to the design and delivery of data solutions. Key responsibilities • Lead and mentor a small team of data engineers, fostering a collaborative and high performance culture • Design, build, and maintain scalable data pipelines and streaming solutions using Spark, Kafka, and Databricks • Write high quality, efficient, and maintainable code in Python or Scala • Collaborate with stakeholders to understand requirements and deliver reliable, high impact data solutions • Ensure best practices in coding, testing, version control, and CI/CD are followed across the team • Monitor and optimise data workflows for performance, scalability, and cost-effectiveness • Support the professional development of team members, providing coaching and feedback Key requirements • Proven background in data engineering, with strong knowledge of Python or Scala • Handson experience with Databricks, Apache Spark, and Kafka • Strong understanding of distributed data processing and data pipeline design • Experience in building and optimising large scale data platforms in cloud environments • Excellent problem-solving skills and a strong technical mindset • Previous experience mentoring or leading engineers is desirable, though this will be a small part of the role • Strong communication and collaboration skills, with the ability to work effectively with technical and non-technical stakeholder