Databricks Engineer - SC Cleared

This is an exciting contract opportunity for an SC Cleared Databricks Engineer to join an experienced team in a new customer engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of advanced Databricks solutions within the AWS ecosystem. Responsibilities • Design, build, and optimise end-to-end data pipelines using AWS and Databricks, including Delta Live Tables. • Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions. • Drive best practices for data engineering. • Help clients realise the potential of data science, machine learning, and scaled data processing within AWS / Databricks ecosystem. • Mentor junior engineers and support their personal development. • Take ownership for the delivery of core solution components. • Support with planning, requirements refinements, and work estimation. Skills & Experiences: • Proven experience designing and implementing data solutions in AWS using Databricks as a core platform. • Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows. • Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks. • Deep understanding of lakehouse architecture, with a solid grasp of data warehousing, data lakes, and real-time data processing. • Good experience with CI/CD practices and tools for data platforms. • Good knowledge on how to leverage AI to increase deployment productivity and quality. • Excellent communication skills. • Desirable: certification in Databricks Data Engineer and/or AWS Data Engineer are a plus. Additional Information • Rate offered: £500-550 per day • IR35 Status: Outside • Location: Hybrid with 1 day per week travel to client site in the North East • Start date: January • Duration: 3 months initial sign up with significant opportunity for extension • Required: Active SC Clearance