Senior Python / PySpark Data Engineer (Azure Databricks)

Senior Python / PySpark Data Engineer (Azure Databricks) Remote (UK) £425/day Outside IR35 Long-Term Contract About the Role We're partnering with a global technology organisation delivering enterprise-scale cloud data platforms for major international clients. We're looking for an experienced Senior Python / PySpark Data Engineer to join an established Azure Data Engineering team, working on the design, development and optimisation of scalable data solutions within Azure Databricks. This is a hands-on engineering role suited to someone who enjoys solving complex technical challenges, writing high-quality code and taking ownership of technical delivery. Key Responsibilities • Design and develop data solutions using Azure Databricks. • Build scalable data pipelines with Python and PySpark. • Develop batch and streaming data processing solutions. • Analyse complex datasets and build efficient data models. • Deliver robust, production-ready ETL/ELT pipelines. • Collaborate with other engineers to deliver high-quality cloud data solutions. Essential Skills • Strong commercial experience with Azure Databricks. • Excellent Python and PySpark skills. • Strong SQL and core Data Engineering experience. • Experience building enterprise-scale data pipelines. • Experience with batch and streaming data processing. • Understanding of Unity Catalog and core Databricks functionality. Desirable • Azure DevOps. • CI/CD pipelines. • Infrastructure as Code. • Experience working within enterprise Azure environments. What We're Looking For We're looking for engineers who: • Have strong technical and problem-solving skills. • Can work independently with minimal supervision. • Produce clean, maintainable, production-quality code. • Enjoy working in highly technical engineering teams. • Take ownership and pride in delivering high-quality solutions. Technology Stack Azure Databricks • Python • PySpark • SQL • Azure Data Lake • Unity Catalog • Databricks Jobs • Batch & Streaming Processing • Git • Azure DevOps What's on Offer • £425/day. • Outside IR35. • Fully remote within the UK. • Long-term contract. • Immediate interview process. Opportunity to work on large-scale cloud data engineering programmes. Interested? If you're an experienced Python / PySpark Data Engineer with strong Azure Databricks experience and you're looking for your next Outside IR35 contract, we'd love to hear from you. Apply today or send your CV for a confidential discussion. We're reviewing applications as they come in, with interviews taking place on a rolling basis.