Senior Data Engineer

Lead Data Engineer (Contract – Outside IR35) Remote The Opportunity Our client, a market-leading organisation at the forefront of property data and technology, is looking for a contract Lead Data Engineer to join their team on a key project. This is a contract assignment, offering the chance to deliver complex data engineering solutions in a hands-on role, while guiding and supporting a team of engineers through delivery. This position is well-suited to an experienced contractor who thrives on rolling up their sleeves, taking ownership of project delivery, and ensuring engineering best practices are consistently applied. Key Responsibilities • Lead the technical delivery of data engineering projects, ensuring pipelines and infrastructure are designed, built, and optimised effectively. • Work hands-on with cloud and big data technologies (AWS or Azure, Hadoop, Spark, Kafka). • Mentor and coach engineers, supporting them to overcome challenges and maintain high-quality standards. • Contribute directly to coding, configuration, automation, and troubleshooting of data solutions. • Build, manage, and optimise large-scale data sets to meet project requirements. • Ensure data quality, performance, and availability through monitoring and problem resolution. • Develop ETL workflows and data pipelines using tools such as Azure Data Fabric (ADF), Databricks, and related technologies. • Keep solutions efficient and cost-effective within agreed project budgets. About You The successful Lead Data Engineer will be delivery-focused, highly technical, and confident working in a project-driven environment. You will bring: • Strong coding skills in at least two of: Python, PySpark, Scala, Java, or Spark. • Extensive hands-on experience with big data environments (design, coding, configuration, monitoring, automation, security). • Proven expertise with AWS or Azure data platforms. • Strong background in ETL development and modern data lakehouse technologies. • Ability to guide and mentor engineers in best practices and technical delivery. • Excellent problem-solving and troubleshooting skills. • Strong communication skills to work with engineers and stakeholders effectively. Nice to Have • Advanced SQL and database optimisation skills. • Familiarity with data warehousing design patterns. • Relevant industry certifications (AWS, Azure, Cloudera). Why This Role? This is a hands-on contract where you’ll deliver impactful data engineering solutions at scale, working with modern cloud and big data technologies. You’ll have the chance to lead projects from a technical perspective while remaining deeply involved in delivery — ideal for contractors who enjoy being close to the code while guiding others.