Senior Data Engineer

Senior Data Engineer | £500 - £550 We're working with a leading global investment firm on this exciting opportunity. We are looking for a heavy-hitting Data Engineer to architect and deploy high-performance ELT pipelines that drive critical operational decision-making at scale. In this role, you will bridge the gap between complex raw data and actionable intelligence, leveraging a modern cloud-native stack centered around Python, SQL, and AWS. If you thrive in an agile, high-stakes finance environment where code quality and architectural resilience are paramount, this is your next challenge. The Role • Design and implement end-to-end ELT pipelines for real-time analysis, ensuring scalable outcomes across development, test, and production environments. • Write high-quality, testable, and readable Python code, participating in rigorous code reviews and maintaining best-in-class engineering standards. • Build and maintain cloud infrastructure using Infrastructure as Code (IaC) tools including Terraform or CloudFormation. • Work closely with Scrum Masters and Product Owners within an Agile framework to ensure data effectively enables the client experience. • Own the full deployment lifecycle, from sourcing diverse data sets to presenting clear, high-impact outputs for internal business stakeholders. What You'll Need • Deep proficiency in Python and SQL with a proven track record of delivering data solutions in AWS cloud environments. • Extensive experience with data transformation and processing tools such as PySpark or Pandas. • Professional experience implementing data quality frameworks, specifically Great Expectations, to ensure pipeline integrity. • Strong hands-on experience with IaC (Terraform/CloudFormation) and a solid understanding of software development best practices (Unit Testing, CI/CD). • Exceptional communication skills with the ability to translate technical complexities for non-technical stakeholders in a fast-paced environment. What's On Offer • Competitive daily rate of £500 - £550 inside IR35. • Hybrid working model providing a perfect balance between London-based collaboration and remote flexibility. • Opportunity to work with a world-class engineering team within a premier investment firm. • Exposure to cutting-edge technologies including graph databases and advanced cloud-native data architecture. Apply via Haystack today!