Senior Data Engineer

Senior Data Engineer • Inside IR35 Contract • 3 Days per Week in London • 6-Month Initial Contract (2 Years+ Project Scope) • Start Date : April 2026 We are working alongside a leading Commodities Trading Firm who are searching for a Senior Data Engineer to join the business. You'll be building pipelines to support their trading and analytics platforms! Project & Responsibilities • Design and develop scalable Python-based data pipelines using Dagster to ingest, transform and integrate datasets into the enterprise data platform. • Build ingestion frameworks to extract data from internal systems, trading platforms, APIs, and external providers, supporting both batch and real-time data flows. • Implement streaming data integrations using Apache Kafka to enable event-driven processing and near real-time analytics. • Land and manage curated datasets within AWS storage environments, ensuring data integrity, scalability and cost efficiency. • Apply strong data governance practices including validation, lineage tracking, schema consistency and secure access controls across the data platform. • Ensure production stability and operational reliability of data pipelines through monitoring, alerting, logging and proactive incident management. • Break down complex data integration initiatives into structured technical deliverables, defining implementation strategies and mitigating delivery risks. • Provide engineering leadership through code reviews, CI/CD best practices, mentoring engineers and promoting scalable, maintainable data platform solutions. Technical Skill Set Required • Strong Python data engineering experience, including orchestration with Dagster, advanced SQL, and data modelling. • Experience building streaming and event-driven pipelines using Apache Kafka and integrating heterogeneous data sources. • Solid background operating cloud-native data platforms on Amazon Web Services, with CI/CD, version control and production operations experience. jevans@hunterbond.com for more details