Senior Python Data Engineer

Senior Data Engineer (Python Enterprise Developer) • Position: Senior Data Engineer (Python Enterprise Developer) • Location: London (Canary Wharf) • Work Mode: Hybrid (4 days per week onsite) • Contract Duration: Long-term Contract • Recruitment Agency: Norton Blake About the Client Norton Blake is partnering with a premier, global player within the Energy & Trading sector to find a heavyweight Senior Data Engineer. This is a long-term contract opportunity based in their state-of-the-art Canary Wharf office, offering the chance to lead and architect enterprise-grade data solutions within a fast-paced, high-impact environment. The Role As a Senior Data Engineer, you will bridge the gap between heavy-duty data engineering and core Python enterprise development. You will take technical ownership of designing, optimizing, and scaling native Python ETL pipelines and robust data processing frameworks. Given the nature of the trading floor, this role demands someone who thrives under agility, coordinates seamlessly across global time zones, and brings a strong, motivated leadership presence to the technical team. Key Responsibilities • Pipeline Architecture: Lead the design, end-to-end development, and optimization of highly scalable data pipelines and enterprise-grade Python applications. • Technical Leadership: Serve as the subject matter expert for Python development, championing best practices for automation, scraping, data processing, and integration workflows. • Data Manipulation: Extract and process complex datasets using data-centric libraries (Pandas, NumPy, Polars) and scraping/parsing tools (BeautifulSoup, Selenium, Requests, pdfplumber). • Database & Cloud Management: Architect and optimize complex SQL queries in PostgreSQL. Manage and deploy cloud-based workflows seamlessly across AWS (S3) and Azure Databricks. • DevOps Integration: Embed CI/CD best practices using Azure DevOps, Jenkins, and Git to ensure smooth, automated deployments. • Agile Delivery: Drive project delivery using Scrum/Agile methodologies, coordinating effectively with cross-functional teams across multiple geographic locations. Must-Have Skills & Experience • Industry Experience: A proven track record working within the Energy Trading or broader trading/commodities domain is essential. • Experience Level: 8+ years of dedicated experience in Python scripting and data engineering. • Core Tech Stack: Deep proficiency with Python, Postgres SQL, Azure Databricks, AWS (S3), Git, Azure DevOps CI/CD, and Apache Airflow. • Python Ecosystem: Extensive, recent hands-on experience utilizing NumPy, Pandas, Polars, BeautifulSoup, Selenium, and Requests. • Data Ecosystems: Strong background in building native Python ETL pipelines for data scraping/processing. Big Data experience or knowledge of Spark is highly advantageous. ⚠️ Important Note for Applicants • Recent Hands-On Code Execution is Required: This role is for a pure, active developer. If your recent experience has drifted into pure management or architecture without daily coding, this will not be the right fit. • Technical Assessment: Candidates must be fully prepared to complete a rigorous live technical assessment/coding questions focusing on core Python and data engineering competencies. • Industry experience: Must have experience operating within the energy trading sector How to Apply If you have the recent, deep-dive Python expertise and the Energy Trading background required to excel in this role, the team at Norton Blake wants to hear from you. Please submit your CV highlighting your recent hands-on projects within trading environments.