Senior Data Engineer : Energy Trading : Databricks + IceBurg

Exciting Contract Opportunity for a hands-on Data Engineer with strong business-facing skills to join a Global Energy Trading Company. The role will involve delivering high-performance market data solutions that directly support trading strategies and pre- and post-trade analytics. This is a hybrid technical and business facing role, sitting at the intersection of engineering, trading and data. Key Responsibilities: • Evaluating, onboarding, and integrating complex data products from diverse vendors, serving as a key technical liaison to ensure data feeds meet the stringent requirements for research and live trading • Build and maintain high-performance tick data pipelines for ingesting, processing, and storing large volumes of market data • Providing expert operational support for the data pipelines, diagnosing and resolving issues to ensure uninterrupted flow of high-availability data powering trading activities • Implement robust data validation, monitoring, and error handling to ensure data integrity and uptime • Collaborate with trading and engineering teams to define data requirements and deliver production-grade solutions Experience: • Experience using Databricks, Iceberg, ADF, Kafka and Cosmos DB • 8+ years’ experience in Commodity Trading & Capital Markets / Investment Banking • Strong understanding of global futures exchanges and the full exchange-traded derivatives lifecycle • 5+ years working with large-scale market, order/execution, and positions data • Proven experience with real-time market data platforms, feed handlers, and consolidated feeds • Strong Python Experience with solid SQL and scripting (PowerShell/Bash) • Experience with time-series databases (KDB, OneTick) and Parquet-based storage • Comfortable operating as a technical SME and business analyst in a trading-room environment With a focus within Energy Trading, Oil & Gas, Financial Markets and Commodities, we offer a transparent Recruitment Service that has proven to be reliable and effective for over 40 years. We are ISO accredited and proud of our excellent TrustPilot Reviews. Your search for a New Contract Assignment or for a New Permanent Job will be in safe hands with Eaglecliff Recruitment. Please telephone for an immediate response or email your CV for a quick response. Eaglecliff Ltd is acting in the capacity of an employment agency for permanent recruitment and an employment business for contractor resourcing.