Senior Data Engineer

Our Client, a Global Financial Services Firm, is seeking a Data Engineer in their New York, NY location. Join a global Risk Technology team building and supporting an enterprise risk platform that enables Risk Management to oversee market and credit exposures across the firm. This platform powers the measurement, analysis, reporting, and control of risk at scale. We’re looking for a hands-on Data Engineer to design and operate high-scale, cloud-native data pipelines and deliver reliable, performant data solutions that support critical risk decisions. What You’ll Do • Design, implement, and operate ETL/ELT pipelines in Python to ingest, cleanse, transform, and publish data into Snowflake • Build scalable Snowflake data models and SQL transformations (tables, views, materialized views) • Optimize Snowflake performance using micro-partitioning, clustering keys, Streams/Tasks, and query profiling • Engineer event-driven integrations using AWS services (S3, SQS, Lambda) for near-real-time data processing • Optimize distributed computation using strong data structures, partitioning strategies, vectorization, and columnar formats • Implement cache-aside patterns using ElastiCache/Redis to improve performance and reliability • Own observability across pipelines: metrics, logging, tracing, cost monitoring, and operational runbooks • Partner with risk, engineering, and product stakeholders to deliver scalable and resilient data solutions Required Experience & Skills • 8+ years of data engineering experience building production-grade Python pipelines at scale • Strong ETL/ELT architecture experience across batch and streaming environments • Deep Snowflake expertise: schema design, clustering, Streams/Tasks, query tuning, and cost optimization • Strong understanding of distributed systems, concurrency, idempotency, and data reliability patterns • Experience with Kubernetes and containerized compute within AWS environments • CI/CD implementation, unit testing (pytest), and observability tooling (CloudWatch, Prometheus, Grafana, OpenTelemetry) Nice to Have • Experience building responsive, modular UIs using React (hooks, context, functional components) and TypeScript/JavaScript • Exposure to real-time or event-driven data architectures in enterprise environments