Lead GCP Data Engineer

We are seeking experienced Data Engineers to support a largescale data platform transformation for a leading banking client. This role focuses on building Spark-based data pipelines and enabling data movement between GCP (Google Cloud Platform) and on-prem systems (DPC) based on governance and model requirements. Key Responsibilities • Design and build scalable ETL/data pipelines using Spark and Python • Develop data workflows to ingest, transform, and move large datasets • Implement data routing logic to direct data to: GCP (BigQuery, Dataflow, Dataproc) On-prem platforms (DPC) • Ensure data quality, validation, and reconciliation across systems • Collaborate with data science and platform teams to support predictive model pipelines • Optimize performance and scalability for high-volume data processing Required Skills • Strong hands-on experience with Apache Spark / PySpark for large-scale data processing • Proficiency in Python for data engineering (ETL pipelines) • Experience designing and developing data pipelines / data engineering workflows • Solid background in ETL, data ingestion, transformation, and data movement • Experience working with big data technologies and handling large datasets (batch/streaming) • Experience with cloud platforms – GCP (Google Cloud Platform) • BigQuery, Dataflow, Dataproc, GCS (Google Cloud Storage) • Experience with data migration / data integration projects • Understanding of data pipeline architecture and distributed systems Preferred Skills • Experience with GCP (BigQuery, Dataflow, Dataproc, GCS) • Exposure to hybrid environments (cloud + on-prem) • Familiarity with ML/data pipelines (supporting models, not building them) • Experience in financial services / banking domain (nice to have) Euclid Innovations is an Equal Opportunity Employer We do not discriminate against any applicant or employee based on race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other legally protected characteristic. At Euclid Innovations, we embrace individuals of all abilities and strive to ensure that our hiring and interview processes are accessible and accommodating to meet the needs of all applicants.