We’re seeking a Senior Data Engineer with strong experience in GCP, Spark, BigQuery, SQL, and Scala/Python to support the migration of data workloads from a Hadoop On-Prem cluster to GCP. This role will involve building scalable, high-performance pipelines, designing robust data models, ensuring data quality, and supporting BI/reporting needs in a highly collaborative environment. Responsibilities • Build and optimize data pipelines in GCP using Spark on DataProc and BigQuery • Design and implement data models/schemas to support analytical and operational use cases • Develop automated data quality checks and ensure data integrity and SLA compliance • Contribute to data ingestion from varied sources (DBMS, APIs, file systems, streaming) • Translate complex business requirements into scalable technical solutions • Support development of dashboards and semantic layers, integrating data from Teradata, Hive, HBase, and BigQuery • Build REST APIs for hosted models, ensuring proper logging, authentication, and error handling • Collaborate with analysts and data scientists to produce models and KPIs • Lead migration efforts from Hadoop to GCP, ensuring security, governance, and performance • Document architecture, perform testing (CIT/SIT/UAT), and support platform monitoring • Ensure alignment with enterprise data governance, logging, and security policies Qualifications • GCP / BigQuery – 1+ years of hands-on development • Scala or Python – 3+ years building scalable data applications • SQL – 3+ years of advanced querying and data modeling Required Skills • Experience with LookML or semantic layer design • GCP Certification (Associate or Professional) • Master’s Degree in a related field (Computer Science, Data Engineering, etc.) Preferred Skills • Languages/Tools: Scala, Python, SQL, Spark, BigQuery, REST APIs • Platforms: GCP (DataProc, BigQuery), Hadoop (On-Prem), Teradata, Hive, HBase • Concepts: Agile Development, Cloud Data Architecture, Big Data Management, ETL, Performance Optimization, Data Governance