GCP Big Data Engineer

Client: American Express (Amex) Location: Phoenix, Arizona (Local candidates Preferred) Visa eligibility: OPT, CPT, H4 EAD or L2 Contract: W2 Rate: DOE About the Role We are seeking a highly skilled and experienced Big Data Engineer with strong expertise in Python, Spark, and Google Cloud Platform (GCP). The ideal candidate will have at least 8+ years of experience in big data technologies and should be capable of designing, building, and optimizing scalable big data pipelines and platforms. Responsibilities • Design and develop large-scale data processing systems using Spark and Python. • Build and maintain scalable data pipelines and ETL processes on GCP. • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions. • Ensure performance optimization, scalability, and reliability of big data solutions. • Implement best practices for data governance, quality, and security. • Troubleshoot and resolve production issues related to big data applications. • Stay updated with the latest big data and cloud technologies to recommend improvements. Required Skills • 8+ years of professional experience in big data engineering. • Strong hands-on experience with Python and Apache Spark. • Proven expertise in Google Cloud Platform (GCP) big data services (e.g., BigQuery, Dataflow, Dataproc, Pub/Sub). • Solid understanding of distributed systems and cloud-native architecture. • Experience with data lake and data warehouse implementations. • Proficiency in SQL and performance tuning. • Strong problem-solving and debugging skills. Preferred Skills • Experience with CI/CD pipelines for data solutions. • Knowledge of other cloud platforms (AWS, Azure) is a plus. • Familiarity with containerization (Docker, Kubernetes). • Experience with workflow orchestration tools (Airflow, Cloud Composer).