Job Title: Sr Cloud Data Engineer Client: Workato Location: SFO, CA Employment Type: Longterm Contract W2 Job Summary: We are seeking a skilled Cloud Data Engineer with expertise in designing, developing, and optimizing large-scale data pipelines and analytics solutions on Azure and/or AWS. The ideal candidate will have strong experience with ETL processes, big data technologies, and real-time analytics, as well as proficiency in cloud infrastructure setup and management. Key Responsibilities: • Design, develop, and maintain scalable ETL pipelines and data workflows using modern tools and frameworks. • Work with Azure Data Services and/or AWS Data Services to implement cloud-based data solutions. • Build and orchestrate data pipelines with Luigi, Airflow, or similar workflow management tools. • Integrate, process, and analyze large datasets using Hadoop, Spark, and other big data technologies. • Develop and maintain data lakes, data warehouses, and real-time analytics solutions. • Collaborate with data scientists, analysts, and business teams to deliver reliable, high-performance data solutions. • Implement cloud infrastructure best practices, ensuring scalability, performance, and cost efficiency. • Monitor, troubleshoot, and optimize data workflows for quality and efficiency. Required Skills & Qualifications: • Proven experience as a Data Engineer or similar role in cloud environments (Azure and/or AWS). • Strong expertise in ETL processes, data ingestion, and data transformation. • Proficiency with big data tools (Hadoop, Spark, Hive, etc.). • Experience building and managing data pipelines and workflow orchestration using Luigi, Airflow, etc. • Hands-on experience with data lakes, data warehouses, and real-time streaming frameworks (Kafka, Kinesis, etc.). • Solid understanding of cloud infrastructure and deployment automation. • Knowledge of relational and NoSQL databases. • Strong problem-solving skills and ability to work in cross-functional teams. Nice to Have: • Experience with DevOps for data engineering (CI/CD pipelines, Infrastructure as Code – Terraform, CloudFormation). • Familiarity with machine learning data pipelines. • Exposure to multi-cloud environments.