Data Engineer

Data Engineer McLean, VA - Onsite 12 months contract Job Summary We are looking for an experienced Data Engineer with strong expertise in Snowflake, PySpark, and AWS to design and implement scalable data solutions. The ideal candidate will be responsible for building robust data pipelines, optimizing data workflows, and enabling advanced analytics by ensuring seamless integration across various data platforms. Key Responsibilities • Design, develop, and maintain ETL/ELT pipelines using PySpark and AWS services. • Work with Snowflake to design efficient schemas, optimize queries, and manage large-scale datasets. • Develop scalable and reliable data ingestion and transformation workflows. • Collaborate with data analysts, scientists, and business stakeholders to deliver high-quality data solutions. • Implement best practices for data governance, security, and performance tuning. • Monitor, troubleshoot, and optimize data pipelines for performance and cost efficiency. • Support migration and integration of data from legacy systems to Snowflake on AWS. Required Skills & Qualifications • Strong hands-on experience with Snowflake (data modeling, query optimization, Snowpipe, tasks, streams). • Proficiency in PySpark for large-scale data processing and transformations. • In-depth knowledge of AWS cloud services (S3, Glue, Lambda, EMR, Redshift, EC2, IAM). • Strong SQL skills and experience with performance tuning in Snowflake/relational databases. • Experience building and managing data pipelines in production environments. • Familiarity with CI/CD pipelines and version control (Git). • Excellent problem-solving, analytical, and communication skills. Preferred Qualifications • Experience with orchestration tools (Airflow, Step Functions, or similar). • Exposure to data lake and data warehouse architectures. • Knowledge of Python for automation and scripting. • Experience with Agile/Scrum methodologies.