Senior Data Engineer

Position: Senior Data Engineer Location: Charlotte, NC 28217 – 3x onsite Hybrid Duration: 6-month contract and extending Pay Rate: Starting at $60/hr - has flexibility Interview Process: 1 round Insight Global is looking for a Senior AWS Data Engineer to work on MDM project, an enterprise platform that creates a trusted view of business data. This role is hands-on and focused on building scalable data pipelines, improving data quality, and supporting entity resolution and ML-assisted matching. This is ideal for someone who enjoys working with large datasets and owning production-grade pipelines on AWS. What You’ll Do • Build and maintain data pipelines on AWS • Develop ETL jobs using AWS Glue (PySpark) and Amazon EMR • Orchestrate workflows using Apache Airflow • Support full and incremental data processing • Implement data matching, deduplication, and entity resolution • Monitor, troubleshoot, and support production pipelines • Partner with analytics and business teams Required Skills • Strong AWS data engineering experience • Python and PySpark development • Hands-on with AWS Glue and Amazon EMR • Experience using Apache Airflow • Strong SQL skills • Experience working with large datasets • Familiarity with ML concepts for data quality or matching Nice to Have • Experience with entity resolution, fuzzy matching, or deduplication • Experience with AWS Entity Resolution • Experience in Business MDM programs Experience • 6+ years of experience in data engineering or related roles