Azure - Sr. Data Engineer

Local candidates only - in-person interview is a MUST Duration - 6+ months Location - Chicago Downtown - onsite Tue, Wed and Thu Rate - 65-73/hour W2 Key Responsibilities • Design, build, and support end-to-end data pipelines (ingestion, transformation, validation, publishing). • Develop and optimize SQL and PySpark/Databricks transformations for large datasets. • Build production-grade Python components (reusable modules, logging, error handling, testing). • Create and maintain Azure Data Factory (ADF) pipelines (triggers, parameterization, monitoring, failure handling). • Work within Azure environments (ADLS Gen2, Azure SQL, resource groups, portal operations). • Provision and maintain Azure components using Pulumi (Infrastructure as Code). • Participate in code reviews, documentation, and operational support Must-have Skills (Required) • 7+ years experience as a data engineer • 3+ years doing ETL / ELT Concepts: Strong understanding of pipeline patterns, incremental loads, data validation, and troubleshooting. • 3+ years in SQL: Advanced querying (CTEs, views, joins, complex query logic) and performance tuning for transformations and validation. • 2+ years using Python: Production-quality development (modular code, testing, logging, integration with APIs/files, CICD, Unit Test/Integration test automation, Code Coverage). • PySpark: Distributed transformations and performance optimization, CICD, Unit Test/Integration test automation, Code Coverage. • 2+ years using Azure Data Factory (ADF) • 2+ year using Databricks #TECH #Chicagohybrid