Azure Data Engineer

Azure Data Engineer • Contract: 1+ year • Hybrid: 2-3 Days / Week • Locations: Dallas area, TX • Open on c2c or w2 Azure Data Engineer (Python & Azure) We are looking for an Azure Data Engineer with strong Python development and containerization experience to build scalable, cloud-native data solutions. The ideal candidate will have expertise in Azure services, ETL pipeline development, automation, and data governance. Key Responsibilities • Develop Python-based ETL pipelines integrating data from APIs, JDBC/ODBC, and batch sources. • Build and manage Apache Airflow DAGs using reusable, modular frameworks. • Design and deploy containerized solutions with Docker and AKS. • Work with Azure SQL Managed Instance to manage metadata, classifications, and access controls. • Implement data governance using Microsoft Purview for cataloging, tagging, and lineage. • Configure Azure services including Blob Storage, Key Vault, Azure Monitor, Functions, and AKS. • Develop CI/CD pipelines using Azure DevOps. • Enforce security through service accounts, least-privilege access, and data masking policies. • Analyze audit logs and develop reporting for usage and compliance monitoring. • Create reusable code, documentation, and automation standards. Required Qualifications • 5+ years of Data Engineering experience with strong Python development skills. Hands-on experience with: • Python, ETL development, logging, and error handling • SQL development and performance tuning • Azure services (AKS, Blob Storage, Key Vault, Azure Monitor, Service Principals, Azure Functions) • REST APIs and multi-source data ingestion • Docker and container lifecycle management • Service account management and data security • Terraform, Git, and CI/CD best practices • Data governance, PII/PCI classification, and compliance standards (SOX, GDPR, etc.) Preferred Skills • Microsoft Purview for data cataloging and classification. • Power BI data lineage and report-level security experience. • AI enthusiast.