Senior Azure Data Engineer (W2/1099 Only)

Role: Data Engineer Location: Remote Job Summary We are seeking a highly skilled Azure Data Engineer with strong expertise in Databricks, Azure data services, and modern data engineering practices. The ideal candidate will have hands-on experience designing, building, and optimizing scalable data pipelines and enterprise-grade lakehouse architectures in hybrid cloud environments. Key Responsibilities • Design, build, and orchestrate scalable data pipelines using Azure-native services. • Develop and optimize batch and near real-time data processing solutions using Spark and Databricks. • Implement and manage enterprise-grade Lakehouse architectures (Medallion architecture). • Perform data processing, validation, and automation using Python (PySpark, Pandas, NumPy). • Optimize performance of large-scale data systems, including Spark tuning and query optimization. • Work with CDC (Change Data Capture) pipelines and large-volume data ingestion. • Collaborate with cross-functional teams to deliver secure, scalable, and high-performance data platforms. • Implement CI/CD pipelines and DevOps best practices for data engineering workflows. Required Skills & Experience • Strong experience with Azure Databricks, including notebooks, clusters, and Delta Lake. • Hands-on expertise in Azure Data Factory (ADF) and pipeline orchestration. • Proficiency in Python (PySpark, Pandas, NumPy) and SQL. • Experience with Spark SQL, performance tuning, and distributed data processing. • Solid understanding of Azure ecosystem: ADLS, Synapse Analytics, Azure Functions, Event Grid, Key Vault, Purview. • Knowledge of dimensional data modeling and analytics solutions.