Sr Data Engineer (Azure) ($50/hr)

We are seeking a highly skilled Senior Data Engineer to design, build, and optimize large-scale data solutions on the Azure platform. The ideal candidate will have hands-on expertise with Databricks, PySpark, Azure Data Factory, Synapse, and other Azure cloud services, combined with strong SQL and Python skills. This role requires both engineering depth and a collaborative mindset to deliver robust, high-performing data pipelines and support enterprise-wide analytics. Key Responsibilities • Design and develop scalable data pipelines leveraging existing ingestion frameworks and tools. • Orchestrate and monitor pipelines using Azure Data Factory (ADF) and Delta Live Tables (DLT). • Build and enhance data transformations to parse, transform, and load data into Enterprise Data Lake, Delta Lake, and Enterprise Data Warehouse (Synapse Analytics). • Configure compute resources, define data quality (DQ) rules, and perform pipeline maintenance. • Conduct unit testing, coordinate integration testing, and support UAT cycles. • Prepare and maintain documentation including high-level design (HLD), detailed design (DD), and runbooks for data pipelines. • Optimize and tune performance of ETL processes and data pipelines. • Provide production support for deployed data solutions, troubleshooting and resolving issues promptly. • Collaborate with cross-functional teams and contribute to design and architecture discussions. Must-Have Skills • Hands-on experience with Databricks (Data Engineering), PySpark, and Delta Live Tables (DLT). • Strong expertise with Azure Data Factory, Azure Synapse (Dedicated SQL Pool), and SQL. • Proficiency in Python, with additional experience in Azure Function Apps and Azure Logic Apps. • Experience with Azure DevOps for CI/CD, version control, and pipeline automation. • Strong background in performance tuning and data pipeline optimization. • Proven ability to create technical documentation (HLD, DD, runbooks). • Solid understanding of data modeling, ETL design, and cloud-based data warehousing. Good-to-Have Skills • Experience with Precisely or similar data integration/quality tools. • Exposure to enterprise-scale data governance practices. Qualifications • Bachelor’s or Master’s degree in Engineering, Computer Science, or a related field. • 5–7 years of hands-on data engineering experience (3–5 years for Associate-level). • Strong problem-solving skills with ability to work independently and as part of a team. • Excellent communication and collaboration skills, with experience working in enterprise environments.