Senior Data Engineer

We are seeking seven highly skilled Data Engineer IV professionals to lead the design, development, testing, and optimization of enterprise data solutions within the Azure ecosystem. This role requires deep expertise in Databricks, Azure Data Factory, Spark, SQL, and Power BI, along with strong leadership capabilities and the ability to work independently in a fast-paced Agile environment. The ideal candidate will be responsible for building and supporting scalable data pipelines that move data from source systems into Azure Data Lake environments for reporting, analytics, and business intelligence. Candidates must have extensive experience working with Databricks, Unity Catalog, Delta Tables, and Power BI reporting solutions while ensuring data quality through effective unit and system testing practices • . Design, develop, and maintain scalable data pipelines using Databricks and Azure Data Factor • y.Develop Spark-based data transformation and processing solutions for large-scale data environment • s.Move and transform data from various source systems into Azure Data Lake environment • s.Utilize Databricks Unity Catalog and Delta Tables to manage and optimize enterprise data asset • s.Develop and support Power BI datasets, semantic models, reports, dashboards, and visualization • s.Partner with business stakeholders to understand reporting and analytics requirement • s.Perform unit testing, integration testing, and system testing to ensure complete and accurate data processin • g.Validate that all required files and transactions are successfully captured and processe • d.Troubleshoot and resolve data pipeline and reporting issue • s.Participate in Agile ceremonies and contribute to sprint planning, backlog grooming, and delivery activitie • s.Lead technical discussions, mentor team members, and promote engineering best practice s. Job Qualificati • onsDatabricks: 5+ years of experie • nceDatabricks Certification requi • redStrong experience with Databricks architecture, optimization, and developm • entAzure Data Factory: 5+ years of experie • nceSQL: 5+ years of strong hands-on development experie • ncePower BI Development: 3+ years of experience creating enterprise dashboards, reports, and data mod • elsStrong Spark programming experie • nceExperience with Azure Data Lake environme • ntsExperience working with Unity Catalog and Delta Tab • lesStrong understanding of data integration, transformation, and validation proces • sesExperience performing unit testing and system testing of data soluti • onsStrong verbal and written communication ski • llsStrong understanding of Agile development methodolog • iesProven ability to function as a technical lead and mentor junior team memb • ersPreferred Qualificati • onsExperience within large enterprise data environme • ntsAzure cloud certificati • onsExperience with CI/CD and DevOps practices for data engineer • ingKnowledge of data governance, data quality, and security best practi • cesLeadership Expectati • onsLead and influence technical solution design and implementati • on.Provide guidance and mentorship to other enginee • rs.Drive best practices related to data engineering, testing, and reporti • ng.Communicate effectively with technical and business stakeholde • rs.Take ownership of deliverables and provide proactive issue resoluti on. Top Required Sk • illsDatabricks (5+ years) - Certification Requ • iredAzure Data Factory (5+ ye • ars)Strong SQL Development (5+ ye • ars)Power BI Develop • mentSpark Program • mingUnity Catalog & Delta Ta • blesAzure Data • LakeAgile Methodo • logyStrong Communication Sk • illsTechnical Leadership Experi ence