Lead Data Engineer

Job Summary: We are seeking a highly experienced Lead Data Engineer to help drive the next evolution of our enterprise data, analytics, and AI ecosystem. In this role, you will lead the design, development, and optimization of a modern AWS + Databricks Lakehouse platform while partnering closely with business and technical stakeholders to deliver scalable, high-performance data solutions .This is a hands-on technical leadership role requiring expertise in data engineering, cloud technologies, ETL/ELT, and modern data architecture . Key Responsibiliti • esDesign, develop, and maintain enterprise-grade batch and streaming data pipeline • s.Lead the full ETL/ELT lifecycle from design through deployment and production suppor • t.Build scalable, secure, and high-performance data solutions using AWS and Databrick • s.Drive data engineering best practices, architecture standards, and governanc • e.Optimize Databricks workloads for performance and cost efficienc • y.Implement and manage Delta Lake, Unity Catalog, Delta Live Tables (DLT), Databricks SQL, and workflow orchestratio • n.Collaborate with business stakeholders to translate requirements into scalable technical solution • s.Mentor junior engineers while remaining hands-on with developmen • t.Ensure data quality, reliability, governance, and operational excellenc • e.Participate in Agile ceremonies and contribute to continuous improvement initiative s.Required Qualificatio • ns10+ years of IT experience with strong expertise in Data Engineering and ET • L.4–6+ years of recent hands-on experience designing and building large-scale data pipeline • s.Strong experience wit • h:Databric • ksApache Spa • rkDelta La • keUnity Catal • ogDelta Live Tables (DL • T)Databricks S • QLStrong AWS experience includin • g:Amazon • S3I • AMNetworki • ngE • C2Expertise in SQL, Python, data modeling, and distributed data processin • g.Experience with Lakehouse architecture and Medallion architectur • e.Experience with CI/CD, DevOps, and workflow orchestratio • n.Strong understanding of Databricks performance tuning and cost optimization, includin • g:Cluster sizi • ngAuto Scali • ngSpot Instanc • esPhoton Engine optimizati • onData shuffle optimizati • onExperience designing, configuring, coding, testing, and deploying enterprise data platform • s.Strong communication skills with the ability to work directly with business stakeholder • s.Experience working in Agile environment s.Preferred Skil • lsLeadership or mentoring experienc • e.Strong analytical and problem-solving skill • s.Experience supporting enterprise analytics and AI initiative • s.Passion for learning new technologies and modern data platform s.Technical Skil • lsDatabric • ksApache Spa • rkDelta La • keUnity Catal • ogDelta Live Tables (DL • T)Databricks S • QLAWS (S3, IAM, EC2, Networkin • g)Pyth • onS • QLETL / E • LTData Modeli • ngDistributed Processi • ngLakehouse Architectu • reMedallion Architectu • reCI/ • CDDevO • psAgi leInterview Proce • ss60–90 minute technical interview focused on architecture, Databricks, AWS, and hands-on desig • n.30–45 minute behavioral/team fit interview with the hiring manage r.