Lead Data Engineer

Job Description We are seeking an experienced Technology Lead / Lead Data Engineer with strong hands-on expertise in Python, AWS, and SQL. The ideal candidate will lead data engineering initiatives, build scalable data processing pipelines, and collaborate closely with architecture and business teams in a client-facing environment. This role requires strong technical leadership, experience working in Agile delivery models, and prior exposure to enterprise or financial industry environments. Key Responsibilities • Design, develop, and maintain scalable data engineering solutions using Python • Build and optimize data processing, transformation, and orchestration pipelines • Work extensively with AWS cloud services for data storage, processing, and deployment • Collaborate with architects, business analysts, and stakeholders to gather and refine requirements • Translate business needs into technical solutions and system designs • Participate in design discussions and provide technical leadership for data platforms • Ensure data quality, performance, and reliability across pipelines • Work in an Agile/Scrum environment with distributed (onshore/offshore) teams • Support integration of AI/ML-related initiatives where applicable • Engage directly with client teams for requirement gathering and solution delivery Required Skills & Qualifications • 10+ years of experience in Data Engineering or related field • Strong hands-on experience in Python for data engineering • Proven experience with AWS cloud services (e.g., S3, Glue, Lambda, EMR, Redshift, etc.) • Strong proficiency in SQL and data modeling • Experience in data transformation and orchestration frameworks • Strong communication skills and client-facing experience • Experience working in Financial Services or Banking domain preferred • Ability to work onsite/hybrid in Irvine, CA