Lead Data Engineer with AI Chatbot - W2 Position

Job Title: Lead Data Engineer Location: Berkeley Heights, NJ (Day 1 Onsite) Employment Type: Long-Term Contract (W2 Position) Job Description: We are seeking a highly skilled Lead AWS Data Engineer with strong hands-on experience in building scalable data solutions on AWS. The ideal candidate will have deep expertise in data engineering, cloud technologies, and leading data-driven initiatives. Key Responsibilities: • Design, develop, and maintain scalable data pipelines using AWS services • Lead end-to-end data engineering solutions from ingestion to transformation and loading • Work closely with cross-functional teams including Data Scientists, Analysts, and Architects • Optimize and monitor data workflows for performance, reliability, and cost-efficiency • Implement data governance, security, and compliance best practices • Mentor junior engineers and provide technical leadership • Collaborate with stakeholders to understand business requirements and translate them into technical solutions Required Skills: • 10+ years of experience in Data Engineering • Strong hands-on experience with AWS services (S3, Glue, Redshift, Lambda, EMR), Power BI, AI/ML, AI native, AI Devlopement, AI Chatbot • Proficiency in Python / PySpark / SQL • Experience with ETL/ELT pipeline development • Strong knowledge of data warehousing concepts • Experience with Apache Spark / Hadoop ecosystem • Familiarity with CI/CD pipelines and DevOps practices • • Excellent problem-solving and communication skills Preferred Qualifications: • Experience in Banking / Financial domain • Knowledge of streaming technologies (Kafka, Kinesis) • AWS Certification (e.g., AWS Certified Data Analytics or Solutions Architect) • Experience with Airflow or other orchestration tools