Emp Type: W2 or 1099........ (No C2C) Visa: H1B, H4EAD, GCEAD, L2, OPT, CPT,Green Card, US Citizens (Only USA Applicants) Workplace Type: Onsite - Boston,Ma Experience: 5+ Yrs Job Summary: We are looking for a highly skilled Data Engineer with hands-on experience in SQL, Spark, Java/Scala, Unix/Shell scripting, and Databricks. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines, performing data analysis, and supporting data modeling efforts. You will work in an agile delivery environment and collaborate with cross-functional teams to enable high-quality data solutions. \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ Key Responsibilities: • Develop complex and optimized SQL queries for data extraction, transformation, and loading (ETL). • Design and build Spark-based data processing pipelines using Java or Scala in a distributed computing environment. • Perform exploratory data analysis and build data models to support analytics and business intelligence use cases. • Develop and maintain Unix/Shell scripts for automation and job orchestration. • Work within Databricks notebooks and workflows for collaborative data processing and transformation. • Participate in Agile ceremonies such as sprint planning, daily stand-ups, retrospectives, and demonstrations. • Collaborate with data analysts, data scientists, and business users to gather requirements and deliver data solutions. • Ensure data quality, integrity, and security across data pipelines and storage layers. • Troubleshoot performance issues in distributed data environments. \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ Required Qualifications: • 4+ years of experience in writing complex SQL queries and optimizing query performance. • Proficient in Apache Spark with programming experience in Java or Scala. • Strong experience in Unix/Linux environments and Shell scripting. • Hands-on experience in Databricks, including notebook development, job scheduling, and integration with cloud data platforms (e.g., Azure, AWS). • Good understanding of data modeling concepts (relational, dimensional, and NoSQL). • Experience working in Agile / Scrum delivery environments. • Strong analytical and problem-solving skills. • Excellent communication and collaboration skills. Please forward your resume and contact details to krithik_r@surgetechinc.com/ kaviya_t@surgetechinc.com