Job Title: Data Engineer – AWS, Databricks, PySpark, Splunk Location: Jersey City, NJ (onsite) Role Type: Contract Job Overview: We are looking for an experienced Data Engineer to join our data team and contribute to building scalable, high-performance data pipelines and analytics solutions. The ideal candidate will have hands-on expertise in AWS, Databricks, PySpark, and experience with Splunk for monitoring and log analytics. Key Responsibilities: • Design, develop, and optimize ETL/ELT data pipelines using Databricks and PySpark. • Work with large-scale structured and unstructured data across various cloud and data lake environments. • Implement data processing workflows on AWS (e.g., S3, Glue, EMR, Lambda). • Monitor pipeline performance and troubleshoot issues using Splunk and other observability tools. • Ensure data quality, integrity, and compliance through robust validation and testing processes. • Collaborate with data analysts, architects, and DevOps teams to align solutions with business needs and enterprise architecture. • Automate workflows and deployments using CI/CD pipelines and Infrastructure-as-Code principles. Required Skills • Strong hands-on experience with AWS services, especially S3, Glue, EMR, Lambda, IAM, and CloudWatch. • Expertise in Databricks, including notebooks, jobs, Delta Lake, and workspace management. • Proficiency in PySpark and distributed data processing. • Solid understanding of data modeling, partitioning, and performance tuning in big data environments. • Experience using Splunk for log monitoring, dashboarding, and root cause analysis. • Strong SQL skills and knowledge of performance optimization techniques. Nice to Have: • Experience with Airflow or other orchestration tools. • Familiarity with Snowflake or other cloud data warehouses. • Knowledge of CI/CD, Docker, or Terraform for deploying data applications. • Python scripting for automation and data engineering tasks. Soft Skills: • Strong problem-solving and debugging capabilities. • Excellent communication and collaboration in cross-functional teams. • Ability to work independently in a fast-paced, agile environment.