PySpark Data Engineer (W2)

TSR Consulting is currently seeking a highly motivated PySpark Data Engineer (W2) for an opportunity in Rutherford, NJ Position Title: PySpark Data Engineer Location: Rutherford, NJ Job Type: Hybrid – 3 days a week Anticipated Start Date: ASAP Please note this is the target date and it is subject to change. TSR will send official notice ahead of a confirmed start date. Expected Duration: 6+ Months Contract with to Hire (GC/Citizen/GC EAD) Pay Range: Please note that actual compensation may vary within this range due to factors such as location, experience, and job responsibilities, and does not encompass additional non-standard compensation (e.g., benefits, paid time off, per diem, etc.). We are looking for a skilled and experienced PySpark Data Engineer to join our data team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable data pipelines using PySpark. This role requires a strong understanding of big data technologies, data warehousing concepts, and the ability to work with large datasets to support analytics, reporting, and machine learning initiatives. Responsibilities • Design, build, and optimize data pipelines using PySpark to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses. • Develop and maintain scalable data processing jobs and frameworks using Apache Spark with Python (PySpark). • Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality data solutions. • Implement data quality checks, monitoring, and alerting for data pipelines to ensure data accuracy and reliability. • Optimize existing PySpark jobs for performance, efficiency, and cost-effectiveness. • Manage and process large datasets, ensuring data governance, security, and compliance. • Troubleshoot and resolve issues in data pipelines and data processing jobs. • Participate in code reviews, contribute to architectural discussions, and promote best practices in data engineering. • Stay informed about new PySpark features, big data technologies, and industry best practices. • Document data pipelines, data models, and processes. Required Skills & Experience • Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field. • 7-10 years of experience as a Data Engineer, with significant experience specifically in PySpark. • Strong proficiency in Python programming. • Extensive experience with Apache Spark, including Spark SQL, Spark Streaming, and DataFrame API. • Solid understanding of data warehousing concepts, dimensional modeling, and ETL principles. • Proficiency in SQL for data querying and manipulation. • Experience with big data technologies suchation as Hadoop, HDFS, Hive, or similar. • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services (e.g., S3, ADLS, Google Cloud Storage, EMR, Databricks, Glue). • Experience with version control systems (e.g., Git). • Excellent problem-solving, analytical, and communication skills. Preferred Skills & Experience (Optional) • Master's degree in a related field. • Experience with workflow orchestration tools (e.g., Apache Airflow, Azure Data Factory, AWS Step Functions). • Knowledge of stream processing technologies (e.g., Kafka, Kinesis). • Experience with NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB). • Familiarity with data governance tools and practices. • Experience in a CI/CD environment. Benefits: TSR Consulting offers all eligible employees a comprehensive benefits package including, but not limited to major medical, HSA, dental, vision, employer-provided group life, voluntary life insurance, short-term disability, long-term disability, and 401k. About TSR: TSR is a trusted staffing and workforce solutions partner with more than 50 years of experience delivery highly qualified talent to support clients' most critical business and technology initiatives. Through a disciplined approach to sourcing, candidate vetting, and delivery, TSR helps organizations scale teams quickly while maintaining quality and reliability. TSR operates with a global delivery model, leveraging specialized teams to support enterprise clients across North America and beyond. In June 2024, TSR was acquired by Justin Christian, founder and CEO of BCforward, a global provider of professional services and workforce solutions. This partnership expands TSR's ability to deliver broader capabilities, global delivery resources, and enhanced opportunities for both clients and consultants.