Hadoop Data Engineer

Job Title: Hadoop Data Engineer Location: Chicago, IL/Denver, CO/Washington DC (Local Only No relocation - In person Interview ) Work Arrangement: Fully Onsite Client Industry: Banking Duration: 12 Months Contract Day-to-Day: • Design, develop, and maintain batch and near-real-time data pipelines using Spark Structured Streaming, MapReduce, and other Big Data frameworks. • Ingest data from multiple sources such as message queues (Kafka), file shares, REST APIs, and relational databases. • Transform, clean, and validate data in HDFS, Hive, Impala, or Spark SQL. • Convert and manage data in formats like JSON, CSV, XML to support downstream analytics. • Perform data validation, profiling, and analysis to identify anomalies and ensure data integrity. • Troubleshoot issues in data pipelines, SQL jobs, or Spark applications, including slow-running jobs or failures. Must Haves: • Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQL • Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml • Experience working with SPARK Structured steaming • Experience working with Hadoop/Big Data and Distributed Systems • Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc. • Hands on programming experience in at least one of Scala, Python, PHP, PLUSES • Banking or finance • Compensation • Hourly Rate: 60$-65$ per hour This range reflects base compensation and may vary based on location, market conditions, experience, and candidate qualifications. Benefits: • The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable) • About Us • At Collabera, we don’t just offer jobs—we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact. • Ready to Apply? • Apply now or reach out to Pritam Palai at pritam.palai@collabera.com for more information. We look forward to speaking with you!