Hadoop Engineer

Job Title: Hadoop data engineer Location: Chicago, IL Work Arrangement: Onsite Client Industry: Financial Services Duration: 12 Months Contract Schedule: Standard Hours( Monday - Friday, 8 AM to 5 PM) Day-to-Day: • Design, develop, and maintain batch and near-real-time data pipelines using Spark Structured Streaming, MapReduce, and other Big Data frameworks. • Ingest data from multiple sources such as message queues (Kafka), file shares, REST APIs, and relational databases. • Transform, clean, and validate data in HDFS, Hive, Impala, or Spark SQL. • Convert and manage data in formats like JSON, CSV, XML to support downstream analytics. • Perform data validation, profiling, and analysis to identify anomalies and ensure data integrity. • Troubleshoot issues in data pipelines, SQL jobs, or Spark applications, including slow-running jobs or failures. Must Haves: • Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQL • Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml • Experience working with SPARK Structured steaming • Experience working with Hadoop/Big Data and Distributed Systems • Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc. • Hands on programming experience in at least one of Scala, Python, PHP, Plusses: • Prior Bank Experience • Experience in Service Now Compensation • Hourly Rate: $60 - $65 per hour This reflects base compensation and may vary based on candidate qualifications. Benefits The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, paid time off, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, and paid holidays annually - as applicable. About Us At Collabera, we don’t just offer jobs—we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact.