Hadoop Python Data Engineer

Job Title: Hadoop Data Engineer Location: Chicago, IL/Denver, CO/Washington, DC Work Arrangement: Fully Onsite Client Industry: Enterprise BFSI client Duration: 18+ Months Contract Schedule: Monday to Friday, Standard working hours About the Role: Seeking a highly skilled Data Engineer (hadoop plus python) to join the client in Chicago or Denver or Washington. This is a 100% onsite role supporting critical data ingestion, pipeline development, and performance optimization initiatives in a secure banking environment. Top Three skills: • Python-Based Data Pipeline Engineering • Building production-grade pipelines • Performance tuning, memory management, error handling • Batch & near-real-time processing • Hadoop Ecosystem Expertise • Strong understanding of HDFS, YARN, MapReduce • Distributed processing with Spark/Hive • Scalable and reliable data workflows • Custom Data Ingestion & Integration • Designing ingestion from APIs, queues, DBs, files • Kafka & message-driven architectures • PHP-based data services & integration endpoints What We’re Looking For: · Design, develop, and maintain data pipelines primarily using Python, writing production-grade code to ingest, process, and move large-scale datasets across distributed environments. · Build and enhance data processing workflows on Hadoop-based platforms, leveraging a strong understanding of Hadoop architecture (HDFS, YARN, MapReduce) to ensure scalability, reliability, and performance. · Develop custom data ingestion and transformation logic, rather than relying solely on prebuilt tools, to support batch and near-real-time processing requirements. · Write, maintain, and optimize Python code for distributed data processing, including performance tuning, memory management, and error handling in large data environments. · Contribute hands-on code in PHP to support data services, ingestion endpoints, or integration layers that interact with data pipelines or upstream/downstream system Compensation: Hourly Rate: $63 - $64 per hour This range reflects base compensation and may vary based on location, market conditions, experience, and candidate qualifications. Benefits: The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time , paid sick and safe time , hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable) About Us: At Collabera, we don’t just offer jobs—we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact. Ready to Apply? Apply now on shivani.soni@collabera.com/973-841-2468 Note: we are looking for python programming with data integration rather than ETL Tooling.