Hadoop/Spark Data Engineer (W2 Only)

Our client has an immediate need for a Hadoop/Spark Data Engineer, who will be responsible for designing and implementing new applications, maintaining existing applications, and supporting RTB (Run the Bank) functions within a dynamic and fast-paced environment. Must Have Technical Skills & Experience: • Spark3 • Python • Shell Scripting • Hadoop Cloudera (Hadoop Admin, Hadoop Tables, HDFS file processing) • Data and System Architecture experience • Data Modeling using Erwin Tool • Alation or similar data mining/reporting tools Flex Skills/Nice to Have: • Agile methodology • Jira • Git Bash • Jenkins • uDeploy • CA7 • Banking industry experience preferred • Minimum 3+ years of development experience Responsibilities: • Design, develop, and implement new data applications and solutions • Maintain and enhance existing applications to ensure performance, scalability, and reliability. • Support RTB functions, ensuring data availability, quality, and timely processing • Work with Hadoop Cloudera environments to manage Hadoop administration, HDFS file processing, and Hadoop Tables • Develop, optimize, and maintain Spark3, Python, and Shell scripts to handle large-scale data processing • Apply data and system architectural expertise to design scalable, efficient, and secure solutions • Perform data modeling using Erwin Tool to design and maintain enterprise data models • Utilize Alation or similar data mining/reporting tools to support data governance and analytics initiatives • Collaborate with cross-functional teams to align technical solutions with business needs For a complete listing of all ConsultUSA jobs and the benefits of working for us, please visit www.consultusa.com