Hadoop/Spark Data Engineer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Hadoop/Spark Data Engineer with a contract length of "unknown," offering a pay rate of "unknown." Key skills include Spark3, Python, Shell Scripting, and Hadoop Cloudera. Banking industry experience and 3+ years of development experience are required.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
-
🗓️ - Date discovered
September 4, 2025
🕒 - Project duration
Unknown
-
🏝️ - Location type
Unknown
-
📄 - Contract type
Unknown
-
🔒 - Security clearance
Unknown
-
📍 - Location detailed
Pittsburgh, PA
-
🧠 - Skills detailed
#Jira #Python #Alation #Bash #Jenkins #GIT #Scala #Spark (Apache Spark) #Agile #ERWin #Shell Scripting #Data Engineering #Data Processing #Scripting #Cloud #Hadoop #Data Mining #Data Modeling #Data Governance #HDFS (Hadoop Distributed File System) #Cloudera
Role description
Our client has an immediate need for a Hadoop/Spark Data Engineer, who will be responsible for designing and implementing new applications, maintaining existing applications, and supporting RTB (Run the Bank) functions within a dynamic and fast-paced environment.
Must Have Technical Skills & Experience:
• Spark3
• Python
• Shell Scripting
• Hadoop Cloudera (Hadoop Admin, Hadoop Tables, HDFS file processing)
• Data and System Architecture experience
• Data Modeling using Erwin Tool
• Alation or similar data mining/reporting tools
Flex Skills/Nice to Have:
• Agile methodology
• Jira
• Git Bash
• Jenkins
• uDeploy
• CA7
• Banking industry experience preferred
• Minimum 3+ years of development experience
Responsibilities:
• Design, develop, and implement new data applications and solutions
• Maintain and enhance existing applications to ensure performance, scalability, and reliability.
• Support RTB functions, ensuring data availability, quality, and timely processing
• Work with Hadoop Cloudera environments to manage Hadoop administration, HDFS file processing, and Hadoop Tables
• Develop, optimize, and maintain Spark3, Python, and Shell scripts to handle large-scale data processing
• Apply data and system architectural expertise to design scalable, efficient, and secure solutions
• Perform data modeling using Erwin Tool to design and maintain enterprise data models
• Utilize Alation or similar data mining/reporting tools to support data governance and analytics initiatives
• Collaborate with cross-functional teams to align technical solutions with business needs
For a complete listing of all ConsultUSA jobs and the benefits of working for us, please visit www.consultusa.com
Our client has an immediate need for a Hadoop/Spark Data Engineer, who will be responsible for designing and implementing new applications, maintaining existing applications, and supporting RTB (Run the Bank) functions within a dynamic and fast-paced environment.
Must Have Technical Skills & Experience:
• Spark3
• Python
• Shell Scripting
• Hadoop Cloudera (Hadoop Admin, Hadoop Tables, HDFS file processing)
• Data and System Architecture experience
• Data Modeling using Erwin Tool
• Alation or similar data mining/reporting tools
Flex Skills/Nice to Have:
• Agile methodology
• Jira
• Git Bash
• Jenkins
• uDeploy
• CA7
• Banking industry experience preferred
• Minimum 3+ years of development experience
Responsibilities:
• Design, develop, and implement new data applications and solutions
• Maintain and enhance existing applications to ensure performance, scalability, and reliability.
• Support RTB functions, ensuring data availability, quality, and timely processing
• Work with Hadoop Cloudera environments to manage Hadoop administration, HDFS file processing, and Hadoop Tables
• Develop, optimize, and maintain Spark3, Python, and Shell scripts to handle large-scale data processing
• Apply data and system architectural expertise to design scalable, efficient, and secure solutions
• Perform data modeling using Erwin Tool to design and maintain enterprise data models
• Utilize Alation or similar data mining/reporting tools to support data governance and analytics initiatives
• Collaborate with cross-functional teams to align technical solutions with business needs
For a complete listing of all ConsultUSA jobs and the benefits of working for us, please visit www.consultusa.com
