CrescentSoftTech Inc
Hadoop Administration
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Hadoop Administrator in Chicago, IL, on a W2 contract for over 6 months, offering $65.00 - $68.00 per hour. Key skills include Hadoop administration, Azure cloud management, Linux/Unix, and scripting.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
544
-
🗓️ - Date
November 27, 2025
🕒 - Duration
More than 6 months
-
🏝️ - Location
On-site
-
📄 - Contract
W2 Contractor
-
🔒 - Security
Unknown
-
📍 - Location detailed
Chicago, IL 60617
-
🧠 - Skills detailed
#ADLS (Azure Data Lake Storage) #Debugging #Automation #Deployment #Azure Data Factory #Monitoring #Data Management #Compliance #Big Data #Grafana #Kafka (Apache Kafka) #Azure Blob Storage #Sqoop (Apache Sqoop) #Storage #Cloudera #Scripting #ADF (Azure Data Factory) #IAM (Identity and Access Management) #Azure #Data Engineering #Spark (Apache Spark) #Unix #Data Lake #Azure cloud #Data Processing #Linux #Distributed Computing #Ambari #Presto #DevOps #HDFS (Hadoop Distributed File System) #Cloud #Kubernetes #Vault #Python #YARN (Yet Another Resource Negotiator) #Hadoop #Disaster Recovery #HBase #Prometheus #Kerberos #Security
Role description
Role: Hadoop AdministratorLocation: Chicago, IL (Strictly Local Candidates Only)Type: Contract | W2 Only
OverviewWe are seeking a highly skilled Hadoop Administrator to join our data management team. This role involves managing and optimizing large-scale data environments, ensuring the seamless operation of Hadoop ecosystems, and supporting our big data initiatives. The ideal candidate will have extensive experience with cloud platforms, data warehousing, and a strong foundation in various data technologies to facilitate efficient data processing and analysis.
Responsibilities
Install, configure, and administer Hadoop ecosystem components including HDFS, YARN, Hive, Spark, HBase, Oozie, Sqoop, Kafka, Ranger, and Knox.
Manage Hadoop cluster capacity planning, performance monitoring, troubleshooting, and upgrades.
Perform user provisioning, Kerberos authentication setup, and cluster security hardening using Ranger/Knox.
Handle Hadoop cluster health, NameNode operations, failover management, and high availability setups.
Develop automation scripts (Shell/Python) for monitoring, deployment, and maintenance tasks.
Manage Azure cloud resources: Azure Data Lake, Azure Blob Storage, HDInsight, Azure Data Factory, Azure Kubernetes Service, and Azure VM clusters.
Configure and monitor Azure networking, access control, service principals, role-based access, and Azure Key Vault.
Implement backup/restore strategies, disaster recovery, cluster patching, and version upgrades.
Perform log analysis, job debugging, resource allocation tuning for Hadoop/Spark jobs.
Collaborate with Data Engineers, Cloud Engineers, and DevOps teams to support CI/CD pipelines and data workflows.
Ensure compliance with security, governance, and operational procedures across Hadoop and Azure environments.
Required Skills
Strong hands-on experience with Hadoop administration (HDFS, YARN, Hive, Spark, Ambari/Cloudera Manager).
Experience managing Azure cloud resources: ADLS, ADF, HDInsight, Azure VMs, Azure Backup, IAM/RBAC.
Strong understanding of Linux/Unix administration, networking, and distributed computing.
Knowledge of security frameworks: Kerberos, SSL/TLS, Ranger, Knox, Azure AD.
Scripting experience: Shell, Python, PowerShell.
Experience with monitoring tools (Grafana, Prometheus, Ambari Metrics, Azure Monitor).
Good troubleshooting skills for cluster performance, job failures, and resource issues.
fasi@crescentsofttech.com
Job Types: Full-time, Contract
Pay: $65.00 - $68.00 per hour
Work Location: In person
Role: Hadoop AdministratorLocation: Chicago, IL (Strictly Local Candidates Only)Type: Contract | W2 Only
OverviewWe are seeking a highly skilled Hadoop Administrator to join our data management team. This role involves managing and optimizing large-scale data environments, ensuring the seamless operation of Hadoop ecosystems, and supporting our big data initiatives. The ideal candidate will have extensive experience with cloud platforms, data warehousing, and a strong foundation in various data technologies to facilitate efficient data processing and analysis.
Responsibilities
Install, configure, and administer Hadoop ecosystem components including HDFS, YARN, Hive, Spark, HBase, Oozie, Sqoop, Kafka, Ranger, and Knox.
Manage Hadoop cluster capacity planning, performance monitoring, troubleshooting, and upgrades.
Perform user provisioning, Kerberos authentication setup, and cluster security hardening using Ranger/Knox.
Handle Hadoop cluster health, NameNode operations, failover management, and high availability setups.
Develop automation scripts (Shell/Python) for monitoring, deployment, and maintenance tasks.
Manage Azure cloud resources: Azure Data Lake, Azure Blob Storage, HDInsight, Azure Data Factory, Azure Kubernetes Service, and Azure VM clusters.
Configure and monitor Azure networking, access control, service principals, role-based access, and Azure Key Vault.
Implement backup/restore strategies, disaster recovery, cluster patching, and version upgrades.
Perform log analysis, job debugging, resource allocation tuning for Hadoop/Spark jobs.
Collaborate with Data Engineers, Cloud Engineers, and DevOps teams to support CI/CD pipelines and data workflows.
Ensure compliance with security, governance, and operational procedures across Hadoop and Azure environments.
Required Skills
Strong hands-on experience with Hadoop administration (HDFS, YARN, Hive, Spark, Ambari/Cloudera Manager).
Experience managing Azure cloud resources: ADLS, ADF, HDInsight, Azure VMs, Azure Backup, IAM/RBAC.
Strong understanding of Linux/Unix administration, networking, and distributed computing.
Knowledge of security frameworks: Kerberos, SSL/TLS, Ranger, Knox, Azure AD.
Scripting experience: Shell, Python, PowerShell.
Experience with monitoring tools (Grafana, Prometheus, Ambari Metrics, Azure Monitor).
Good troubleshooting skills for cluster performance, job failures, and resource issues.
fasi@crescentsofttech.com
Job Types: Full-time, Contract
Pay: $65.00 - $68.00 per hour
Work Location: In person
