Apache Hadoop Architect

Job Overview: We are seeking an experienced Apache Hadoop Admin/Platform Architect to join our Data & Analytics team. The ideal candidate will be responsible for managing, optimizing, and architecting Hadoop ecosystems and related data platforms. This role requires deep technical expertise in Hadoop components, strong programming skills, and a solid understanding of data warehousing, ETL processes, and data security principles. Key Responsibilities: • Architect, deploy, and administer large-scale Apache Hadoop environments. • Manage core Hadoop components including HDFS, YARN, MapReduce, Spark, Hive, HBase, and Phoenix. • Design and implement efficient data processing and ETL workflows. • Optimize performance and scalability of the Hadoop ecosystem. • Develop and maintain scripts and automation using Linux command-line tools. • Work with programming languages such as Java, Python, and PySpark for data processing and integration. • Ensure data security, governance, and compliance across the Hadoop platform. • Troubleshoot complex technical issues and provide performance tuning recommendations. • Collaborate with cross-functional teams to support data analytics and reporting initiatives. Required Skills & Qualifications: • Proven hands-on experience with Apache Hadoop and its ecosystem (HDFS, YARN, MapReduce, Spark, Hive, HBase, Phoenix). • Strong Linux administration and command-line expertise. • Proficiency in Java, Python, PySpark, and SQL. • Strong analytical and problem-solving skills. • Knowledge of data security, data governance, and data warehousing principles. • Experience working in ETL and large-scale data processing environments.