Join a dynamic team as a Sr. DevOps Engineer, where you will play a pivotal role in maintaining and optimizing a dedicated data environment. This fully remote position offers the chance to work with cutting-edge technology and collaborate with talented professionals. Responsibilities • Maintain and support a dedicated data environment within BigData infrastructure. • Plan capacity and manage data pruning, while administering databases efficiently. • Enhance system performance through tuning and optimization of tables and queries. • Manage access control, secrets, and ensure compliance with data governance policies. • Support data management and ingestion projects, ensuring seamless integration. • Monitor and optimize system performance and reliability, resolving issues in data pipelines and storage solutions. • Develop and manage CI/CD pipelines to automate testing, integration, and deployment processes. • Collaborate with data engineering and development teams for seamless deployment integration. Skills • Extensive experience in DevOps/SRE, focusing on big data platforms and cloud infrastructure. • Proficient in designing and maintaining scalable cloud infrastructure using Kubernetes and Docker. • Hands-on experience with data processing tools like Apache Spark, dbt, Kafka, and Airflow. • Strong knowledge of Hadoop components such as Spark Streaming, HDFS, and Hive. • Expertise in leveraging SCM and build tools like Git, Jenkins, and Docker for CI/CD operations. • Proficient in scripting languages such as Python, Bash, and Go for automation. Preferred Skills • Experience with MLOps platforms and practices. • Familiarity with Snowflake, ClickHouse, and data lakehouse technologies. • Knowledge of securing Hadoop stack using Sentry, Ranger, and Kerberos KDC. • Background in software development with experience in OOP languages like Java and JavaScript. We are committed to fostering an inclusive environment where diversity, equity, and inclusion are at the forefront of our company values. We welcome applicants from all backgrounds to apply and join our team. Once you apply for this position, you may receive a phone call, SMS or email at the time of application from our Virtual AI Recruiter, Alex, to conduct an initial interview.