AWS Data Operations - DataOps/DataLake

Please go through the JD and share your resume. Job Title: Data Operations Engineer Duration : Contract long term Location: SFO, CA (Onsite) Need Cube Formation About the Job As a Data Operations Engineer, you will manage and optimize cloud-based data collections, ensuring the availability, performance, and security of data services and applications. You will focus on the entire data lifecycle. The ideal candidate will possess a deep understanding of cloud platforms, data management, and operational best practices. Your problem-solving mindset will guide you in collaborating with domain experts, software engineers, and data engineers to create integrated solutions that enable scientific research and discovery while supporting data operations activities with increased data value and support reuse according to FAIR principles. Key Responsibilities Cloud Infrastructure Management • Support the design, deployment, and management of scalable, reliable, and secure cloud infrastructure • Monitor and report on cloud-based systems, including instances and storage services • Optimize resource utilization and cost management Data Lifecycle Management • Oversee the end-to-end lifecycle of data from ingestion, processing, and storage to archiving and purging • Co-develop and implement data governance practices to ensure data quality, consistency, and accessibility throughout its lifecycle • Develop and maintain policies and procedures for data retention, archival, and disposal in compliance with regulatory requirements Security and Compliance • Implement and manage security policies and practices in accordance with industry standards • Ensure compliance with data protection regulations and company policies Performance Optimization • Monitor system performance and implement tuning recommendations • Perform root cause analysis and provide solutions for performance issues • Perform data analytics to forecast data growth and anticipate future storage capacity requirements • Continuously seek opportunities for process improvement and automation Collaboration and Support • Work closely with cross-functional teams including data scientists, software engineers, and business analysts • Provide technical support and troubleshooting for data-related issues • Collaborate with data engineers to build new capabilities and integrations aimed at increasing the value and reusability of scientific data • Document processes, best practices, and operational guidelines Required Qualifications Successful candidates will meet many of the following requirements: • Bachelor’s degree or equivalent practical experience • 4+ years of experience supporting IT storage platforms and/or data systems • Competent understanding of Pharma/Biotech scientific data workflows, needs, and requirements • Competent understanding of Unix, NTFS, and SMB/Samba permission schemas and semantics • Moderate expertise with scale-out network attached storage (NAS) solutions such as Dell EMC Isilon or NetApp • Experience with data discovery tools such as Starfish, InsightIQ, S3 Storage Lens, or home-brewed solutions • Experience with object storage platforms and protocols such as Amazon S3 • Strong technical Unix/Linux and project management background • Strong scripting and dynamic language expertise: Bash, Python, SQL (preferred) • Proficiency in software development with a strong focus on API integration and management • Proficient in the use of Atlassian Jira and Confluence tools • Proficient with Google Workspace tools (Docs, Sheets, Slides) • Strong analytical and problem-solving skills • Excellent communication and collaboration abilities • High attention to detail and a proactive approach Nice to Have / Plus Skills Previous experience with any of the following is a plus: • Isilon OneFS CLI and/or UI • Parallel filesystem platforms such as IBM GPFS / Spectrum Scale • Petabyte-scale data movement and migration • Familiarity with CI/CD pipelines and DevOps practices related to API deployment and management • AWS Cloud Solutions Architect Associate or equivalent AWS certifications Thanks & Regards Wilson Kadam STCG Inc Email: wilson@stcgusa.com Direct Number : 609-250-9877