DevOps Engineer (Databricks, Immuta, Starburst,)

Position: Senior DevOps Engineer (Databricks, Immuta, Starburst, Collibra, and AWS) Location - San Francisco Hybrid Role No C2C Overview We are looking for a Senior DevOps Engineer to design, build, and manage our development and product platforms in the cloud. This role will focus on modern data tools such as Databricks, Immuta, Starburst, Collibra, and AWS. You will play a key role in migrating data and data management applications to AWS, helping us reduce costs, improve performance, and maximize the value of our data to meet business objectives. Key Responsibilities • Define, document, and implement best practices for Continuous Integration/Continuous Deployment (CI/CD). • Configure and manage data engineering platforms including Databricks, Immuta, Starburst, and Collibra within AWS environments. • Develop and maintain automation scripts to solve complex problems across diverse environments. • Evaluate and recommend tools, technologies, and processes to improve scalability, speed, and efficiency. • Partner with development teams to ensure applications are built for scalability and reliability. • Perform spot checks and provide coaching to developers and operations teams on DevOps best practices. • Collaborate with business stakeholders to align technology initiatives with strategic goals. • Identify and manage dependencies across multiple platforms and applications. • Ensure systems and applications comply with security standards and policies. • Support governance and secure data access through integration with Immuta and Collibra. Qualifications • Bachelor’s degree in Computer Science, MIS, or related field (or equivalent experience). • 5+ years of relevant technical experience, with at least 3 years managing complex systems. • Strong background in AWS cloud services and data infrastructure. • Hands-on experience with Databricks or similar big data platforms. • Familiarity with data governance and access control tools such as Collibra and Immuta. • Experience with distributed query engines (e.g., Starburst). • Advanced knowledge of CI/CD tools (Jenkins, Maven) and scripting languages. • Strong Linux/Unix system administration skills. • Proficiency with Git-based source control (Git, BitBucket, AWS CodeCommit). • Experience with artifact repositories (Maven, Nexus, Artifactory). • Knowledge of Agile tools and practices (Jira, VersionOne). • Strong automation, testing, and operational troubleshooting skills.