Job Description: We are seeking a highly skilled and experienced Azure Infrastructure and Databricks Specialist to join our team. The ideal candidate will have extensive experience in setting up and managing Azure infrastructure, Azure Databricks, and various other Azure services. The candidate should also have a strong background in Red Hat OpenShift or Kubernetes, as well as experience with Airflow instance setup and DAG deployment. Key Responsibilities: • Set up and manage Azure infrastructure, including Azure Storage Blob configuration, KeyVault, Messaging Service Bus, Grafana, and Prometheus. • Configure and manage Azure Databricks environments. • Demonstrate expertise in Red Hat OpenShift or Kubernetes for container orchestration. • Set up and deploy Airflow instances and manage DAG deployments. • Ensure secure and efficient use of Azure private endpoints and implement security controls. • Develop and maintain Business Continuity Planning (BCP) and Disaster Recovery (DR) strategies. Required Skills and Qualifications: • Proven experience in Azure infrastructure setup and management. • Strong knowledge of Azure Storage Blob configuration, KeyVault, and Messaging Service Bus. • Experience with monitoring tools such as Grafana and Prometheus. • Expertise in Red Hat OpenShift or Kubernetes. • Extensive experience in setting up and managing Airflow instances and deploying DAGs. • Good understanding of Azure private endpoints and security controls. • Experience in developing and implementing BCP/DR strategies. • Excellent problem-solving and communication skills. Preferred Qualifications: • Azure certifications (e.g., Azure Solutions Architect, Azure DevOps Engineer). • Experience with other cloud platforms (e.g., AWS, Google Cloud). • Familiarity with CI/CD pipelines and automation tools. We are only considering Green Card holders or U.S. Citizens