Data Engineer - W2

Required Skills & Qualifications • Experience: 5+ years of hands-on experience in a data engineering, platform engineering, or DevOps role with a significant focus on cloud data platforms. • Azure Databricks Expertise: Strong practical experience in managing and operating an Azure Databricks environment. Proven ability to work with core features like Delta Lake, Unity Catalog, and Apache Spark. Relevant certifications such as Microsoft Certified: Azure Solutions Architect Expert, Databricks Certified Data Engineer Professional, and Databricks Certified Platform Administrator. • Azure Proficiency: Solid working knowledge of the Azure ecosystem, including Azure Data Lake Storage (ADLS), Azure Active Directory (AAD), and cloud networking concepts. • Distributed Systems: A solid understanding of distributed computing principles and experience troubleshooting issues in a distributed environment. • Programming & Scripting: Strong proficiency in Terraform, Python, Apache Spark/PySpark, SQL, and Shell scripting. • Infrastructure as Code & CI/CD:Proven experience with Infrastructure as Code tools (e.g., Terraform) and building automated CI/CD pipelines for platform and data application deployments. • Operational Mindset: Demonstrated experience in contributing to the operational stability and performance of a production platform. • Communication: Excellent communication, documentation, and presentation skills, with the ability to influence technical and business stakeholders. Preferred Qualifications • Familiarity with healthcare data and healthcare insurance feeds • Familiarity with Data Analytics and reporting • Familiarity with ML/AI Education • Bachelor's or master’s degree in computer science, Engineering, or a related field.