Cloud Data Engineer- Databricks

Purpose: We are seeking a highly skilled Cloud Data Engineer with deep expertise in Databricks and modern cloud platforms such as AWS, Azure, or GCP. This role is ideal for professionals who are passionate about building next-generation data platforms, optimizing complex data workflows, and enabling advanced analytics and AI in cloud-native environments. You’ll have the opportunity to work with Fortune-500 organizations in data and analytics, helping them unlock the full potential of their data through innovative, scalable solutions. Key Result Areas and Activities: • Design and implement robust, scalable data engineering solutions. • Build and optimize data pipelines using Databricks, including serverless capabilities, Unity Catalog, and Mosaic AI. • Collaborate with analytics and AI teams to enable real-time and batch data workflows. • Support and improve cloud-native data platforms (AWS, Azure, GCP). • Ensure adherence to best practices in data modeling, warehousing, and governance. • Contribute to automation of data workflows using CI/CD, DevOps, or DataOps practices. • Implement and maintain workflow orchestration tools like Apache Airflow and dbt. Roles & Responsibilities Essential Skills • 4+ years of experience in data engineering with a focus on scalable solutions. • Strong hands-on experience with Databricks in a cloud environment. • Proficiency in Spark and Python for data processing. • Solid understanding of data modeling, data warehousing, and architecture principles. • Experience working with at least one major cloud provider (AWS, Azure, or GCP). • Familiarity with CI/CD pipelines and data workflow automation. Desirable Skills • Direct experience with Unity Catalog and Mosaic AI within Databricks. • Working knowledge of DevOps/DataOps principles in a data engineering context. • Exposure to Apache Airflow, dbt, and modern data orchestration frameworks. Qualifications • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field. • Relevant certifications in cloud platforms (AWS/Azure/GCP) or Databricks are a plus. Qualities: • Able to consult, write, and present persuasively • Able to work in a self-organized and cross-functional team • Able to iterate based on new information, peer reviews, and feedback • Able to work seamlessly with clients across multiple geographies • Research focused mindset • Excellent analytical, presentation, reporting, documentation and interactive skills "Infocepts is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law."