Databricks Solutions Architect (REMOTE)

Job Title: Databricks Solutions Architect Location: REMOTE in CST Duration: 6 Months Contract with possible extension About the Role We are seeking a highly skilled and experienced Databricks Solutions Architect to lead the design, implementation, and optimization of large-scale data and AI solutions on the Databricks Lakehouse Platform. You will serve as a strategic advisor to clients and internal teams, bridging business needs with technical capabilities, and delivering high-impact data-driven outcomes. This role requires deep expertise in Apache Spark, Delta Lake, data lakehouse architecture, and cloud ecosystems (AWS, Azure, or GCP). You will also work closely with Data Engineers, Data Scientists, and Business Stakeholders to design end-to-end solutions. Key Responsibilities • Architect Databricks-based solutions across data ingestion, processing, modeling, machine learning, and analytics use cases. • Design and implement data lakehouse architectures using Delta Lake, Unity Catalog, and MLflow. • Collaborate with data engineering teams to optimize ETL/ELT pipelines, ensuring scalability, performance, and data quality. • Work directly with clients to understand business goals, translate them into technical solutions, and drive adoption of Databricks best practices. • Lead proof-of-concepts (PoCs) and solution design workshops to demonstrate the value of Databricks across domains. • Define and enforce security, governance, and compliance standards in Databricks implementations (e.g., IAM, data lineage, audit trails). • Provide technical guidance on cost optimization, workload migration, and integration with third-party tools (e.g., Tableau, Power BI, Kafka, Snowflake). • Support presales and post-sales technical discussions as needed for client engagements. • Stay current with Databricks product updates, open-source trends (e.g., Apache Spark, Delta Lake, MLflow), and cloud services evolution. Required Qualifications • 7+ years of experience in data architecture, engineering, or analytics roles, with at least 2+ years as a Databricks Architect or Engineer. • Strong experience with Apache Spark and the Databricks platform (including Delta Live Tables, DBSQL, Unity Catalog). • Hands-on expertise with cloud platforms (AWS, Azure, or GCP), especially their data services (e.g., S3, ADLS, BigQuery, Redshift). • Strong programming skills in Python, SQL, and optionally Scala. • Deep understanding of modern data architectures, including data lakes, data warehouses, and lakehouses. • Experience building end-to-end data pipelines and ML workflows. • Familiarity with CI/CD practices, Git, and DevOps for data. • Strong communication and stakeholder management skills; able to convey technical ideas to business users and vice versa. Preferred Qualifications • Databricks certification(s): e.g., Databricks Certified Data Engineer Professional, Solutions Architect Associate. • Experience with MLflow, Delta Live Tables, Unity Catalog, and Job Workflows. • Experience with BI tools (Power BI, Tableau, Looker). • Prior consulting or customer-facing solutioning experience. • Experience in regulated industries (e.g., financial services, healthcare) with a focus on compliance and data governance.