Azure Databricks Architect -- Hybrid -- Only W2 Profiles

Job Title: Azure Databricks Architect Location: Tampa, FL -Hybrid Key Responsibilities • Design and architect scalable enterprise data platforms using Azure Databricks and Lakehouse architecture. • Lead end-to-end data engineering initiatives including ingestion, transformation, integration, and analytics. • Design and implement high-performance ETL/ELT pipelines using PySpark, Spark SQL, and Databricks Workflows. • Build scalable data solutions leveraging Azure Data Factory, Azure Data Lake Storage (ADLS), Azure Synapse, and Azure SQL. • Develop and optimize Delta Lake architectures for high-performance analytics. • Implement and manage Unity Catalog for centralized governance, security, and metadata management. • Design cloud-native solutions using Azure services and, where applicable, AWS services. • Collaborate with business stakeholders, solution architects, and engineering teams to gather requirements and deliver technical solutions. • Optimize Spark jobs, SQL queries, and Databricks clusters for performance and cost efficiency. • Implement data governance, security, data quality, and compliance best practices. • Lead technical design discussions, architecture reviews, and code reviews. • Mentor Data Engineers and provide technical leadership across project teams. • Support CI/CD implementation, deployment automation, and DevOps best practices. • Troubleshoot complex production issues and provide architectural recommendations. Required Skills • 10+ years of experience in Data Engineering, Data Architecture, or Big Data solutions. • Strong hands-on experience with Azure Databricks. • Expertise in Apache Spark, PySpark, Spark SQL, and SQL. • Experience with Delta Lake and Unity Catalog. • Strong knowledge of Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Azure SQL. • Experience designing enterprise ETL/ELT data pipelines. • Strong understanding of Data Warehousing and Lakehouse architecture. • Experience with Azure or AWS cloud platforms. • Knowledge of data governance, security, and performance optimization. • Experience with Git, CI/CD pipelines, and DevOps practices. • Strong analytical, communication, and stakeholder management skills.