Senior Databricks Data Engineer

Role: Senior Databricks Data Engineer Location: Minneapolis, MN (Hybrid) Best Match Profiles • Senior Data Engineers with strong Databricks and Azure experience. • Candidates with PySpark, ADF, Snowflake, Airflow, and SQL expertise. • Professionals who have built enterprise-scale data lake and ETL solutions using Databricks. Required Experience • 8+ years of Data Engineering / ETL development • 8+ years of Python development • 8+ years working on Unix/Linux • 8+ years of Shell Scripting • 6+ years of Databricks development, including: • Delta Lake & Lakehouse Architecture Medallion Architecture Apache Spark & PySpark Unity Catalog & Delta Sharing Databricks Workflows, Notebooks, SQL, and Git • 6+ years of Azure Data Factory (ADF) • 6+ years working with large enterprise data platforms • 4+ years of Snowflake Technical Skills • Strong SQL skills • Experience with Apache Airflow • Experience building Snowflake data pipelines • Hands-on experience with Unity Catalog and data governance • Knowledge of Apache Iceberg or similar open table formats • Experience with Azure Data Lake Storage (ADLS) or AWS S3 • Good understanding of cloud-based data lake architecture • SAS programming experience: SAS Data Step SAS Macros PROC SQL Responsibilities • Build and maintain scalable data pipelines using Databricks, PySpark, and ADF. • Develop ETL workflows for enterprise data platforms. • Work with Snowflake, Delta Lake, and cloud storage solutions. • Implement data governance using Unity Catalog. • Optimize data processing and troubleshoot performance issues. • Collaborate with cross-functional teams and mentor junior engineers. Preferred Skills • Strong problem-solving and analytical skills • Good communication and teamwork • Ability to work independently • Experience creating technical documentation and solution designs