Azure Databricks Engineer

⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for an Azure Databricks Engineer, a hybrid position with a contract length of unspecified duration, offering $60-65/hr. Requires 3-5 years of Azure Databricks experience, strong SQL, Python, and PySpark skills, and expertise in data modeling and medallion architecture.
🌎 - Country
United States
πŸ’± - Currency
$ USD
-
πŸ’° - Day rate
536
-
πŸ—“οΈ - Date discovered
August 22, 2025
πŸ•’ - Project duration
Unknown
-
🏝️ - Location type
Hybrid
-
πŸ“„ - Contract type
Unknown
-
πŸ”’ - Security clearance
Unknown
-
πŸ“ - Location detailed
Warrendale, PA
-
🧠 - Skills detailed
#SQL (Structured Query Language) #Data Modeling #Spark (Apache Spark) #PySpark #Data Engineering #Strategy #REST (Representational State Transfer) #Azure Databricks #Databases #REST API #Cloud #Data Pipeline #"ETL (Extract #Transform #Load)" #Azure #Databricks #Python
Role description
CEIs client is a national leader in Investment Management, and they are adding an Azure Databricks Engineer to their Enterprise Data and Reporting Group. This role will focus on building and maintaining robust data engineering pipelines within our Lakehouse architecture. The ideal candidate will have a strong background in data modeling, pipeline development, and Databricks-specific tools and features. β€’ Hybrid Position working 3 days per week in office. β€’ $60-65 / HR Key Responsibilities: β€’ Design, develop, and optimize complex data pipelines using Azure Databricks. β€’ Acquire and integrate data from diverse sources including APIs, on-prem databases, and file transfers. β€’ Implement and maintain medallion architecture (bronze, silver, gold zones) with increasing levels of data transformation and modeling. β€’ Apply 3NF and dimensional modeling techniques to curate and transform data. β€’ Utilize Databricks tools such as Delta Live Tables (DLT), Lakeflow, Autoloader, Unity Catalog, and Delta Sharing. β€’ Integrate Databricks with REST APIs using OAuth and connect to various relational data sources. β€’ Forecast and monitor cloud costs associated with Databricks usage. β€’ Collaborate with cross-functional teams to gather requirements and mentor junior team members. β€’ Stay current with new Databricks features and best practices. Required Skills & Experience: β€’ 3–5 years of hands-on experience with Azure Databricks. β€’ 7+ years in enterprise data warehousing and data modeling. β€’ Strong proficiency in SQL, Python, and PySpark. β€’ Deep understanding of medallion architecture and data modeling (3NF and dimensional). β€’ Experience with cluster tuning and troubleshooting in Databricks. β€’ Familiarity with Unity Catalog, Delta Live Tables, and Delta Sharing. β€’ Ability to work independently and collaboratively in a hybrid work environment. About CEI: As a trusted technology partner, CEI delivers solutions that help our customers transform their business and achieve meaningful results. From strategy and custom application development through application management - our technology and digital experience services are tailored to meet each unique need of our customers. Our staffing solutions bring specialized skills to complement our customers' workforce and project requirements.