Careerwise
Principal Databricks Engineer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Principal Databricks Engineer on a 12-month remote contract (UK preferred) with a focus on designing scalable Databricks Lakehouse solutions. Key skills include Databricks, PySpark, Azure, and AI integration; EdTech experience is desirable.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
Unknown
-
🗓️ - Date
June 4, 2026
🕒 - Duration
More than 6 months
-
🏝️ - Location
Remote
-
📄 - Contract
Fixed Term
-
🔒 - Security
Unknown
-
📍 - Location detailed
United Kingdom
-
🧠 - Skills detailed
#ML (Machine Learning) #Azure Databricks #Azure #Data Engineering #Data Pipeline #Databricks #Spark (Apache Spark) #MLflow #Cloud #Scala #PySpark #Delta Lake #"ETL (Extract #Transform #Load)" #AI (Artificial Intelligence) #Data Integration
Role description
Principal Databricks Architect/Principal Data Engineer
• Fully Remote (UK Preferred)
• 12-Month Contract + Extensions
We are looking for a hands-on Principal Databricks Architect / Principal Data Engineer to join a large-scale Data & AI transformation programme.
Responsibilities
• Design and build scalable Databricks Lakehouse solutions.
• Lead the implementation of Medallion Architecture (Bronze, Silver, Gold).
• Develop and optimise data pipelines using PySpark and Spark.
• Enable AI and Generative AI use cases using enterprise data assets.
• Integrate external systems and APIs into the data ecosystem.
• Drive best practices across data engineering, governance, and platform architecture.
• Support the adoption of AI, LLM, and RAG-based solutions.
Required Skills & Experience
• Strong hands-on experience with Databricks.
• Expert-level PySpark and Data Engineering skills.
• Experience designing and implementing Databricks Lakehouse architecture.
• Deep understanding of Delta Lake and Medallion Architecture.
• Experience with Azure Databricks and cloud-based data platforms.
• Experience enabling AI, Machine Learning, or Generative AI initiatives.
Desirable Experience
• Education Technology (EdTech) sector experience.
• Student Information Systems.
• Individualized Education Program (IEP) platforms.
• Medicaid-related data integrations.
• Azure OpenAI, LLMs, RAG, MLflow, or MLOps.
Principal Databricks Architect/Principal Data Engineer
• Fully Remote (UK Preferred)
• 12-Month Contract + Extensions
We are looking for a hands-on Principal Databricks Architect / Principal Data Engineer to join a large-scale Data & AI transformation programme.
Responsibilities
• Design and build scalable Databricks Lakehouse solutions.
• Lead the implementation of Medallion Architecture (Bronze, Silver, Gold).
• Develop and optimise data pipelines using PySpark and Spark.
• Enable AI and Generative AI use cases using enterprise data assets.
• Integrate external systems and APIs into the data ecosystem.
• Drive best practices across data engineering, governance, and platform architecture.
• Support the adoption of AI, LLM, and RAG-based solutions.
Required Skills & Experience
• Strong hands-on experience with Databricks.
• Expert-level PySpark and Data Engineering skills.
• Experience designing and implementing Databricks Lakehouse architecture.
• Deep understanding of Delta Lake and Medallion Architecture.
• Experience with Azure Databricks and cloud-based data platforms.
• Experience enabling AI, Machine Learning, or Generative AI initiatives.
Desirable Experience
• Education Technology (EdTech) sector experience.
• Student Information Systems.
• Individualized Education Program (IEP) platforms.
• Medicaid-related data integrations.
• Azure OpenAI, LLMs, RAG, MLflow, or MLOps.
