Senior Data Engineer – Databricks

We are hiring a Senior Data Engineer (Databricks) to build and scale modern data platforms using Databricks, Delta Live Tables (DLT), and Asset Bundles. This role requires a hands-on engineer with strong coding skills and experience in metadata-driven frameworks and CI/CD automation. You will work on designing scalable, reusable, and production-grade pipelines supporting enterprise analytics and data products. Key Responsibilities • Build and optimize data pipelines using Databricks (PySpark, SQL) • Develop and manage Delta Live Tables (DLT) pipelines • Implement metadata-driven frameworks for scalable ingestion and transformation • Design pipelines following Medallion Architecture (Bronze/Silver/Gold) • Develop and deploy solutions using Databricks Asset Bundles • Implement CI/CD pipelines (Dev → QA → Prod) with automated testing • Ensure data quality, monitoring, and performance optimization • Collaborate with cross-functional teams and mentor junior engineers Required Skills • Strong experience with Azure Databricks • Advanced coding in PySpark and SQL • Hands-on experience with: • Delta Live Tables (DLT) • Databricks Asset Bundles • Experience building metadata-driven data pipelines • Strong understanding of Delta Lake & Medallion Architecture • Experience with CI/CD (Azure DevOps, GitHub, etc.) Nice to Have • Experience with Unity Catalog & data governance • Exposure to Azure ecosystem (ADF, ADLS, Synapse, Fabric) • Knowledge of data modeling (Kimball) • Experience with streaming pipelines Domain Experience (Big Plus) • Utilities / Energy / Renewable sector experience (SCADA, metering systems, energy data pipelines) Candidate Profile • 8+ years in data engineering • Strong hands-on + architecture mindset • Experience building scalable and reusable frameworks • Comfortable in Agile / fast-paced environments