Cloud Data Engineer – Azure Databricks & Data Factory

Job Title: Senior Cloud Data Engineer – Azure Databricks & Data Factory Location: Remote Duration: 12+Months About the Role: We’re looking for a Senior Cloud Data Engineer with 12-15 years of experience to lead the design and development of large-scale data pipelines using Azure Databricks and Azure Data Factory. If you have a deep understanding of cloud data engineering and a passion for optimizing complex data workflows, we want you on our team. Key Responsibilities: • Lead the design and development of scalable ETL pipelines using Azure Databricks and Azure Data Factory. • Drive the migration of legacy ETL systems to cloud-based, Databricks-powered solutions. • Integrate and manage data from APIs, relational databases, and cloud sources into Azure Data Lake and Synapse. • Collaborate with cross-functional teams to define and implement data models that support strategic business goals. • Ensure data quality, implement robust validation processes, and maintain detailed metadata and lineage documentation. What We’re Looking For: • 12-15 years of experience in data engineering, with significant expertise in cloud ecosystems (preferably Azure). • Expertise in Azure Databricks, PySpark, SparkSQL, and Azure Data Factory. • Strong background in data warehousing, SQL optimization, and performance tuning. • Proven track record of integrating complex data sources (APIs, relational, cloud systems). • Experience with DevOps, CI/CD, Git, and data governance best practices. Bonus Points: • Azure Data Engineer Associate certification. • Experience with real-time streaming (e.g., Kafka, Azure Stream Analytics).