Senior Data Engineer Azure Databricks, Azure Data Factory 100% Remote Contract to Permanent Job

We are seeking a Senior Data Engineer responsible for designing, developing, and optimizing data pipelines and workflows to support business intelligence and analytics initiatives. With extensive experience in Azure Databricks and Azure Data Factory, the Senior Data Engineer will play a key role in transforming raw data into actionable insights, enabling data-driven decision-making across the organization. • Design, develop, and maintain scalable and reliable data pipelines using Azure Databricks and Azure Data Factory. • Implement ETL processes to integrate data from various sources into a centralized data warehouse or lake. • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet their needs. • Optimize performance of big data workflows and ensure efficient processing of large datasets. • Monitor and troubleshoot data pipelines to ensure data quality and consistency. • Develop and enforce best practices for data engineering, including version control, testing, and deployment. • Ensure compliance with data governance and security standards. • Provide mentorship to junior team members and contribute to team knowledge sharing. • Perform other work-related duties as assigned. Required: • Bachelor’s degree in Computer Science, Information Technology, or a related field. • 7 years of experience in data engineering with a strong focus on Azure Databricks and Azure Data Factory. • Proven experience in designing and implementing big data solutions and cloud-based architectures. • Expertise in Azure Databricks, Azure Data Factory, and other Azure data services. • Strong programming skills in Python, SQL, and Spark. • Familiarity with data modeling, data warehousing, and ETL processes. • Knowledge of data governance, security, and compliance standards. • Strong problem-solving skills and ability to troubleshoot complex data workflows. • Excellent communication and collaboration skills. Preferred: • Experience with DevOps practices and tools for CI/CD in data engineering workflows is a plus. No strenuous physical activity, though occasional light lifting of files and related materials is required. 30% of time in meetings, working with team, or talking on the phone, 70% of the time at the desk on computer, doing analytical work. Minimal travel required. Travel includes airplane, automobile travel and overnight hotel. Works for lengthy periods of time in sitting or standing position and for lengthy periods of time using a computer. Position may require travel, up to 10%, travel includes airplane, automobile travel and overnight hotel. At times, this role demands flexible work hours to meet deadlines, maintain system availability and support business continuity.