Data Engineer

Overview: We are seeking a skilled Data Engineer to join the team and assist in building and completing data pipelines within Microsoft Fabric. The ideal candidate will have deep expertise in Microsoft Fabric, particularly in creating and managing data pipelines (formerly Azure Data Factory). Key Responsibilities: • Design, develop, and maintain scalable data pipelines using Microsoft Fabric to support team objectives. • Integrate data from various third-party systems, including CRM platforms, insurance platforms, survey tools, and equipment scanner data, into our lakehouse. • Develop and optimize Python scripts and Notebooks for data transformation and processing. • Write and optimize SQL queries for data modeling, querying, and performance tuning. • Implement and manage API integrations for efficient data ingestion. • Collaborate with team and other business units to ensure data availability, quality, and compliance with organizational standards. • Monitor, troubleshoot, and resolve performance issues in data pipelines. Required Skills & Experience: • Extensive hands-on experience with Microsoft Fabric, including Data Factory, Lakehouse, Pipelines, Fabric Notebooks, and Dataflows. • Strong proficiency in Azure Data Factory for developing and managing data pipelines. • Advanced skills in Python for data engineering tasks, including scripting and notebook development. • Expertise in SQL, with a focus on query optimization and data modeling. • Proven experience implementing and managing API-based data ingestion workflows. • Strong problem-solving skills and the ability to work independently in a fast-paced environment. • Experience handling high-volume, multi-source data environments. • Ability to work effectively in Pacific Time (PT) or Central Time (CT) time zones. Preferred Qualifications: • Familiarity with data compliance and governance best practices. • Experience working with cross-functional teams to deliver data-driven insights. • Knowledge of additional Azure services is a plus.