Senior Data Engineer

Position Overview We are seeking a Senior Data Engineer to support a large-scale clinical data onboarding initiative involving 80+ hospital systems. You will work within an established Azure-based data platform to extract, validate, transform, and load clinical data from hospital EMR systems. This role requires strong technical skills, healthcare data experience, and the ability to navigate complex hospital IT environments. Key Responsibilities • Configure and implement EMR data extraction pipelines using ODBC connections and file-based exports • Deploy and configure edge extraction agents within hospital environments • Coordinate with hospital IT teams to establish secure connectivity (VPNs, MFA, network allow-listing) • Perform data wrangling including datatype casting, field trimming, null handling, and case normalization • Reconcile patient, encounter, and provider identifiers across EMR and practice management systems • Implement validation and data quality checks against standardized data models • Troubleshoot failed loads, perform root-cause analysis, and drive remediation • Load validated datasets into Azure SQL databases using established transformation frameworks Required Qualifications • 5+ years of experience in data engineering, ETL development, or pipeline operations • Strong SQL expertise with experience writing complex queries and optimizing performance • Proficiency in Python for data manipulation; pandas experience required • Experience with Azure cloud services (Azure SQL, Azure Data Factory, or similar) • Familiarity with healthcare data standards (HL7, FHIR) and EMR systems • Experience navigating hospital IT environments and working with clinical data • Must be US-based and able to work within US-based data center constraints Preferred Qualifications • Experience with dbt, Pydantic, DuckDB, or SQL Alchemy • Familiarity with FastAPI and Python-based backend services • Experience with GitHub Actions for CI/CD pipelines • Prior experience extracting data from Epic, Cerner, Meditech, or other major EMR platforms • HIPAA compliance experience and understanding of PHI handling requirements • Snowflake experience a plus