Data Engineer

Quick Interview || Senior Data Engineer (8–12 years) || W2 || PA -hybrid Senior Data Engineer (8–12 year s) PA -hybr id W2 Role Summ aryDesign, build, and operationalize scalable data pipelines and data products using a Python-based, code-first engineering approach, aligned to enterprise architecture, governance, and AI-readiness goa ls.Key Responsibilit • iesDevelop pipelines and transformations using Python (PySpark / notebooks / scrip • ts)Work within VS Code + GitHub development workfl • owsBuild ingestion, transformation, and curated data layers aligned to medallion architect • ureIntegrate data from ERP, MES, OT, historian, and operational syst • emsConvert notebooks into production-grade, reusable compone • ntsImplement unit testing, logging, monitoring, and observability framewo • rksFollow branching strategies, pull request processes, and CI/CD pipeli • nesPackage reusable logic into shared modules and librar • iesEnable creation of certified, semantic-ready data produ • ctsOptimize performance, troubleshoot failures, and ensure production reliabil • ityMaintain technical documentation and operational runbo oksRequired Ski • llsStrong proficiency in Python and PySpark-based data engineer • ingExperience with VS Code, GitHub, and code-based pipeline developm • entStrong experience with Azure Data Factory, Synapse, Microsoft Fabric, • SQLUnderstanding • of:Notebook vs. production pipeline des • ignCode modularization and re • useStrong debugging, optimization, and problem-solving capabilit iesPreferred Backgro • undManufacturing data experie • nceExposure to AI-ready datasets, feature engineering, and data observabil ity Har sh JainSr.Technical Re cruiterharsh.jain@quantumworl dit.comlinkedin.com/in/harsh-jain-a 7b541b018052256693 EX T : 845