Data Engineer

Role- Data Engineer Location - Remote with Quarterly Once or twice visit to Philadelphia PA Position Type- Contract Role Summary Design, build, and operationalize scalable data pipelines and data products using a Python-based, code-first engineering approach, aligned to enterprise architecture, governance, and AI-readiness goals. Key Responsibilities • Develop pipelines and transformations using Python (PySpark / notebooks / scripts) • Work within VS Code + GitHub development workflows • Build ingestion, transformation, and curated data layers aligned to medallion architecture • Integrate data from ERP, MES, OT, historian, and operational systems • Convert notebooks into production-grade, reusable components • Implement unit testing, logging, monitoring, and observability frameworks • Follow branching strategies, pull request processes, and CI/CD pipelines • Package reusable logic into shared modules and libraries • Enable creation of certified, semantic-ready data products • Optimize performance, troubleshoot failures, and ensure production reliability • Maintain technical documentation and operational runbooks Required Skills • Strong proficiency in Python and PySpark-based data engineering • Experience with VS Code, GitHub, and code-based pipeline development • Strong experience with Azure Data Factory, Synapse, Microsoft Fabric, SQL • Understanding of: • Notebook vs. production pipeline design • Code modularization and reuse • Strong debugging, optimization, and problem-solving capabilities Preferred Background • Manufacturing data experience • Exposure to AI-ready datasets, feature engineering, and data observability