Data Engineer

Role: Data Engineer/Data Scientist Contract #W2 Only Location: San Diego, CA(Remote) duration: 12+Months Client: Medical • Design, develop, and optimize data pipelines using Databricks and Medallion architecture for structured and unstructured data. • Implement data ingestion strategies from diverse sources (SAP, TrackWise, Salesforce, and others) ensuring high-quality, reliable data flow. • Ingest and process large volumes of data from Azure Blob Storage into Databricks for transformation and analytics. • Build and maintain silver and gold layers for curated, analytics-ready datasets. • Apply advanced statistical methods, including: • Anomaly Detection for identifying irregular patterns in operational and quality data. • Forecasting for demand, defect trends, and resource planning. • Root Cause Analysis to identify drivers of failures or complaints. • Risk Modeling to quantify and predict potential quality or operational risks. • Predictive Analytics for proactive decision-making and maintenance. • Pattern Detection to uncover hidden relationships in large datasets. • Develop and deploy NLP solutions for text-based data analysis, leveraging linguistic schemas for structured interpretation of unstructured data. • Create Power BI dashboards with: • Workflow automation (notifications, reminders, messaging). • AI-driven insights using prepped datasets for predictive and prescriptive analytics. • Implement near real-time tracking systems and alert mechanisms for critical events and operational KPIs. • Collaborate with cross-functional teams to align data solutions with business objectives and ensure visibility across the end-to-end operating cycle. • Document data workflows, maintain traceability, and ensure audit readiness for all data engineering activities. • Leverage knowledge of Quality Management Systems (QMS) to support compliance and continuous improvement. kindly share resume at gaurav@stellarconsulting.com or call me at 678-935-7045 to discuss more!