Senior Data Engineer

Veteran Firm Seeking a Senior Data Engineer for a Hybrid Assignment in Washington, DC My name is Stephen Hrutka, and I lead a Veteran-owned consulting firm in Washington, DC, focused on strategic sourcing, supply chain, and IT Staffing. We want to fill a Senior Data Engineer role for the DHCF - Department of Health Care Finance in the DC Government. The ideal candidate is a DMV resident with 7–10 years of experience leading advanced technology projects, strong consulting leadership, and end-to-end project delivery expertise. They should have hands-on experience with SQL Server (SSIS/SSAS/SSRS), expert-level SSIS and T-SQL skills, and advanced proficiency in Azure Databricks and Azure Synapse, along with a solid foundation in ITIL practices. If you’re interested, I'll gladly provide more details about the role and further discuss your qualifications. Thanks, Stephen M Hrutka Principal Consultant www.hruckus.com Executive Summary: HRUCKUS is looking for a Senior Data Engineer for its data modernization efforts associated with its Medicaid data ecosystem. Position Description: The Senior Data Engineer serves as the primary technical engine for the agency's Medicaid data ecosystem. This role is unique: it requires a high-level mastery of our current legacy environment—characterized by SSIS ETL processes managed via Team Foundation Server (TFS)—while actively spearheading the execution of our cloud modernization roadmap. Under the direction of the Lead Data Warehouse Solution Architect, you will ensure the stability of current Medicaid reporting while building the future-state Azure Synapse and Databricks Lakehouse. Position Responsibilities: A. Legacy Maintenance & Operational Excellence (Current State) • ETL Management: Maintain, troubleshoot, and modify complex SSIS packages handling high-volume Medicaid claims, provider, and member data. • Version Control: Manage code deployments and branching strategies within TFS, ensuring continuous integration of legacy SQL assets. • Legacy Reporting Support: Support and optimize SSRS report queries and SSAS tabular/multidimensional models to ensure federal and state compliance reporting remains uninterrupted. B. Modernization & Migration Execution (Future State) • Cloud Development: Implement "Medallion Architecture" (Bronze/Silver/Gold) using Azure Databricks (PySpark/SQL) as designed by the Lead Architect. • Pipeline Refactoring: Lead the transition of legacy SSIS logic into Azure Data Factory (ADF) and Databricks notebooks. • DevOps Transformation: Facilitate the migration of source control and CI/CD pipelines from TFS to Azure DevOps (Git). • Synapse Integration: Build and tune Dedicated and Serverless SQL Pools within Azure Synapse to facilitate advanced analytics and AI-readiness. C. Data Governance & Security • Medicaid Compliance: Implement Row-Level Security (RLS) and automated data masking for PHI/PII in accordance with HIPAA, CMS MARS-E, and NIST standards. • Data Quality: Develop automated data validation frameworks to ensure data parity between legacy SQL systems and the new Cloud Lakehouse. Required Qualifications: • Maintaining SQL Server (SSIS/SSAS/SSRS) while concurrently deploying Azure cloud solutions. • Expert-level proficiency in SSIS and T-SQL. Advanced proficiency in Azure Databricks (Unity Catalog, Delta Lake) and Azure Synapse. • Deep experience with TFS (Team Foundation Server) and a strong desire to migrate workflows to Git/Azure DevOps. • Mastery of SQL and Python (PySpark). • 7-10 yrs. leading advanced technology projects or service projects • 7-10 yrs. full system engineering lifecycle Highly Desired Qualifications: • Experience with Microsoft Purview for data cataloging. • Extensive experience with Medicaid/Medicare data structures (e.g., MMIS, EDI 837/835, claims processing). • Microsoft Certified: Azure Data Engineer Associate or Databricks Certified Professional Data Engineer. • Experience in a government or highly regulated environment. Minimum Education/ Certification Requirements: • Bachelor’s degree in Information Technology or related field or equivalent experience • Training or certification in a particular product or IT platform/service, as required The target annual salary is $157,000 - $169,000. Skills Matrix: • Maintaining SQL Server (SSIS/SSAS/SSRS) while concurrently deploying Azure cloud solutions. | Required | 7 years • Expert-level proficiency in SSIS and T-SQL. Advanced proficiency in Azure Databricks (Unity Catalog, Delta Lake) and Azure Synapse. | Required | 7 years • Deep experience with TFS (Team Foundation Server) and a strong desire to migrate workflows to Git/Azure DevOps. | Required | 7 years • Mastery of SQL and Python (PySpark). | Required | 7 years • 7-10 yrs. leading advanced technology projects or service projects | Required | 7 years • 7-10 yrs. full system engineering lifecycle | Required | 7 years • Bachelor’s degree | Required • Experience with Microsoft Purview for data cataloging. | Highly Desired | 3 years • Extensive experience with Medicaid/Medicare data structures (e.g., MMIS, EDI 837/835, claims processing). | Highly Desired | 3 years • Microsoft Certified: Azure Data Engineer Associate or Databricks Certified Professional Data Engineer. | Highly Desired • Experience in a government or highly regulated environment. | Highly Desired | 7 years