Senior Data Engineer

Title Senior Data Engineer Location Durham, NC (Hybrid)  Duration 12 Months Interview Type Either Webcam Interview or In Person Job Type C2C,W2     Job Description DHHS-ITD is seeking a Senior Data Engineer to lead the development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics, ensuring data accessibility, performance, and security for the Child Welfare Program. • The Department of Health and Human Services (DHHS) requires the assistance of a contract resource to serve as a Senior Synapse Data Engineer. • The primary purpose of this position is to lead the development and optimization of our data pipelines, analytics solutions, and cloud-based data platforms. • This role will be instrumental in designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs. Key Responsibilities: Synapse • Design, Develop and maintain data models in Synapse to support reporting and analytics • Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects. • Analyze the source system and design the ETL data load. • Ability to create and configure Azure Synapse Analytics workspace. • Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract, Transform and Load data from different sources like SalesForce. • Perform needed monitoring, troubleshooting, and maintenance of the data architecture and pipelines. Power BI Tools • Collaborate with data engineers, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools. Skill Required / Desired Amount of Experience Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows Required 5 Years Programming Languages: Strong proficiency in Python or Scala for data processing. Required 3 Years SQL Mastery: Advanced query writing, performance tuning, and optimization. Required 7 Years Experience with Data Modeling and Warehousing (star schema, snowflake schema) Required 4 Years Experience with ETL/ELT processes Required 5 Years Experience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database) Highly desired 4 Years Familiarity with Event Hubs, Azure Stream Analytics, and Azure Functions Desired 4 Years Experience with Programming and Scripting (SQL, T-SQL, and data query optimization) Desired 1 Years Experience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storage Desired 5 Years Experience with Power BI Nice to have 1 Years