Azure SQL Database Developer

Job Details: Position: Azure SQL Database Developer / Data Engineer (Power BI integration) Location: Montpelier, VT (Remote) Duration: 12+ Months contract with possible extension Knowledge Requirements 1. Azure SQL DB 1. The vendor must demonstrate strong experience in designing, implementing, and maintaining Azure SQL Databases. This includes expertise in database architecture, performance tuning, indexing strategies, security configurations, backup and restore operations, and managing high availability and disaster recovery setups. Familiarity with scaling databases to meet varying workloads and implementing monitoring and alerting solutions is required. 1. 1. ETL Processing with Python in Data Factory 1. The vendor must have hands-on experience in building, deploying, and managing ETL pipelines using Azure Data Factory, with Python-based transformations. This includes extracting data from multiple sources, transforming it according to business rules, and loading it into target systems efficiently. Knowledge of orchestrating pipelines, scheduling, error handling, logging, and implementing reusable and maintainable Python scripts is essential. 1. 1. Azure Blob Storage 1. The vendor must have practical knowledge of Azure Blob Storage for storing, managing, and retrieving large datasets. This includes configuring containers, managing access policies, implementing security measures, optimizing storage for performance and cost, and integrating Blob Storage with other Azure services. 1. Experience with automated data movement, lifecycle management, and data archiving is preferred. Functional Requirements 1. Requirements Elaboration • Working with PSD and ADS staff, refine functional (business) and non- functional (technical) requirements, culminating in a requirements repository. • Working with PSD and ADS staff, establish minimum performance expectations and success criteria for the end product. 1. Documentation & Training • Deliver schema design and database structure documentation. • Provide security configurations and access policies. • Train VT PSD personnel on database usage and Power BI integration. Non-Functional Requirements 1. Data Management & Storage • Support storage and retrieval of specified data types and sources. • Handle expected data volumes efficiently. • Ensure data integrity and accuracy during migration/import. 1. Database Schema & Design • Implement an optimized, normalized relational database schema. • Support relational integrity with primary and foreign keys. • Include indexing for performance optimization. • Allow for future scalability and extensibility. 1. Extract Transform Load (ETL) Processing • Implement an optimized ETL solution that utilizes Python scripting to handle the transformation in Azure infrastructure. • ETL processing should be able to be scheduled when new data files are received. • ETL processing needs be standardized between the data files and source systems. • ETL Templates based on the data sources for future expansion. 1. Integration Capabilities • Enable integration with existing VT PSD systems. • Ensure Azure SQL Database connectivity with Power BI. • Support direct querying and/or data export to Power BI. • Provide necessary data pipelines or views for Power BI. • Enable API connections with current and future utility data systems, including, NEPOOL GIS, ISO-NE, and VELCO's VX platform. 1. Security & Compliance • Implement role-based access control (RBAC). • Ensure data encryption at rest and in transit. • Adhere to compliance requirements from VT PSD and VT ADS. 1. Testing & Validation • Validate database integrity and security controls. • Implement and validate a database maintenance plan. 1. Deployment & Support • Deploy the database in the Azure SQL production environment. • Provide post-implementation monitoring and issue resolution. • Ensure database connectivity via VPN and office locations. 1. Performance & Optimization • Optimize database performance for querying and analytics. • Ensure query performance under expected load conditions. Deliverables • Approved database schema design. • Fully implemented Azure SQL Database. • Documentation and training materials. • Knowledge transfer to enable the state to support the solution post-implementation. Qualifications Required • Proficiency in Azure SQL Database architecture and implementation. • Experience designing and optimizing relational databases. • Expertise in integrating Azure SQL with Power BI. • Knowledge of data security and compliance best practices. • Strong communication skills for collaboration with VT PSD stakeholders.