AZURE DATA ENGINEER

Job Title: AZURE DATA ENGINEER Location: New York, NY Job Type: Contract Work schedule: Monday- Friday 8 AM to 5 PM Duration: 10 Months DESCRIPTION OF WORK (SCOPE OF WORK) ERAD currently hosts Cognos and Microsoft Power Platform technologies to provide data, reporting and application development to various departments in an Agency. It is anticipated that this platform will be exploited to a much greater extent in the near future to address all aspects of corporate reporting needs and application development which enables the organization to make decisions that achieve better outcomes, flexible deployment options, and to enable to easily scale analytics to meet changing business needs. The successful candidate may work independently as well as with both consultant and staff resources of different units and departments throughout the Agency under the direction of project manager to deliver work projects including but not limited to: A. JOB RESPONSIBILITIES: New development: Working with PA technical manager, responsible for understanding and documenting business requirements, providing project plans for new implementation, develop, test and deploy solutions to prod environment following PA processes for tracking user requirements, project development status and testing and deploying solutions following change/release management process. Systems Testing and Deployment – Responsible for unit and system integration testing, coordinating with business users for user acceptance testing and getting sign off from business users to implement solutions in the production for any new enhancements or development following PA’s change/release management process. Systems Support – Provide maintenance, enhancements and support of platform making sure the stability of applications is maintained by resolving any data issues, user help tickets in timely manner and provide on-call availability for off-hour problem resolution. Environment Support - Maintenance of Non-prod and Prod Cognos environments making sure the stability of these environments is always maintained by applying any required patching and upgrades as required. System administration - Provide system administration for installation and configurations of different components of Cognos platform, upgrades and responsible to maintain and establish user accounts, security profiles, controlling access to applications and reports following the process. Troubleshooting and Problem Management and Resolution - Logging, documenting, tracking and resolving system problems while ensuring ongoing data integrity with any and all interfaces and/or systems. Disaster Recovery Support – Defining, in conjunction with the Port Authority, the scope of periodic disaster recovery tests. Coordinating with other Port Authority staff and third parties to ensure all required tasks are covered for these tests. Documentation and Training - Responsible for providing all documentation needed for the continued operation and management of the system and for any new implementations that is accurate and available and in compliance with PA Standards. Provide training to end users on any new functionality of the application or platform by providing user guides. B. MINIMUM EXPERIENCE AND QUALIFICATIONS: Minimum 10 years of relevant experience in architecting, design, and development of data warehouse systems (SQL Server based on Cloud/on premise and Analytics) at enterprise scale. Experience in building end-to-end data warehouse and analytical systems using SQL Server family of products, Analysis Services Power BI, etc. Experience in Data platforms development using Azure SQL database, Azure Data Factory, Azure Storage, Azure Pipelines, Azure IaaS/PaaS related to database. Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required. Designing and building data pipelines using API ingestion and Streaming ingestion methods. Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential. Experience in developing NO SQL solutions using Azure Cosmos DB is essential. Thorough understanding of Azure and AWS Cloud Infrastructure offerings. Strong experience in common data warehouse modelling principles including Kimball, Inmon. Knowledge in Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Stream Analytics, Power BI is desirable. Knowledge of Microsoft BI Stack (SSRS/SSAS (Tabular with DAX & OLAP with MDX) SSIS) is desirable. Knowledge of C# and Hands-on with PowerShell scripting is desirable. Working knowledge of Python is desirable. Experience developing security models. Any certification in related technologies is preferred