Azure Data Factory Engineer (Required Security Clearance)

Please apply only if you hold an Active Secret (or higher) clearance Role Overview: The role involves collaborating with business analysts, data architects, and stakeholders to manage and execute end-to-end data migration projects. The engineer will design, implement, and optimize data pipelines from Oracle databases and CSV sources to Microsoft Dataverse using Azure Data Factory (ADF), ensuring data integrity, accuracy, and completeness. Key Responsibilities: • Perform data profiling, cleansing, and quality validation. • Analyze and map Oracle schemas to Dataverse tables/entities, applying necessary transformations. • Develop and optimize SQL queries, stored procedures, and scripts for migration. • Configure and optimize ADF pipelines for performance and concurrency. • Handle error logging/auditing from ADF pipelines to Dataverse. • Work with additional Azure services (Logic Apps, Data Lake, Azure Functions, Azure SQL). • Generate reconciliation reports to validate migrated data. • Maintain DB objects in SQL Server; develop ETL packages (SSIS). • Familiarity with Git/source control and CI/CD processes. Experience Required: • Minimum 4 Years of Work Experience Required Mandatory Skills: • Data Migration (Expert/Advanced) • Microsoft Azure (Intermediate) • Oracle (Advanced) • SQL (Advanced) Preferred Skills: • Azure SQL DB, Azure Data Factory, Data Lake Analytics, Azure Functions, Logic Apps (Intermediate)