Data Migration Consultant

Role Overview We are seeking a Senior ETL / Data Migration Engineer to support a large-scale data migration and optimization initiative within the platform. This role will focus on moving and transforming massive volumes of historical and active customer data across multiple databases and environments while significantly improving migration performance and reliability. The engineer will be responsible for analyzing existing data pipelines, identifying bottlenecks, and optimizing SQL-to-Cosmos DB (JSON) and SQL-to-PostgreSQL data transfers using Azure Data Factory. The current migration processes are functional but slow, and the goal is to improve efficiency, scalability, and overall throughput. This is a hands-on role that requires deep expertise in databases, ETL optimization, and large-scale data movement across heterogeneous environments. Key Responsibilities • Optimize large-scale data migrations involving billions of records and thousands of terabytes of data • Migrate data: • From SQL Server to Cosmos DB (JSON format) • From SQL Server to PostgreSQL with differing schemas • Improve and refactor ETL pipelines built in Azure Data Factory • Analyze and optimize: • Database reads and writes • Insert strategies and batch processing • Query performance across systems • Handle schema mismatches and complex data transformations • Ensure historical and new service request data is migrated accurately and efficiently • Evaluate current migration scripts and processes and recommend performance improvements • Ensure migrations are stable, repeatable, and performant in different environments • Environment & Scale • ~800,000 customers • Multi-year historical dataset (3+ years) • Extremely large datasets where previous migrations of small customer subsets were time-consuming • Data being migrated to support a new platform that must remain accessible and performant Must Have Qualifications Strong ETL and data migration experience across large-scale systems Proven experience migrating data between: SQL databases PostgreSQL NoSQL databases (Cosmos DB preferred) Hands-on experience with Azure Data Factory, including complex transformations Deep understanding of: Database performance tuning Optimizing reads, writes, inserts, and bulk loads Query optimization across different database engines Experience handling schema mismatches and complex transformations Ability to assess existing pipelines and significantly improve efficiency Strong understanding of how data moves across different environments and systems Ability to work independently and deliver tangible performance improvements quickly Plusses Experience working with extremely large datasets (billions of records / TB-scale data) Cosmos DB optimization experience (especially JSON-based ingestion patterns) Experience migrating from legacy platforms (e.g., Salesforce or similar systems) Background in performance engineering or database architecture Experience optimizing custom migration scripts in addition to managed ETL tools Familiarity with networking considerations that impact large data transfers Prior experience parachuting into short-term engagements to “make it faster and better”