Cloud Data Engineer (Azure)

Cloud Data Engineer (Azure) Remote | Public Trust Required Occasional travel to Washington, D.C. metro area Overview We are seeking a senior-level Cloud Data Engineer with strong Microsoft Azure experience to design, modernize, and operate enterprise-scale data pipelines supporting mission-critical government systems. This role is ideal for an engineer who enjoys bridging legacy SQL/SSIS environments with modern Azure-native data platforms, and who takes pride in building reliable, secure, and high-performing data solutions. You’ll work alongside architects, developers, and client stakeholders to translate business and analytics requirements into scalable data engineering solutions that power reporting, analytics, and AI/ML initiatives. What You’ll Do • Maintain, support, and optimize legacy SQL Server and SSIS-based ETL processes, while leading efforts to modernize them into Azure-native solutions • Design, build, and operate end-to-end Azure data pipelines using services such as Azure Data Factory, Synapse Pipelines, Azure Data Lake, and Spark • Redevelop existing SSIS workflows into ADF and Synapse pipelines, ensuring performance, reliability, and data integrity • Design and implement data models and pipelines across: • Relational and dimensional data stores • Data lakes and lakehouse (medallion) architectures • Data warehouses and data marts • SQL and NoSQL platforms • Develop high-performing data pipelines using Python, SQL/T-SQL, PySpark, stored procedures, and notebooks • Implement data migration, validation, quality checks, metadata management, and security controls • Prepare and curate data for analytics, reporting, visualization, and AI/ML use cases • Monitor, troubleshoot, and resolve data pipeline issues to ensure availability and performance • Support CI/CD, version control, deployment automation, and operational monitoring • Actively participate in Agile DevOps ceremonies, including Program Increment (PI) planning • Continuously improve processes, performance, and technical capabilities through learning and collaboration Required Qualifications • Bachelor’s degree in Computer Science, Engineering, or related field with 8+ years of experience • (or Master’s degree with 6+ years of experience) • 4+ years of hands-on experience developing and maintaining ETL pipelines using: • Microsoft SSIS • SQL Server / SQL Agent • PowerShell or equivalent scripting • 4+ years of experience with one or more of the following: • SQL / T-SQL • Python • PySpark • Strong experience with Microsoft data and BI technologies, including: • SQL Server (stored procedures, performance tuning) • SSIS, SSRS, SSAS • Proven experience building data engineering solutions in Microsoft Azure, including: • Azure Data Factory • Azure Synapse Analytics • Azure Data Lake Storage • Experience working in Agile environments with strong version and configuration control practices • Ability to obtain and maintain a Public Trust clearance Nice to Have • Experience migrating large, complex ETL workloads from on-prem SQL/SSIS to Azure • Exposure to Snowflake, REST APIs, JSON/XML processing, or Spark-based pipelines • Experience supporting data platforms in government or highly regulated environments • Familiarity with data governance, security, and compliance best practices Why This Role • Work on high-impact government programs that matter • Help modernize legacy systems into scalable cloud platforms • Collaborate with experienced engineers and mission-focused teams • Remote-first flexibility with limited travel • Opportunity to influence architecture, standards, and modernization strategy