Senior Data Engineer

Job title: Data Engineer – Azure Synapse & Microsoft Fabric Location: Atlanta, GA Visa- GC and USC Job Summary We are seeking a highly skilled Data Engineer with strong expertise in Azure Synapse Analytics, Apache Spark, and modern cloud-based data platforms. The ideal candidate will have hands-on experience designing and implementing scalable data solutions, building robust data pipelines, and leveraging Data Lake architectures to support enterprise analytics and reporting initiatives. Key Responsibilities • Design, develop, and optimize scalable data pipelines using Azure-based technologies. • Build and maintain enterprise data solutions using Azure Synapse Analytics. • Develop data transformation and processing workflows using PySpark and Spark SQL. • Design and implement Data Lake solutions following Medallion Architecture (Bronze, Silver, Gold layers). • Work with structured and unstructured data from multiple sources to support business analytics needs. • Optimize Spark workloads and troubleshoot performance issues in distributed data processing environments. • Collaborate with architects, analysts, developers, and business stakeholders to deliver high-quality data solutions. • Support data quality, governance, and reliability initiatives across the data platform. • Contribute to the adoption and implementation of Microsoft Fabric capabilities where applicable. Required Qualifications • 8+ years of experience in Data Engineering and Data Platform development. • Strong hands-on experience with Azure Synapse Analytics. • Solid understanding of Microsoft Fabric and its data engineering capabilities. • Deep knowledge of Apache Spark architecture and distributed computing concepts. • Extensive experience with PySpark and Spark SQL. • Strong understanding of Data Lake concepts and modern data architecture patterns. • Experience implementing Medallion Architecture and large-scale data processing solutions. • Strong SQL development and performance tuning skills. • Excellent analytical, troubleshooting, and problem-solving abilities. • Strong verbal and written communication skills. Preferred Qualifications • Experience with Azure Data Lake Storage (ADLS), Azure Data Factory, and other Azure data services. • Exposure to data warehousing, ETL/ELT frameworks, and cloud-native analytics solutions. • Experience working in Agile/Scrum environments. • Knowledge of data governance, security, and performance optimization best practices. Rajmurat Yadav E:rajmurat.y@t3pillars.com | https://www.linkedin.com/in/raj-yadav-1bb721223/ www.t3pillars.com 23710 Schooler Plaza Office 2024, Ashburn | VA - 20148