About the Role: Join our team as a Senior Data Engineer, where you will be instrumental in shaping the future of data management and analytics for a leading Mortgaging Fintech Giant. In this role, you will leverage your expertise to design, build, deploy, and monitor robust, scalable data pipelines within a dynamic AWS environment. You will focus on manipulating large volumes of structured and unstructured data, normalizing databases, and ensuring data structures meet application requirements. This position requires a proactive individual capable of combining raw information from various sources into consistent, machine-readable formats, enabling data-driven decision-making at scale. TLDR: We are seeking a highly skilled Senior Data Engineer with 8+ years of experience in building and optimizing robust data pipelines on AWS. The ideal candidate will have strong Python expertise, deep knowledge of AWS Data Services (PySpark, EMR, AWS Glue, Redshift, S3, Lambda, Step Functions), and proficiency in SQL and data modeling. Experience with large-scale data processing, CI/CD, and a drive to hit the ground running are essential. Key Responsibilities: • Design, develop, and optimize scalable data pipelines using Python and AWS data services. • Build and deploy applications in AWS, leveraging services such as S3, Glue, Redshift, RDS, EMR, CloudWatch, Lambda, Step Functions, SNS, SQS, ECS, and AppFlow. • Implement and manage large-scale data processing solutions using Spark, PySpark, and Amazon EMR/Hadoop. • Write and optimize complex SQL queries for relational (Postgres, Oracle, Redshift) and NoSQL (DynamoDB) databases. • Normalize databases and ascertain that data structures meet the requirements of accessing applications. • Construct datasets that are easy to analyze and support company requirements, combining raw information from different sources. • Develop and maintain CI/CD pipelines on AWS using tools like CloudFormation, Git, GitLab, BitBucket, Maven, and Jenkins. • Automate repetitive tasks related to provisioning AWS Services, installation, configuration, or management of infrastructure using Terraform, Gitlab, Ansible, and/or Python scripting. • Troubleshoot and provide production support for data pipelines and applications in a 24/7 cycle. • Actively participate in all Agile ceremonies (planning, grooming, product demonstration, retrospectives). • Create and update detailed technical documentation including specifications, implementation guides, and architecture diagrams. Required Qualifications: • Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field. • 8+ years of relevant experience in Data Engineering and software development. • Strong proficiency in Python programming (required). • 3+ years of experience with Python, SQL, and NoSQL. • 2+ years of experience with Spark and Amazon EMR/Hadoop, PySpark. • 2+ years of experience in building and deploying applications in AWS, with hands-on experience in S3, Lambda, Glue, Redshift, RDS, EMR, CloudWatch, SNS, SQS, and Step Functions. • Deep knowledge of data modeling, data analysis, and data warehousing concepts. • Experience processing large amounts of structured and unstructured data. • Experience with CI/CD with knowledge of Git, BitBucket, Maven, and Jenkins. • Experience with APIs and RESTful services. • Excellent communication, time management, and technical presentation skills. • Strong problem-solving, logic, and analytical skills. Preferred Qualifications (Nice to Have): • Existing Fannie Mae institutional knowledge and mortgage industry experience. • Experience with Tableau reporting. • Experience in IDMC (Informatica's SAAS platform Intelligent Data Management on Cloud) and setting up Informatica on cloud. • Experience with Terraform Module creation and usage. • Familiarity with other cloud services like Azure or GCP. • Prior Identity and Access Management experience. • Experience with web development using Java, XML, JavaScript, AJAX, or other programming languages. • Knowledge of TDD, BDD, Test Automation Tools (SauceLabs, UFT, Jmeter, Gatling, LoadRunner) and Frameworks (Selenium-Cucumber). Other Details: • Location: Reston, VA (On-site, hybrid position, currently 3 days/week but could be 5 days/week). Local candidates are preferred. • Length: 2+ years, long-term. • Client: Mortgaging Fintech Giant. • Employment Type: Open to W2 full-time with benefits or C2C. The difference between something good and something great is attention to detail - AVM Consulting.