Senior Data Engineer

• The candidate must have 5+ years of hands on experience working with PySpark/Python, microservices architecture, AWS EKS, SQL, Postgres, DB2, Snowflake, Behave OR Cucumber frameworks, Pytest (unit testing), automation testing and regression testing. • Experience with tools such as Jenkins, SonarQube AND/OR Fortify are preferred for this role. • Experience in Angular and DevOps are nice to haves for this role. Must Have Qualifications: PySpark/Python based microservices, AWS EKS, Postgres SQL Database, Behave/Cucumber for automation, Pytest, Snowflake, Jenkins, SonarQube and Fortify. Responsibilities: • Development of microservices based on Python, PySpark, AWS EKS, AWS Postgres for a data-oriented modernization project. • New System: Python and PySpark, AWS Postgres DB, Behave/Cucumber for automation, and Pytest • Perform System, functional and data analysis on the current system and create technical/functional requirement documents. • Current System: Informatica, SAS, AutoSys, DB2 • Write automated tests using Behave/cucumber, based on the new micro-services-based architecture • Promote top code quality and solve issues related to performance tuning and scalability. • Strong skills in DevOps, Docker/container-based deployments to AWS EKS using Jenkins and experience with SonarQube and Fortify. • Able to communicate and engage with business teams and analyze the current business requirements (BRS documents) and create necessary data mappings. • Preferred strong skills and experience in reporting applications development and data analysis Knowledge in Agile methodologies and technical documentation.