Senior Big Data Engineer (Python/PySpark)

Position Title: Senior Big Data Engineer (Python/PySpark) Provide locations/flexible work by preference: 1. Pittsburgh PA - Two PNC Plaza OR Cleveland OH - Strongsville Technology Center • • Please note, the hiring team is not looking to source out of any other tech hubs at this time • • Ability to work remote: Hybrid - 3 days in office, 2 Remote Acceptable time zone(s): EST Days of the week: Mon-Fri, 40 hours Working Hours (Flexible): 8-5pm EST Roles and Responsibilities: • Interact with Business to understand the requirement on a daily evolving need and adapt to the needs. • Able to understand the business requirements, tech stack involved and guide the team towards Integral solution approach. • Dedicated and committed approach with good communication skills and participation in agile ceremonies. • Hands on Experience with Object Oriented Programming including limitations. • Familiarity with cross-platform development • Able to handle all the database storage and retrieval mechanisms on Data Lake Platforms and extensive experience in handling. • Extensive Unix/FTP/ File Handling • Strong Hands-on experience with SQL databases Must Have Technical Skills: • A deep understanding and multi-process architecture and the threading limitations of Python. • Pyspark Data engineering skills • Experience using libraries like Pandas, NumPy and MatPlotLib. With experience working with file based systems(supporting csv/parquet/) • Extensive knowledge in understanding Data and creating Data Pipelines • Hands on experience designing and implementing APIs • Hands on experience building microservices using FastAPI or related technologies. • Experience writing unit testing and ensure code coverage. • Experience with Agile Methodology/JIRA/Confluence • Experience in version control using Git Flex Skills/Nice to Have: Added advantage if worked on Big Data, PySpark libraries. Education/Certifications: Bachelors Preferred Python or Spark certifications are a plus Role Differentiator: Conversion possibility, growth opportunities are immense, there is always work and always ways to grow and a place where you can be energized by new work and opportunities. Supporting the bank in a huge way in this department and very critical to the bank's success. Skills: • A deep understanding and multi-process architecture and the threading limitations of Python • Experience in version control using Git • Experience using libraries like Pandas, NumPy and MatPlotLib. With experience working with file based systems(supporting csv/parquet/) • Experience with Agile Methodology/JIRA/Confluence • Experience writing unit testing and ensure code coverage. • Extensive knowledge in understanding Data and creating Data Pipelines • Hands on experience building microservices using FastAPI or related technologies. • Hands on experience designing and implementing APIs • Pyspark Data engineering skills Share your resume with ariz.khan@systemone.com. Also connect me at LinkedIn : (16) Ariz J. Khan | LinkedIn Ref: #404-IT Pittsburgh