BigData Engineer (Python/Spark) - W2 Only

We are actively looking for a Data Engineer @ Charlotte, NC Title: Big Data Engineer (Python/Spark) Duration: 12+ Months Location: Charlotte, NC Rate: DOE Note: W2 only Visa elegibility: USC/GC/H4-EAD/GC-EAD/TN Summary: Join a passionate, tight-knit, and supportive team as a Big Data Developer/Engineer at a Global Financial Institution. This role focuses on delivering the best experience for customers while remaining sensitive to their unique needs. This position is required to be fulfilled onsite 5 days a week. Responsibilities: • Develop and manage data ingestion from various sources including message queues, file shares, REST APIs, and relational databases • Design and build end-to-end Near-Real Time and Batch Data Pipelines • Perform performance tuning for Spark/MapReduce and SQL jobs • Work within an Agile development process through all phases of the Software Development Life Cycle • Utilize source code and version control systems for code management • Work with minimal supervision and collaborate effectively within a team of diverse skill sets • Comprehend customer requests to provide correct solutions and resolve complex issues Requirements: • Over 9+ years of experience as Data Engineer. • Strong SQL skills (MySQL, HIVE, Impala, SPARK SQL) • Experience with data ingestion and data formats (json, csv, xml) • Experience with SPARK Structured Streaming, Hadoop/Big Data, and Distributed Systems • Working experience with Spark, Sqoop, Kafka, MapReduce, and NoSQL Databases (HBase, SOLR) • Experience with CDP/HDP (Cloudera or Hortonworks), Elastic Search, and Kibana • Hands-on programming experience in at least one of the following: Scala, Python, PHP, or Shell Scripting • Proficiency with the Linux operating system • Experience with Source Code and Version Control systems (SVN, Git, Bit Bucket) • Experience with Jenkins and Jar management • Strong analytical and problem-solving skills • Ability to adapt and learn new technologies