Data Engineer

BCforward is seeking a highly motivated and experienced Data Engineer Note: Candidate Must be local to New York, NY and willing to work on W2. Please do not apply if you are willing to work on C2C. Position: Data Engineer Worksite: New York, NY Duration: Long Term Contract Pay Rate: $65/Hr. On W2 Must haves: Ideally Diverse member 3 days in NYC Amex Tower is a must Individual contributor to an SDLC life cycle based agile team Data Engineering Export - Concept, Strategy and end to end data as a product/service philosophy Expert in Python Capable of devising ETL pipelines using Python from scratch Expert Airflow and understands how to develop DAGs Expert in Spark and Pyspark Willing to learn new cloud based business apps and tools Hands on proficiency and expert-level knowledge in at least one object oriented programming language in C, C++ Or Java Deep knowledge in RDBMS concepts and data engineering as a concept and service (data warehousing, data lakes and master data management) Expert at analyzing and developing queries in SQL in various dialects (SQL Server, DB2, Oracle) Hands on experience in manipulating databases via DML code packages, stored procedures, triggers and materialized views Hands on experience in developing reports and dashboards using tools such as Qlik, Tableau or Power BI Hands on experience in integrating two systems to process data through various channels (SOAP, Rest, ETL and SSIS) Hands on experience with Node Js and JSON Ability to independently write efficient and reusable code for ETL pipelines Expert in data modeling concepts such as schemas and entity relationships