Mid-Level SQL Data Engineer

Verified Job On Employer Career Site Job Summary: Apex Systems is a world-class IT services company that serves thousands of clients across the globe. They are seeking a SQL Data Engineer to work on data ingestion and the design and build of data pipelines using various technologies. The role requires strong SQL skills and experience with Python, Kafka, and Agile development processes. Responsibilities: • Strong SQL Skills – one or more of MS SQL, MySQL, HIVE, Impala, SPARK SQL • Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml • Excellent Object oriented programming experience with Python • Experience with testing frameworks including pytest and python.unittest • Experience working with Kafka for streaming and HIVE (or equivalent) for historical storage • Bonus points for having experience working with one or more tech like: Hadoop/Big Data and Distributed Systems, SPARK Structured steaming, elastic • Performance tuning experience with Python and SQL jobs • Experience and proficiency with Linux operating system is a must • Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines • Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle • Experience using Source Code and Version Control systems like Git, Bit Bucket etc. • Experience working with Jenkins and Jar management • Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets • Ability to comprehend customer requests and provide the correct solution • Strong analytical mind to help take on complicated problems • Desire to resolve issues and dive into potential issues • Ability to adapt and continue to learn new technologies is important Qualifications: Required: • Strong SQL Skills – one or more of MS SQL, MySQL, HIVE, Impala, SPARK SQL • Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml • Excellent Object oriented programming experience with Python • Experience with testing frameworks including pytest and python.unittest • Experience working with Kafka for streaming and HIVE (or equivalent) for historical storage • Performance tuning experience with Python and SQL jobs • Experience and proficiency with Linux operating system is a must • Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines • Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle • Experience using Source Code and Version Control systems like Git, Bit Bucket etc. • Experience working with Jenkins and Jar management • Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets • Ability to comprehend customer requests and provide the correct solution • Strong analytical mind to help take on complicated problems • Desire to resolve issues and dive into potential issues • Ability to adapt and continue to learn new technologies is important Preferred: • Bonus points for having experience working with one or more tech like: Hadoop/Big Data and Distributed Systems, SPARK Structured steaming, elastic Company: Apex Systems, a division of On Assignment, provides organizations with IT staffing solutions to address gaps in their current workforce. Founded in 1995, the company is headquartered in Richmond, Virginia, USA, with a team of 1001-5000 employees. The company is currently Late Stage. Apex Systems has a track record of offering H1B sponsorships.