Data Engineer

We are seeking a Data Engineer II to contribute to the data management aspects of client engagements, delivering innovative solutions within the Services group. In this role, you will develop robust data pipelines, implement scalable data solutions, and collaborate with cross-functional teams. Here are some of the specific details: Job Title: Data Engineer II Job Duration: 3+ months Job Location: O'Fallon, MO (2/3 days onsite) REQUIRED SKILLS: • Experience as a Data Engineer or in a similar role, with a strong understanding of data engineering concepts and methodologies. • Strong knowledge of writing and optimizing SQL queries to retrieve, manipulate, and analyze data efficiently. • Hands-on experience with big data technologies such as: Apache Spark (PySpark, Spark SQL, Spark Streaming). • Hadoop ecosystem (HDFS/ Ozone, Hive, YARN). • Assist in creating, running and optimizing queries on Impala and Spark to extract data from the MC Data Warehouse. • Build PySpark jobs based on the technical specs for multiple projects in parallel. • Familiarity with ETL frameworks and the ability to design, implement, and maintain data pipelines. • Monitor and troubleshoot the execution of jobs. • Ingest Data into SQL Server and transform it into Custom Analytics models. • Familiarity with Python. • Bachelor's degree in quantitative discipline such as Engineering, Mathematics, Finance, Business, or a related field. Equivalent practical experience may also be considered. A reasonable, good faith estimate of the minimum and maximum for this position is $59/hr to $69/hr on W2.