Data Engineer

Responsibilities Kforce is immediately seeking an experienced Data Engineer in support of our enterprise telecommunications and mass media client based in Maryland Heights, MO. Summary: We are seeking a highly skilled and motivated Data Engineer to join our growing team. This role will focus on leveraging cutting-edge technologies to design and build scalable data solutions. The ideal candidate will have a strong background in cloud-driven environments, big data frameworks, and real-time data streaming technologies. Key Responsibilities: • Data Engineer will design, develop, and deploy Spark pipelines from scratch using Scala • Migrate and process data to the cloud, predominantly on AWS • Implement and optimize batch processing and real-time streaming solutions, transitioning to a fully real-time environment in AWS • Utilize Apache Kafka (or AWS Kinesis) for real-time data streaming • Develop and manage databases using DynamoDB and other big data tools such as Hive and HBase • As a Data Engineer, you will write and optimize SQL queries, including CTEs (Common Table Expressions) and window functions • Collaborate with cross-functional teams to ensure seamless data integration and delivery Requirements • Hands-on experience with Spark, specifically in building pipelines from scratch • Experience with streaming technologies, particularly Kafka (or AWS Kinesis as an alternative) • Solid understanding of DynamoDB in AWS for database management • Expertise in Scala for Spark development (not API development) • Advanced SQL skills, including the use of CTEs and window functions Preferred Skills • Experience working in a fully real-time data processing environment • Knowledge of additional big data technologies like Hive or HBase • Proficiency in AWS, with a strong focus on EMR • Familiarity with Spark on AWS EMR to optimize performance and scalability The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future. We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave. Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law. This job is not eligible for bonuses, incentives or commissions. Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status. By clicking “Apply Today” you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.