Lead Data Engineer – Kafka Streaming & Spark

Job Title: Lead Data Engineer – Kafka Streaming & Spark Location: Remote Job Summary: We are seeking an expert in data engineering to help drive mission-critical projects focused on scalable data pipelines and real-time processing solutions. Our team values technical leadership and collaboration to deliver innovative analytics and intelligent applications across the organization. Responsibilities • Lead the design, optimization, and maintenance of large-scale distributed data platforms, streaming architectures, and high-performance ETL/ELT workflows. • Build scalable data pipelines and real-time processing solutions using technologies such as Hadoop, Spark, Python, Scala, Kafka, and Kafka Streams/KStream. • Present to clients and executives, ensuring effective communication and demonstrated executive presence while representing technical concepts. • Stay current with AI/data technologies, including vector databases, graph databases, and AI/ML platform integrations to support next-generation analytics. Required • Bachelor's degree in Computer Science, Information Systems, or a related field. • Proven experience as a Data Engineer or in a similar role. • Strong programming skills in languages such as Python, Java, or Scala. • Kafka experience (including Streams/KStream) is mandatory. About SSI People: With over 26 years of industry experience, SSi People has built its reputation and expertise on putting people first. Everything we do works toward delivering exceptional experience for our consultants, our clients, and our internal team. Through a genuine commitment to people in everything we do. We have developed refined processes and a stellar internal team to deliver talent quickly. More importantly, we focus on building long-term relationships, not transactions. Putting people first is just what we do well. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from SSi People and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: SSi People Privacy Policy