Machine Learning Engineer

Role: Lip Sync Engineer – Real-Time Avatar Synchronization Duration: long term contract Location: Remote About the Role We’re seeking a technically skilled Lip Sync Engineer to bring our avatars to life with natural, real-time speech synchronization. This role focuses on building systems that seamlessly integrate text, audio, and facial animation—ensuring avatars speak convincingly across languages and platforms. You’ll work at the intersection of AI, animation, and engineering to deliver lip-sync generation in under 3 seconds, enabling immersive experiences for clients and partners. The Lip Sync Engineer role focuses on developing real-time, high-accuracy lip synchronization systems for digital avatars, enabling natural speech and facial movement across multiple languages and platforms. The candidate will work at the intersection of AI, animation, and engineering to optimize performance and integration. This position emphasizes technical fluency and collaboration rather than pure development, aiming to deliver seamless, immersive user experiences. Responsibilities • Strong technical knowledge of lip-sync technologies, phoneme/viseme mapping, and facial animation integration. • Experience working with multi-language speech synchronization and ensuring phoneme accuracy across diverse languages. • Proficiency in scripting and system optimization using Python, C++, or related languages to achieve 1–3 second lip-sync generation times. • Familiarity with ML/AI frameworks applied to speech-to-animation synchronization. • Ability to design and optimize pipelines for real-time face animation and voice integration. • Demonstrable experience in system performance tuning to meet speed and accuracy benchmarks. • Experience liaising with product, creative, or client teams to align technical outputs with user experience goals. • Knowledge of avatar expression and emotion blending techniques. • Familiarity with multilingual phoneme/viseme mapping challenges and solutions. • Experience with animation/visualization pipelines including image, audio, and video input formats. • Certifications or coursework in AI/Machine Learning applied to animation or speech processing. • Exposure to cloud-based or distributed systems supporting real-time avatars. Qualifications Strong technical knowledge of lip-sync technologies, phoneme/viseme mapping, and facial animation integration. Required Skills • Strong technical knowledge of lip-sync technologies, phoneme/viseme mapping, and facial animation integration. • Experience working with multi-language speech synchronization and ensuring phoneme accuracy across diverse languages. • Proficiency in scripting and system optimization using Python, C++, or related languages to achieve 1–3 second lip-sync generation times. • Familiarity with ML/AI frameworks applied to speech-to-animation synchronization. • Ability to design and optimize pipelines for real-time face animation and voice integration. • Demonstrable experience in system performance tuning to meet speed and accuracy benchmarks. • Experience liaising with product, creative, or client teams to align technical outputs with user experience goals. • Knowledge of avatar expression and emotion blending techniques. • Familiarity with multilingual phoneme/viseme mapping challenges and solutions. • Experience with animation/visualization pipelines including image, audio, and video input formats. • Certifications or coursework in AI/Machine Learning applied to animation or speech processing. • Exposure to cloud-based or distributed systems supporting real-time avatars. Preferred Skills • Exposure to cloud-based or distributed systems supporting real-time avatars.