AI Multimedia Generation Product Evaluator

Job Title: AI Multimedia Generation Product Evaluator Location: Remote - West coast preferred Our client's Multimedia Generation team focuses on fine-tuning and productionizing media foundational models in the generative AI space. The team includes applied scientists working across video generation, image editing, and evaluation metrics. This role supports them by ensuring consistency, accuracy, and scalability in evaluation processes. We are seeking a highly motivated and detail-oriented individual to join as an AI Multimedia Generation Product Evaluator. You will be responsible for evaluating AI multimedia generation products (images and videos), managing evaluation datasets, and ensuring offline metrics align with user engagement outcomes. 2+ years of relevant experience in data handling, evaluation, or multimedia AI workflows Key Responsibilities: Support model evaluations by setting up tasks, running inference, and managing evaluation queues Audit vendor annotations to maintain quality standards Build and maintain tools for evaluation datasets Collaborate with model development teams to conduct offline evaluations and automate pipelines Manage multimedia data workflows (images/videos) and audit evaluation results Ensure consistency and reliability in evaluation metrics through programming and auditing tasks Requirements (Must-Have): 1–2 years of experience with Python, especially for image/video data and JSON Experience with SQL and handling large datasets Familiarity with the image and video domain Ability to adapt to new code Strong attention to detail and flexibility in working hours Nice-to-Have Skills: Hands-on experience with generative AI tools for image/video Basic shell scripting knowledge Education/Experience: Bachelor’s degree preferred, not required