Data Quality and AI Tooling Specialist

Job Title: Data Quality and AI Tooling Specialist Location: Remote (USA Only) Employment Type: Contract Experience Required: Min 3+ Years Engagement Duration: 10 Months Work Commitment: • Minimum 30 hours per week (option of 30 hrs/week or 40 hrs/week) • At least 4 hours per day • Mandatory 4 hours overlap with PST timezone Required Skills: • 3+ years of relevant experience • Strong experience with Google Colab • Proficiency in Python • High attention to detail and data quality Role Overview: We are seeking a detail-oriented LLM Data Quality and Tooling Specialist to support large language model training through high-quality data validation and lightweight tooling solutions. Key Responsibilities: • Perform quality checks (QC) on diverse generated samples, including: • Simple Q&A pairs • Rubric-based datasets • Model evaluations • Agentic data • Review data across both STEM and humanities domains • Create clear, practical QC guidelines to enable internal teams to review their own samples effectively • Conduct hands-on QC work to ensure accuracy, consistency, and usability of training data • Design and develop lightweight Python-based tools, primarily using Google Colab, to help domain experts efficiently review and validate samples • Translate QC requirements into practical workflows and utilities • Communicate findings and guidelines clearly and professionally Perks & Benefits: • Fully remote work environment • Opportunity to work on cutting-edge AI and LLM projects • Potential for contract extension based on performance and project requirements