Role: AI Data Trainer – Software Location: Remote US Duration: 6 months Contract About the Role: We are seeking experienced Software Engineers to develop and evaluate high-quality training data for our advanced AI models. As part of the Human Data Operations team, you will architect, analyze, and curate sophisticated datasets that facilitate the training of large language models. You will work closely with our research and engineering teams to ensure our AI systems demonstrate key traits like helpfulness, honesty, and harmlessness while maintaining technical excellence. Key Responsibilities: Design and implement data collection systems and pipelines for AI model training Architect and evaluate datasets for AI model training and benchmarking Provide in-depth analysis of model behaviors, performance, and interaction patterns Develop and curate complex code examples and solutions in multiple languages (Python, JavaScript, Rust, C/C++) Lead evaluation efforts of AI-generated code to enforce industry-leading standards Identify and analyze emerging trends, edge cases, and opportunities for improvement Develop advanced benchmarks and evaluation methodologies for AI capabilities Create technical documentation and evaluation frameworks Quality Standards: Maintain high levels of precision and consistency in data labeling and code evaluation Follow annotation guidelines and quality control processes Participate in regular quality audits and calibration exercises Document clear rationales for evaluation decisions Flag edge cases and provide detailed feedback on challenging examples Required Qualifications: Bachelor's degree or equivalent experience in Computer Science, Software Engineering, or related technical field 5+ years of professional software development experience Expert proficiency in multiple programming languages (Python, JavaScript, Rust) Strong full-stack development experience across frontend and backend systems Advanced understanding of data structures, algorithms, and system architecture Experience with ML/AI systems, preferably language models or related technologies Strong attention to detail with exceptional analytical and critical thinking skills Outstanding written and verbal communication abilities Proven ability to work independently while delivering high-quality output Other Qualifications: Master's degree in Computer Science, AI, or related field preferred Experience with AI language models, prompt engineering, or model evaluation Deep knowledge of machine learning frameworks and concepts Previous experience developing tooling for data labeling or annotation platforms Expertise in cloud infrastructure (AWS, GCP, Azure) and containerization (Docker, Kubernetes) Experience with distributed systems and high-performance computing Understanding of ethical considerations in AI development Job Type: Contract Pay: $120.00 - $125.00 per hour Schedule: Monday to Friday Education: Bachelor's (Required) Experience: Python programming: 5 years (Required) Rust programming: 5 years (Required) JavaScript programming: 5 years (Required) Full-stack development: 5 years (Required) data structures: 5 years (Required) algorithms: 5 years (Required) system architecture: 5 years (Required) ML/AI systems, preferably language models : 5 years (Required) prompt engineering: 5 years (Required) model evaluation: 5 years (Required) machine learning frameworks and concepts: 5 years (Required) data labeling or annotation platforms: 5 years (Required) cloud infrastructure and containerization : 5 years (Required) distributed systems and high-performance computing: 5 years (Required) Work Location: Remote