Expert Rater – AI Model Evaluation & Code Quality

We’re expanding our technical evaluation team and looking for Expert Raters to review AI-generated code, machine learning outputs, and technical reasoning. This contract role is ideal for software engineers, ML practitioners, and data professionals who enjoy code review, debugging, and working with advanced AI systems. Responsibilities: • Review AI-generated code and ML model outputs • Identify errors, inefficiencies, and deviations from best practices • Annotate and label code/documentation • Compare model outputs and rank quality • Validate datasets and ensure technical accuracy Requirements: • Strong background in Software Engineering, Computer Science, ML/AI • Expert-level Python (must-have) • Proficiency in at least one: JavaScript, TypeScript, Node.js, C/C++, Go, Rust, Shell, Ruby, PHP, Swift, Kotlin • Familiarity with ML/DL frameworks (TensorFlow, PyTorch, JAX, etc.) • Knowledge of NLP, CV, RL, or LLM-based systems • Experience with APIs, web scraping, or web development • Strong analytical and written communication skills Preferred: • Prior experience in code review, annotations, or LLM evaluation Employment: Contract, Remote (US-based applicants preferred) For more information, please share your resume and hourly rate at sagar.gupta@truelancer.com