Senior/Staff Code Review Experts | $125/hr Remote

Position: Senior / Staff Code Review Experts Type: Hourly contract Compensation: $40–$125/hour Location: Remote Commitment: 10–40 hours/week Role Responsibilities • Review long-form transcripts between users and AI coding assistants. • Analyze AI logic, execution steps, and stated actions for accuracy and consistency. • Score transcripts using a structured 10-point evaluation rubric across multiple criteria. • Provide brief written justifications citing specific examples from the dialogue, when required. • Identify mismatches between AI claims and actions (e.g., stating tests were run when they were not). • Work independently to complete assigned transcript batches within defined turnaround windows. Requirements • Strong experience in software engineering, code review, testing, documentation, or related technical roles. • Ability to critically evaluate code reasoning, execution flow, and tool usage. • Comfort reviewing complex technical conversations and identifying logical inconsistencies. • Familiarity with Git workflows, testing frameworks, and debugging practices. • Proficiency in Python is helpful; familiarity with additional languages (JavaScript, TypeScript, Java, C++, Go, Ruby, Rust, Bash) is a plus. • High attention to detail and ability to follow structured evaluation guidelines. • Comfort working independently in a remote, asynchronous environment. Application Process (Takes 20 Min) • Upload resume • Receive rubric documentation and platform access if selected • Submit form