Systems Design Experts | Remote

Position: Software Engineering, Data Science, and Systems Design Experts Type: Hourly contract Compensation: $60–$100/hour Location: Remote Commitment: 10–40 hours/week Role Responsibilities • Evaluate LLM-generated responses to software engineering, data science, and systems design questions. • Validate technical accuracy by reviewing reasoning, explanations, and generated code. • Execute and test code to confirm correctness and expected outputs. • Identify logical flaws, inefficiencies, edge cases, and misleading explanations. • Assess code quality, readability, algorithmic soundness, and system design choices. • Apply structured evaluation frameworks, benchmarks, and taxonomies. • Provide clear, actionable annotations to improve AI model performance. • Ensure outputs align with real-world engineering best practices and conversational standards. Requirements • Strong academic background in computer science or a closely related discipline. • Strong professional background in software engineering, data science, or systems design. • Expertise in at least two programming languages (e.g., Python, Java, C++, JavaScript, Go, Rust, SQL, Bash). • Strong problem-solving ability and comfort evaluating complex technical reasoning. • Excellent written communication skills and attention to detail. • Ability to work independently in a fully remote environment. Application Process (Takes 20 Mins) • Upload resume • Interview (15 min) • Submit form