Data Scientist

Role Overview Mercor is hiring highly skilled Data Science experts to join a significant research collaboration with one of the world's leading AI labs. The role involves contributing to the development of advanced AI agents by creating evaluations for exploratory data analysis. You'll help train, test, and calibrate these AI systems through identifying patterns, trends and associations in datasets and visualizing the results using Python. Key Responsibilities • Evaluate data analysis produced by AI systems for quality and accuracy • Understand dataset context and execute statistical analysis & modeling for both vague and specific prompts • Design prompts and create detailed rubrics for fine-grained reward modeling and evaluation. • Produce gold-standard responses including data visualizations, explanatory text, and executable Python code (ipynb file). • Clearly translate data scientist reasoning, decision-making, and expertise into gradable criterion for AI agents Ideal Qualifications • Bachelor’s, Master’s, or PhD degree in Data science or ML • 2+ years of industry experience in a data science role • Proficiency in Python data science libraries (e.g., pandas, numpy, scikit-learn). • Solid understanding of data analysis techniques, statistical modeling, or machine learning principles. Experience in identifying patterns, trends, and associations within complex datasets, as well as visualizing results to communicate insights, is highly valued. • Excellent analytical and data-driven writing skills. The ability to distill complex data-driven insights into clear, concise, and compelling analyses is crucial. Project Timeline • Start Date: Immediate • Duration: 5-6 weeks • Commitment: Part-time, ~20 hours/week (flexible) • Schedule: Fully remote and asynchronous Compensation & Contract • The hourly rate for the role is competitive and based on experience ($70-100/hr) • Top performers on the project may be eligible to receive a bonus-based incentive in the range of $20-$50/hr on top of their pay rate. • Status: Independent Contractor • Payment: Weekly via Stripe Connect Application & Onboarding Process 1. Submit Resume 1. AI Interview A short, 25-minute technical interview which will assess conceptual project-based questions and a Google Co-Lab data analysis exercise 1. Work trial • 6 lessons on rubric-writing fundamentals • Short comprehension quizzes (non-evaluative) • A final quiz and 1–2 hour prompt-writing exercise • Total time: ~3 hours • Total pay: $180 About Mercor Mercor specializes in recruiting experts for top AI labs and is based in San Francisco, CA. Our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey. Apply today and leverage your data science expertise to advance cutting-edge AI models! We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.