Data Analyst

Position: Data Analyst I Type: Full-time position Compensation: $70-$85 per hour Location: Menlo Park, CA, USA Role Responsibilities • Manage data labeling workflows, including data enqueueing for labeling, labeling UI coordination, and extracting labels into datasets for the modeling team • Maintain large-scale, efficient, and reliable data processing pipelines, including data sourcing, running machine learning models to understand content, and using LLMs to clean data • Maintain a portfolio of datasets, ensuring governance of access, retention, and privacy compliance • Manually annotate training data based on modeling team requirements • Use LLMs and other models to annotate training data or evaluate generated content and apply auditing to assess model performance • Collaborate with engineers to identify and summarize model gaps based on evaluations • Identify necessary data, mine and prepare that data for subsequent model training iterations • Scale validated evaluation protocols with product development teams, including coordination and auditing • Audit and correct human-labeled data Requirements • Verbal and written communication skills, problem-solving skills, and interpersonal skills • Attention to detail and aptitude for experimental investigations • Ability to work independently and manage time effectively • Knowledge of Python and SQL • Knowledge of computer vision and generative models • Knowledge of data ETL workflows and pipelines • Experience using LLMs for data labeling-related work • Associate's degree or equivalent training in Computer Science, Electronic Engineering, Physics, Bioinformatics, or other STEM subjects • Prior industrial experience in software development and testing and/or research experience in human computer interaction • Previous experience at a major technology company preferred Application Process (Takes 20 Mins) • Upload resume • Interview (15 min) • Submit form