Data Scientist

We are seeking a skilled Product Data Scientist with 3-5+ years of experience to join our team and drive data-informed decision-making within our Generative AI services. The ideal candidate will have a strong analytical background, proficient in SQL and Python, along with expertise in machine learning and statistics. You will play a pivotal role in defining success metrics, analyzing product performance, and translating business needs into actionable data insights. Key Responsibilities: • Metric Definition and Tracking: Define and track success metrics across Generative AI services to measure performance and impact. • Data Problem Translation: Translate ambiguous business needs into measurable data problems, ensuring alignment between product goals and data analysis. • Collaboration: Partner with engineers and data scientists to define user workflows, evaluation sets, and queries that support product development and refinement. • Model Analysis: Analyze model failures, ambiguities, and user logs to provide insights that guide improvements in prompts and retrievers. • A/B Testing: Design and implement A/B tests to evaluate product features, analyze results, and inform product decisions. • Communication: Effectively communicate findings and recommendations to both technical and non-technical stakeholders, fostering a data-driven culture within the organization. • Product Sense: Utilize strong product sense to understand user needs and how data insights can enhance product offerings. Required Skills: • Proficient in SQL and Python for data manipulation and analysis. • Strong understanding of machine learning concepts and statistical analysis. • Experience with experimentation methodologies, including metric definition and A/B testing. • Excellent communication skills with the ability to convey complex data insights to diverse audiences. • Familiarity with Large Language Models (LLMs) and their applications in product development. Qualifications: • 3-5+ years of experience in data science, product analytics, or a related field. • Bachelor’s degree in Data Science, Statistics, Computer Science, or a related discipline (or equivalent experience). • Strong analytical problem-solving skills and attention to detail. • Ability to work collaboratively in a fast-paced, cross-functional environment.