Business Data Analyst - AI

Responsibilities Kforce has a client that is seeking a Business Data Analyst - AI in Redmond, WA. Overview: We are seeking a Senior Business Data Analyst/Product Owner with product experience to support and optimize an AI-powered Brand Agent, a conversational experience designed to deliver accurate, up-to-date brand guidance to users. The ideal candidate is comfortable working in ambiguity, analyzing AI/chatbot behavior, identifying gaps or inaccuracies, and translating insights into actionable product improvements. This person will act as the day-to-day steward for the agent, helping monitor performance, validate updates, refine prompts/guardrails, and support ongoing AI optimization efforts. Key Responsibilities: • Analyze chatbot analytics, conversation logs, usage patterns, and behavioral trends to identify issues related to response quality, escalation, hallucination risk, or content drift • Investigate AI agent behavior and translate findings into recommendations, backlog items, and user stories • Support UAT and release validation for prompt updates, indexed content changes, ingestion rule updates, and response logic enhancements • Partner closely with AI engineers, product teams, and stakeholders to refine prompts, instructions, and agent behavior • Build/report on analytics and dashboards (Power BI or similar) to communicate insights, trends, risks, and improvement opportunities • Help define and monitor success metrics such as response accuracy, deflection, satisfaction, trust signals, and coverage • Support cross-functional communication between product, engineering, brand, and platform teams Requirements • Strong experience in Business Analysis, Product Analytics, Product Operations, or AI/Chatbot-focused roles • Experience working with conversational AI, chatbots, AI agents, Copilot/GenAI tools, or prompt-based systems • Strong analytical mindset with experience using SQL, Power BI/Tableau, dashboards, or manual data analysis to surface insights • Experience with Agile tools/processes including Azure DevOps, Jira, user stories, backlog management, and UAT Product, BA & Analytics Skills: • Strong experience as a Business/Data Analyst, Product Owner, or Product Manager in digital or platform-based products • Comfort operating in ambiguous environments and wearing multiple hats across analysis, validation, and execution • Experience working with analytics, dashboards, and usage data to inform product decisions (ideally with PBI and/or Adobe Analytics) • Ability to define success metrics and evaluate product performance over time AI/Bot/Platform Familiarity: • Experience working with chatbots, conversational interfaces, or AI assisted products (LLM experience a strong plus) • Understanding of prompt-based systems, guardrails, and content governance concepts • Familiarity with retrieval-based systems and indexed content is preferred Collaboration & Communication: • Strong stakeholder management and communication skills • Ability to translate data and technical behavior into clear business and brand implications • Comfortable partnering closely with engineers, designers, and brand teams • Strong ownership mindset with attention to detail and brand risk • Analytical and curious - driven to understand why the agent behaves the way it does • Pragmatic and execution-oriented, balancing insight with action • Comfortable operating in a live, evolving production environment Tools & Environment: • Power BI, Adobe Analytics or similar analytics and reporting tools • Experienced with querying, using SQL, Kusto, etc. The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future. We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave. Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law. This job is not eligible for bonuses, incentives or commissions. Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status. By clicking “Apply Today” you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.