Product Analyst III (AI Context Designer)

Product Analyst III (AI Context Designer) W2 Contract Pay Rate: $38.07 - $48.07 per hour Location: Carrollton, TX - Onsite Role Job Summary: We are seeking a highly analytical and detail-oriented Product Analyst to act as a "Context Designer" for the voice AI and prompt-driven initiatives. While this is a non-engineering role, it requires a strong technical bent. You will focus on driving use case context development by drafting natural language prompts, configuring conversational flows, and refining business requirements across CDL/Sales, Servicing, and Production/MFD. Duties and Responsibilities: • Act as a "Context Designer" to write, refine, and configure natural language prompts and conversational flows based on defined business logic. • Collaborate daily with sales, servicing, and fulfillment teams to capture, define, and negotiate business requirements for AI agent interactions. • Review and curate operational PDFs and documentation to provide a verified "Source of Truth" for the RAG Vector Database. • Execute A/B tests on various prompt configurations and analyze the resulting data to improve accuracy, tone, and resolution rates. • Assist the Product Owner in defining and documenting the "Golden Dataset" of test scenarios to support automated AI evaluations. • Work alongside platform engineers who manage the underlying technical architecture within the AWS tech stack to ensure successful API handshakes and platform functionality. Requirements and Qualifications: • 3-5 years of experience as a Product Analyst, Business Analyst, or similar role (targeting Analyst III level). • A non-engineer with a strong "technical bent" and the ability to quickly grasp Generative AI concepts (e.g., RAG, LLM orchestration, prompt tuning). Desired Skills and Experience Prompt Engineering, AI Context Design, Conversational AI, Voice AI, Natural Language Prompt Development, Conversational Flow Configuration, Generative AI, Retrieval-Augmented Generation (RAG), Large Language Models (LLMs), LLM Orchestration, Prompt Tuning, Vector Databases, Knowledge Base Curation, Business Requirements Gathering, Business Analysis, Product Analysis, Use Case Development, A/B Testing, Data Analysis, Golden Dataset Development, AI Evaluation, Test Scenario Documentation, API Integrations, AWS, Cross-Functional Collaboration, Sales, Mortgage Servicing, Fulfillment Bayside Solutions, Inc. is not able to sponsor any candidates at this time. Additionally, candidates for this position must qualify as a W2 candidate. Bayside Solutions, Inc. may collect your personal information during the position application process. Please reference Bayside Solutions, Inc.'s CCPA Privacy Policy at www.baysidesolutions.com.