AI Prompt Engineer

Ascendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise clients. Headquartered in New Jersey, our workforce of 6,000+ Ascenders delivers solutions from around the globe. Ascendion is built differently to engineer the next. Ascendion | Engineering to elevate life We have a culture built on opportunity, inclusion, and a spirit of partnership. Come, change the world with us: • Build the coolest tech for world’s leading brands • Solve complex problems - and learn new skills • Experience the power of transforming digital engineering for Fortune 500 clients • Master your craft with leading training programs and hands-on experience Experience a community of change makers! Join a culture of high-performing innovators with endless ideas and a passion for tech. Our culture is the fabric of our company, and it is what makes us unique and diverse. The way we share ideas, learning, experiences, successes, and joy allows everyone to be their best at Ascendion. Job Role: This role supports Copilot experiences across Word, Excel, and PowerPoint, with a primary focus on LLM prompt evaluation and automation. The team builds and operates the middle services that ensure Copilot delivers accurate, grounded, and high-quality responses at scale. The ideal candidate has hands-on experience with LLM evaluation, synthetic data creation, and Python-based automation, and is comfortable working on production systems. Key Responsibilities • Evaluate and test Copilot prompts and AI responses across Office applications • Perform manual and automated testing of LLM outputs • Set up synthetic tenant data, test accounts, and grounding data • Create and maintain evaluation test datasets as configuration-as-code • Write Python or C# code to support evaluation and automation • Integrate AI quality checks into build and deployment pipelines • Analyze evaluation results and collaborate with partner teams to improve AI quality Qualifications • Bachelor’s degree in Computer Science or a related technical field • 2–4 years of relevant experience • Strong foundation in computer science and software development • Experience with LLM prompt engineering or evaluation • Strong Python experience (highly preferred) • Experience with testing, validation, or automation of software systems Typical Day Supporting evaluation for Office services by creating and running LLM evaluation test sets, validating AI responses, automating quality checks, maintaining test datasets, and collaborating with partner teams to improve Copilot behavior. If this role aligns with your background, please share your updated resume, and we can discuss next steps. Salary Range: $145,600-$166,400 Annually Factors that may affect pay within this range may include geography/market, skills, education, experience and other qualifications of the successful candidate. Benefits: The Company offers the following benefits for this position, subject to applicable eligibility requirements: [medical insurance] [dental insurance] [vision insurance] [401(k) retirement plan] [long-term disability insurance] [short-term disability insurance] [5 personal day accrued each calendar year. The Paid time off benefits meet the paid sick and safe time laws that pertains to the City/ State] [10-15 day of paid vacation time] [6 paid holidays and 1 floating holiday per calendar year] [Ascendion Learning Management System] Want to change the world? Let us know. Tell us about your experiences, education, and ambitions. Bring your knowledge, unique viewpoint, and creativity to the table. Let’s talk!