ExaTech Inc
AI QE Engineer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for an AI QE Engineer, remote, long-term contract in the healthcare industry. Key skills include Python, TypeScript, Azure AI Foundry, automation of RAG workflows, and Azure DevOps. Duration exceeds 6 months with competitive pay.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
Unknown
-
🗓️ - Date
November 21, 2025
🕒 - Duration
More than 6 months
-
🏝️ - Location
Remote
-
📄 - Contract
Unknown
-
🔒 - Security
Unknown
-
📍 - Location detailed
United States
-
🧠 - Skills detailed
#Python #TypeScript #Scripting #DevOps #Automation #Azure #Regression #Azure DevOps #Debugging #AI (Artificial Intelligence)
Role description
AI QE Engineer
Remote [Seattle, WA]
Long Term
Client: Healthcare
Job Description:
Builds automated evaluation pipelines for agents and RAG components. Implements scoring logic, telemetry integration, regression testing, and CI/CD-based evaluation workflows.
Skill set:
• Python/TypeScript for building evaluation utilities
• Azure AI Foundry Evaluations, RAGAS, DeepEval
• Automation of RAG/agent scoring workflows
• Azure Monitor, App Insights, Log Analytics telemetry integration
• Azure DevOps CI/CD regression frameworks
• Strong debugging and scripting skills
AI QE Engineer
Remote [Seattle, WA]
Long Term
Client: Healthcare
Job Description:
Builds automated evaluation pipelines for agents and RAG components. Implements scoring logic, telemetry integration, regression testing, and CI/CD-based evaluation workflows.
Skill set:
• Python/TypeScript for building evaluation utilities
• Azure AI Foundry Evaluations, RAGAS, DeepEval
• Automation of RAG/agent scoring workflows
• Azure Monitor, App Insights, Log Analytics telemetry integration
• Azure DevOps CI/CD regression frameworks
• Strong debugging and scripting skills
