AI Engineer - Enterprise AI Agents & Microsoft Fabric Integration

AI Engineer - Enterprise AI Agents & Microsoft Fabric Integration (Contract-to-Hire) Position Overview Join our cutting-edge AI initiative to build intelligent agents that seamlessly integrate with our Microsoft Fabric Data Lake as the central data hub, connecting structured data from Infor M3 ERP, Salesforce CRM, Anaplan planning platform, Uncountable PLM, and Freshworks helpdesk alongside unstructured data from SharePoint, file systems, and document repositories. We're seeking an AI Specialist to architect next-generation agents that understand and interact with complex business processes by leveraging our unified data architecture. This role involves creating sophisticated RAG systems, vector databases, and multi-modal AI capabilities that transform how our organization leverages both structured enterprise data and unstructured content across all touchpoints - from manufacturing and supply chain to customer relationships and product lifecycle management. Key Responsibilities AI Agent Architecture Design agents connecting primarily to Microsoft Fabric Data Lake as central data repositoryAccess structured data from Infor M3 ERP, Salesforce CRM, Anaplan, Uncountable PLM, and Freshworks stored in FabricProcess unstructured data from SharePoint, file systems, and document repositories outside FabricImplement RAG systems using FAISS, Pinecone, Weaviate, ChromaDB for hybrid structured/unstructured searchBuild natural language interfaces for querying both lakehouse tables and external document sourcesCreate unified data processing pipelines combining Fabric data with external unstructured contentSystem Integration & Data Processing Connect to Microsoft Fabric Data Lake using Delta Lake format and SQL endpointsAccess structured business data from all enterprise systems centralized in Fabric lakehouseIntegrate unstructured data sources: SharePoint documents, file servers, email archivesProcess PDFs, Word docs, Excel files, images, and multimedia content from external systemsImplement real-time data streaming from Fabric Event Streams and external file monitoringBuild hybrid search capabilities combining Fabric structured data with external document vectorsMulti-Platform AI Development Utilize OpenAI GPT-4, Anthropic Claude, Google Gemini, Meta LLaMA, and Cohere APIsImplement model routing and fallback strategies across AI providersBuild agents using LangChain, LlamaIndex, AutoGen, CrewAI frameworksDeploy containerized solutions with Docker/Kubernetes for scalabilityRequired Skills Core Technical Expertise 5+ years AI/ML development with enterprise data integration3+ years Microsoft Fabric, Azure Data Lake, or similar lakehouse platformsAdvanced Python with AI/ML libraries (LangChain, LlamaIndex, Transformers)SQL/KQL proficiency for complex data querying and analysisVector database expertise (FAISS, Pinecone, Weaviate, ChromaDB)RAG system architecture and implementation at enterprise scaleAI & Machine Learning Multi-LLM integration (OpenAI, Anthropic, Google, Cohere APIs)Prompt engineering and advanced AI agent orchestrationEmbedding models and semantic search optimizationFine-tuning experience with domain-specific modelsAI safety and governance implementationEnterprise Integration Microsoft Fabric Data Lake and Delta Lake architectureSharePoint API integration and document processingRESTful API design and microservices architectureReal-time data streaming and event-driven systemsEnterprise security and authentication (OAuth, SSO)Development & Deployment Full-stack development (React/Angular frontend, FastAPI/Node.js backend)Cloud platforms (Azure preferred, AWS/GCP experience valued)Containerization (Docker, Kubernetes) and DevOps practicesCI/CD pipelines and automated testing frameworksAI Platform Experience Multiple LLM providers (OpenAI, Anthropic, Google, Cohere) for text and multimodal processingVector databases (FAISS, Pinecone, Weaviate, ChromaDB) for semantic search across business dataDocument processing tools (PyPDF2, PDFplumber, Tesseract OCR, Azure Document Intelligence)Integration frameworks for Infor M3, Salesforce, Anaplan, Uncountable PLM, and FreshworksFrontend frameworks (React, Angular, Vue.js) and backend (FastAPI, Django, Node.js)Data Platform Knowledge Microsoft Fabric Data Lake, Delta Lake, and lakehouse architecture expertiseStructured data access from Fabric tables containing ERP, CRM, and planning dataSharePoint integration for document libraries and collaborative contentFile system monitoring and processing for external unstructured data sourcesAzure Data Factory and Fabric Data Factory for ETL/ELT pipelinesPower BI integration for data visualization and reporting within Fabric ecosystemPreferred Qualifications & Certifications Microsoft Fabric Analytics Engineer or Azure AI Engineer Associate certificationBachelor's/Master's degree in Computer Science, AI/ML, or related fieldEnterprise AI implementation experience in manufacturing or financeApache Spark and big data processing experiencePower BI development and advanced analyticsAgile/Scrum methodology and cross-functional team collaborationTechnical leadership and mentoring experienceTechnology Stack AI/ML: OpenAI, Anthropic Claude, Google Gemini, Hugging Face, LangChain, LlamaIndex Vector DB: FAISS, Pinecone, Weaviate, ChromaDB, Qdrant Data Platform: Microsoft Fabric Data Lake, Delta Lake, Azure Data Factory, Power BI Structured Data: ERP, CRM, PLM, helpdesk data centralized in Fabric lakehouse Unstructured Sources: SharePoint, file systems, document repositories, email archives Integration: Fabric APIs, REST APIs, GraphQL, webhooks, Microsoft Graph API Development: Python, JavaScript, KQL, SQL, React, FastAPI, Docker, Kubernetes Job Type: Contract Pay: $101,471.54 - $122,202.28 per year Work Location: Remote