LLM Engineer

Insight Global is seeking an LLM Engineer to join our clients dynamic development team. This individual will enhance and expand a complex application, requiring strong communication skills and full-stack technical expertise. This role involves collaborating with global teams across multiple time zones (IST, UST, and other countries) and actively contributing to ongoing feature development. Key Responsibilities: • Enhance and expand a complex, dynamic application. • Collaborate with global teams across multiple time zones. • Actively contribute to ongoing feature development. Ideal Candidate: • Highly skilled Senior Python and LLM engineer. • Capable of executing both planning and hands-on technical work independently. • Effective collaborator with Product Owners and other stakeholders to solve complex problems. • Able to work cross-functionally to deliver impactful solutions. • Committed to continuously developing technical expertise and staying current with new technologies. • Passionate, intellectually curious, and driven to expand skills and knowledge. • Utilizes a data-driven approach to solve technical challenges and make informed decisions. • Applies systems-level thinking, integrating data science and engineering principles. • Takes full ownership of features and projects, delivering high-quality solutions independently. REQUIRED SKILLS AND EXPERIENCE Years of Experience: • 2+ years of experience developing and experimenting with LLMs • 8+ years of experience developing APIs with Python • Background: • Extensive experience with Python, particularly in building REST APIs using frameworks like FastAPI or Flask. • Expertise in microservices architecture and deployment in containerized environments (e.g., Docker, Kubernetes). • Strong knowledge in AI, machine learning, and natural language processing. • Proficient in working with key LLM model APIs (e.g., OpenAI, Anthropic) and LLM frameworks (e.g., LangChain, LlamaIndex). • Experience with MCP (Model Context Protocol). • Understanding of multi-agent systems and their applications in complex problem-solving scenarios. • Familiarity with RAG concepts and fundamentals (vectorDBs, semantic search, etc.). • Expertise in implementing RAG systems that combine knowledge bases with generative AI models. • Skilled in prompt writing for various use cases. • Experience with deploying generative solutions to production at scale, beyond POCs. • Proficiency with server-side events, event-driven architectures, and messaging systems. • Strong problem-solving skills and experience in debugging and optimizing backend systems. • Solid understanding of security best practices for backend systems, including authentication and data protection. • Can work IST and UST hours Compensation: $65/hr to $85/hr. Exact compensation may vary based on several factors, including skills, experience, and education. Employees in this role will enjoy a comprehensive benefits package starting on day one of employment, including options for medical, dental, and vision insurance. Eligibility to enroll in the 401(k) retirement plan begins after 90 days of employment. Additionally, employees in this role will have access to paid sick leave and other paid time off benefits as required under the applicable law of the worksite location.