LLM Engineer/GenAI Engineer

Akkodis is seeking a LLM Engineer/GenAI Engineer for a Contract job with a client in Charlotte, NC(Hybrid). Ideally looking for applicants with a solid background in the financial services industry. Rate Range: $60/hour to $65/hour; The rate may be negotiable based on experience, education, geographic location, and other factors. Job Description: LLMs & Inference: • Experience with major LLMs, specifically Llama 3, Mistral, and possibly "Quinn." • Direct experience with VLLM (an inference engine) is a perfect match, as it's the core technology they are using to handle batched requests. • Experience with Nvidia Triton is a "big bonus" and a key part of their model serving infrastructure. Core Development: • Python: A mandatory skill. They are using Python 3.12, but experience with 3.10 and above is sufficient. • Web Frameworks: Knowledge of Flask or FastAPI is required, as they are using a Python endpoint to host the LLM. • Java: A "secondary preferred" skill, used to create the REST service that interacts with the front-end UI. Database & Data Management: • Vector Databases: Experience with Redis and other vector databases is essential for the RAG component. SQL: Required. • RAG Skills: The candidate needs to understand how to handle the business-side parameters from the product team and push back if they are technically unfeasible. This shows they need to be a critical thinker, not just a code-jockey. Infrastructure & Operations (MLOps) • Containers & Orchestration: Knowledge of containers and OpenShift (a Kubernetes platform) for CI/CD. CI/CD Tools: Experience with XLR and Datical for pipeline deployments is required. • Hardware: A solid understanding of GPUs is necessary, as they are the most critical and challenging component of their infrastructure. • Agile: The team uses Agile methodology. If you are interested in this role, then please click APPLY NOW. For other opportunities available at Akkodis, or any questions, feel free to contact me at dileep.kumar2@akkodisgroup.com. Equal Opportunity Employer/Veterans/Disabled Benefit offerings available for our associates include medical, dental, vision, life insurance, short-term disability, additional voluntary benefits, an EAP program, commuter benefits, and a 401K plan. Our benefit offerings provide employees the flexibility to choose the type of coverage that meets their individual needs. In addition, our associates may be eligible for paid leave including Paid Sick Leave or any other paid leave required by Federal, State, or local law, as well as Holiday pay where applicable. Disclaimer: These benefit offerings do not apply to client-recruited jobs and jobs that are direct hires to a client. To read our Candidate Privacy Information Statement, which explains how we will use your information, please visit https://www.akkodis.com/en/privacy-policy. The Company will consider qualified applicants with arrest and conviction records in accordance with federal, state, and local laws and/or security clearance requirements, including, as applicable: · The California Fair Chance Act · Los Angeles City Fair Chance Ordinance · Los Angeles County Fair Chance Ordinance for Employers · San Francisco Fair Chance Ordinance