Machine Learning Specialist

About the Role Insight Global is seeking a LLM/ML Specialist to join our client, a leading telecommunications company, in Englewood, CO. In this role, you will play a key part in advancing internal enterprise GPT solutions by evaluating and benchmarking large language models (LLMs), improving their performance, and assessing new model integrations within a proprietary evaluation platform. You will work closely with statisticians and engineers to enhance backend capabilities and introduce innovative features that drive continuous improvement. This position offers an exciting opportunity to contribute to cutting-edge AI initiatives and help shape the future of enterprise technology. Key Responsibilities • Evaluate LLM performance using internal tools and proprietary evaluation platforms. • Conduct comparative analysis of different models and recommend improvements. • Work closely with the backend team to assess new additions and enhancements. • Collaborate with statisticians and data scientists to design robust evaluation metrics. • Document findings and provide actionable insights for model optimization. Required Qualifications • Bachelor’s degree in Computer Science, Statistics, Data Science, or related field. • 2+ years of hands-on experience working with LLMs, including evaluation and integration techniques for enhanced information retrieval and generation. • Familiarity with enterprise AI tools and evaluation frameworks. • Strong programming skills in Python, R, SQL. • Ability to analyze and interpret model performance metrics. Preferred Background • Experience in statistical modeling or data analysis. • Familiarity with Scala and Spark. • Strong problem-solving and communication skills. • AWS knowledge