LLM Specialist (Generative AI)

Job Title: LLM Specialist (Generative AI) Location: Remote Employment Type: Full-Time Contract (W2/1099) About Us Conglomerate IT is a certified and a pioneer in providing premium end-to-end Global Workforce Solutions and IT Services to diverse clients across various domains. Visit us at http://www.conglomerateit.com Our mission is to establish global cross culture human connections that further the careers of our employees and strengthen the businesses of our clients. We are driven to use the power of global network to connect business with the right people without bias. We provide Global Workforce Solutions with affability. Job Summary Key Responsibilities: • Lead end-to-end technical assessments of GenAI products—focusing on safety, neutrality & fairness • Design and implement LLM evaluation frameworks for performance and accuracy • Analyze model outputs (accuracy, coherence, ethical considerations, etc.) • Develop automated testing pipelines for efficient model evaluation • Generate data-driven insights to guide product iterations • Collaborate with ML engineers, data scientists, and product managers • Identify model performance gaps and recommend improvements • Stay updated on the latest in NLP, LLMs, and evaluation methodologies • Present findings through detailed reports and presentations • Ensure ethical AI practices: fairness, bias detection, compliance Qualifications • Bachelor's or Master’s in Computer Science, ML, Data Science, or related field (PhD preferred) • Strong NLP and ML foundation • Hands-on experience with LLMs (GPT, BERT, LLaMA, etc.) • Proficiency in Python and ML libraries (PyTorch, TensorFlow, Hugging Face) • Experience designing LLM evaluation metrics (BLEU, ROUGE, perplexity, etc.) • Familiarity with AI ethics and responsible AI practices • Strong analytical and data interpretation skills • Excellent written and verbal communication Preferred Skills • Experience working with LLM APIs and fine-tuning models • Knowledge of A/B testing and user feedback loops • Prompt engineering and evaluation techniques • Data visualization skills for presenting evaluation results Founded in 2014, ConglomerateIT is a global leader in delivering innovative IT solutions and services. Headquartered in the USA with a presence in the UK, Canada, and India, we specialize in offering industry-leading expertise and cutting-edge products that help our clients maximize their technological investments. Our focus on best-in-class solutions, a highly knowledgeable team, and proactive talent mapping ensure we remain at the forefront of the IT industry. ConglomerateIT is driven by our Center for Excellence and Innovation, an initiative dedicated to keeping us ahead in a rapidly evolving technology landscape. We understand that building strong relationships is key to our success, and this commitment has enabled us to partner with Fortune 500 companies and leading system integrators worldwide. Our ability to provide local talent on a global scale ensures that we can meet the contingent project requirements of our clients efficiently and effectively. As a strategic extension of ConglomerateIT, Conglomerate Healthcare specializes in international healthcare recruitment. Leveraging our global reach and deep industry expertise, we connect healthcare organizations with top-tier talent, including Physicians, Nurses, and Medical Technicians. Our carefully curated talent pool includes Western-qualified Physicians, licensed Nurses, and highly skilled Medical Technicians who bring excellence and expertise to healthcare facilities worldwide. Key Healthcare Services • Physicians Recruitment: We connect healthcare facilities with Western-qualified physicians who deliver exceptional expertise and care. • Nurses Recruitment: We identify and place highly qualified licensed nurses who meet the highest standards of care. • Medical Technician Recruitment: We provide healthcare institutions with access to certified and skilled medical technicians who support critical healthcare operations. Conglomerate Healthcare operates as an integral part of ConglomerateIT's mission to deliver excellence across multiple sectors, further solidifying our position as a global leader in recruitment and IT solutions.