Data Scientist (Python ,Pyspark)

Smartedge’s Client is looking for an individual to help with their Data Scientist (Python ,Pyspark) @ Remote Working Key area: We are seeking an experienced Senior Data Scientist with strong expertise in Python, PySpark, advanced analytics, and agentic AI frameworks. The role focuses on building scalable, production-grade analytics and AI systems, leveraging LLMs, RAG architectures, and agent-based workflows to solve complex business problems and enhance decision intelligence. Responsibilities: • Design, develop, and deploy machine learning and advanced analytics models at scale Analyze large, complex datasets using Python and PySpark in distributed environments • Build end-to-end data and analytics pipelines, including data ingestion, feature engineering, model training, validation, and deployment • Develop agentic AI solutions to automate workflows, orchestrate tasks, and augment human decision-making • Apply statistical analysis, ML techniques, and pattern recognition to uncover insights and emerging patterns Design and implement LLM-powered solutions, including: • Retrieval-Augmented Generation (RAG) pipelines • Vector databases and embedding-based retrieval • Prompt orchestration and agent collaboration • Build and maintain scalable systems, APIs, and microservices to support analytics and agent-based solutions in production • Collaborate with business, product, and engineering teams to translate requirements into end-to-end AI and analytics workflows • Monitor model and agent performance, conduct tuning, and ensure robustness, scalability, and maintainability • Document models, agentic workflows, assumptions, and system designs for knowledge sharing and governance • Stay current with advancements in data science, LLMs, and agentic AI frameworks If this sounds like a role you would be interested in or if you know someone in this field. Connect with me or email me at sirisha.p@smartedgesolutions.co.uk Alternatively, you can call me on Tel: +44(0)203 500 2108.