Sr. Data Scientist

Job Title: Sr. Data Scientist Location: Hybrid – Plano, TX (3 days in office) Contract About Smart IT Frame: At Smart IT Frame, we connect top talent with leading organizations across the USA. With over a decade of staffing excellence, we specialize in IT, healthcare, and professional roles, empowering both clients and candidates to grow together. Job Summary As a Senior Consultant, you will leverage your extensive experience in Spark SQL, PySpark, Spark Scala, and Databricks to drive innovative solutions in AI and Machine Learning. You will collaborate with cross-functional teams to enhance data-driven decision-making processes, ensuring the seamless integration of advanced technologies within the organization. Your expertise will contribute to optimizing workflows and improving operational efficiency. Responsibilities • Lead the design and implementation of advanced data processing solutions using Spark SQL and PySpark to enhance data analytics capabilities. • Oversee the development of scalable machine learning models utilizing Spark ML and Databricks to drive predictive insights. • Provide technical expertise in Spark Scala and Databricks Delta Lake to ensure efficient data storage and retrieval processes. • Collaborate with cross-functional teams to integrate AI and ML concepts into existing systems, promoting innovation and efficiency. • Develop and maintain Databricks workflows to streamline data processing and improve operational efficiency. • Implement AWS Machine Learning solutions to leverage cloud-based resources for scalable AI applications. • Utilize Generative AI techniques to create innovative solutions that address complex business challenges. • Optimize MLOps to ensure the reliability and scalability of deployed models. • Drive the adoption of AI/ML in AWS, GCP, and Azure environments to enhance the organization’s technological capabilities. • Provide insights and recommendations based on data analysis to support strategic decision-making processes. • Ensure compliance with industry standards and best practices in AI and machine learning implementations. • Collaborate with stakeholders to identify opportunities for leveraging AI and ML to improve business outcomes. • Monitor and evaluate the performance of machine learning models to ensure accuracy and effectiveness. Qualifications • Demonstrated expertise in Spark SQL, PySpark, Spark Scala, and Spark ML. • Proficiency in Databricks, including Databricks SQL, Delta Lake, and Workflows. • Experience in Machine Learning and AWS Machine Learning. • Familiarity with Generative AI and AI & ML concepts. • Knowledge of AI/ML in AWS, GCP, and Azure environments. • Strong analytical skills with the ability to provide actionable insights. • Excellent collaboration and communication skills to work effectively with cross-functional teams. Required Skills • Spark SQL • PySpark • Spark Scala • Databricks • Databricks Workflows • Databricks Delta Lake • Databricks SQL • Spark ML • Machine Learning • AI & ML Concepts • AWS Machine Learning • MLOps • Generative AI • Spark (Scala & PySpark) • AI/ML in AWS, GCP, and Azure 📩 Apply today or share profiles at Gayathri.s@smartitframe.com