Hi, Hope you doing well, Pl let me know If you are interested in below position Job Title: - Senior Data Engineer No C2C Only W2 Preferred Qualifications • Experience with Microsoft Azure and its data services. • Knowledge of Python and other programming languages. Position Overview We are seeking a highly motivated Microsoft Focused Data Engineer to join our dynamic team. If you have a strong foundation in data engineering and a passion for leveraging advanced technologies to drive innovation, we want to hear from you. As a Data Engineer, you will play a crucial role in our data development and AI initiatives, contributing to the design, implementation, and management of our data infrastructure. Responsibilities • Design, develop, and maintain scalable data pipelines using PySpark, Spark familiar with Databricks, ADF and Fabric. • Implement and manage data lakes to ensure efficient and secure data storage, processing, and retrieval. Understanding of the concepts of Medallion Architecture and the data in the cloud. • Collaborate with cross-functional teams to gather and analyze data requirements, ensuring the delivery of high-quality data solutions. • Optimize and enhance existing data pipelines to improve performance and reliability. • Collaborate with Enterprise Data Management to develop and enforce best practices for data management, including data governance, data quality, and data security within the data pipelines. • Stay up-to-date with the latest advancements in data engineering and AI development, continuously seeking opportunities to learn and grow. • Contribute to the development and implementation of AI models and solutions, working closely with data scientists and AI engineers. • Participate in code reviews, providing constructive feedback and ensuring adherence to coding standards. • Proactively bring innovative ideas to the table, driving the continuous improvement of our data infrastructure and processes. Required Skills and Qualifications • Proven experience as a Data Engineer, with a focus on Microsoft technologies. • Strong proficiency in PySpark, Spark, and Databricks. • Hands-on experience with data lakes and data management best practices. • Solid understanding of data governance, data quality, and data security principles. • Experience with SQL and other database technologies. • Familiarity with AI development and machine learning concepts. • Excellent problem-solving skills and attention to detail. • Strong communication and collaboration skills, with the ability to work effectively in a team environment. • Eagerness to learn and adapt to new technologies and methodologies. • Passion for innovation and a proactive approach to bringing new ideas to the table. Why Join Us? • Be a part of a great team doing advanced work in data development and AI development. • Opportunities for continuous learning and professional growth. • An innovative and collaborative work environment that values new ideas and diverse perspectives. If you are passionate about data engineering and eager to advance your skills in a supportive and forward-thinking environment, we encourage you to apply for this exciting opportunity. Let's shape the future of data and AI together! Thanks and Regards Nishant Saurabh | Team Lead Direct: (732) 426-0654 Ext. 574 Email: nishant@jobilitytalent.com Jobility Talent Solutions MBE, WOSB, SWAM, NMSDC 2 Lincoln Highway, Suite 401, Edison, New Jersey 08820| USA