Azure Data Lead

Role: Azure Data Lead Remote (PST) data engineer pypark and synapse Job Description: • Candidate should have 12-15 years of experience in Data Engineering and Architect area • Data platform strategy, Data migration strategy, Data validation strategy. • Designing, creating, testing and maintaining the complete data management & processing systems. • Working closely with the stakeholders • Contribute towards defining platform roadmap/Architecture/ solution, Design, POCs, prototype, technical evaluation for tech stack finalization and guiding principle for the best practices etc. • Contribute towards understanding the business problems, identify and propose the best technical solution. • Design / Implement DWH, data model, Data Pipelines/ Analytics; Handling NFR & benchmarking • Creating data models to reduce system complexities and hence increase efficiency & reduce cost. • Introducing new data management tools & technologies into the existing system to make it more efficient. • Ensuring architecture meets the business requirements. • Building highly scalable, robust & fault-tolerant systems. • Taking care of the complete ETL process. • Must have knowledge and working experience in Real-time processing Framework (Apache Spark), PySpark and in Azure • Must have experience on SQL-based technologies (e.g. MySQL/ Oracle DB) and NoSQL technologies (e.g. Cassandra and MongoDB) • Experience in Snowflake • Discovering data acquisitions opportunities • Finding ways & methods to find value out of existing data. • Improving data quality, reliability & efficiency of the individual components & the complete system. • Setting & achieving individual as well as the team goal. • Problem solving mindset working in agile environment