Azure Data Lead Remote We are looking someone who is having deep understanding of ADF ,Pyspark, native python as well infrastructure related knowledge like, github actions integration, DevOps role, prod-support of ADF pipelines etc, along with below JD :- Detailed Job Responsibility :- • Development Hands-On with ADF, • Build and create pipelines and Dataflows in ADF, • Understanding business requirement and implement them in Azure Synapse Notebooks using Spark-SQL • Daily deployment of Azure components like dataflows, pipelines ,triggers and notebooks using GITHUB Actions. • Apply logic to build Azure Python Function App as well as spark-sql queries via understanding either business case/existing mapping. • Perform optimization techniques to run Synapse notebooks using best use of spark pools. • Monitoring of existing pipelines running in ADF and Synapse and take appropriate action in case of failure. • Build and amend powerbi dashboard as per business request.