Azure Data Engineer Remote/Nearshore—EST hours About the Role MUST-HAVE SKILLS: Python, Pyspark, Databricks, Azure, YAML, Databricks Asset Bundles Responsibilities • Design, implement, and manage data solutions within the Azure cloud environment. • Develop/analyze/optimize Power Query scripts for efficient data extraction, transformation, and loading (ETL) processes. • Design and implement robust Azure SQL databases to support diverse data needs. • Ensure data integrity, security, and optimal performance within Azure SQL. • Implement & execute SQL optimizations to enhance database performance and query efficiency. • Must have a detailed understanding of data warehousing techniques and implementation guidelines. • Analyze/architect/implement data pipelines using Azure Data Factory for seamless data orchestration and movement. • Design and maintain Azure Analysis Services models for efficient data analysis and reporting. • Utilize Databricks with a focus on PySpark for big data processing and analytics. • Develop and optimize PySpark scripts for large-scale data transformations and analytics. • Proven experience of using Unity Catalog and other governance techniques. • Develop PowerBI reports based on the requirements, along with DAX optimizations. • Implement optimizations for Power BI reports to ensure efficient and responsive data visualization. Qualifications • Bachelor’s or master’s degree in computer science, information technology, or a related field. • Proven experience as a lead or senior data engineer. • In-depth expertise in Azure cloud infrastructure and services. • Strong proficiency in Power Query for ETL processes. • Extensive knowledge of Azure SQL, SQL optimizations, and database administration. • Hands-on experience with Azure Data Factory for data pipeline development. • Proficiency in Azure Analysis Services and Databricks with a focus on PySpark. • Strong experience with Power BI for data visualization and reporting. • Strong problem-solving and analytical skills. • Excellent communication and collaboration abilities. Preferred Skills • Certification in Azure Data Engineering or a related field. • Familiarity with data governance and security best practices. • Experience in implementing and maintaining data lakes on Azure.