Senior Data Engineer

Responsibilities: • Identifying, creating, and preparing data required for modern BI/ML solutions • Building data architectures, and data pipelines to collectively bring together data • Designing solutions using Microsoft Azure services, Databricks, and other tools • Assuring that data is cleansed, mapped, transformed, and optimized for storage and use according to business and technical requirements • Automating tasks and deploying production standard code (with unit testing, continuous integration, versioning, etc.) • Loading transformed data into storage and reporting structures such as data warehouses, real-time reporting systems and analytics applications Required Technical Skills: • Experience in data engineering and cloud data processing services (Azure Cloud Platform) • Hands on Experience in Data Warehousing & ETL tools • Experience in Big Data technologies (e.g. Databricks, Alteryx) • Experience building and optimizing 'big data' data pipelines, architectures, and data sets • Knowledge of SQL and Python/PySpark • Open mindset, ability to quickly adapt to new technologies and learn new practices Required Functional Skills: • Communication skills • Collaboration skills • Presentation skills Optional Skills: • Knowledge of Oracle PL/SQL, Java, SAS is a plus • Performance/security-oriented data modeling and data design, including partitions, different type of indexes, views, and most effective data management practices • Azure Synapse Analytics, Azure DevOps • Knowledge of Purview, Power BI, Qlik, or Tableau is a plus Education & Certifications: • Bachelor’s Degree in Computer Science or similar • Azure Data Engineer certification (preferred)