W2 - Azure Data Engineer

Job Title: Azure Data Engineer Location: Houston, TX Position Type: Contract position Job Description: This person will be working on a project that is moving digitalized business data to modern cloud structure, deliver values, BI insights, move data to the correct places, and adding analytics and AI. This environment is all on Azure. This person will need strong experience ingesting data from multiple sources and building scalable pipelines using ADF and Databricks. This person will also need experience building curated datasets in Databricks using PySpark, and SQL. The ideal person will have experience with time series data and real-time use cases. REQUIRED SKILLS AND EXPERIENCE: • 5+ years of experience in Data Engineering • Databricks experience - pivot logic, aggregation, extracting data from multiple sources and enhancing data management, building curated datasets, building scalable pipelines • Azure Data Factory - experience ingesting data into ADLS, experience building more complex scalable pipelines, developing end-to-end data pipelines to ensure seamless data ingestion and curation • Experience designing, developing and implementing scalable ETL processes, and data engineering pipelines using Python and Pyspark • Writing SQL queries from scratch NICE TO HAVE SKILLS AND EXPERIENCE: • Experience with Fabric. Thanks!