Senior Data Engineer

hackajob on-demand focuses on matching talented contractors like you with organisations seeking specific skills for their projects. We use our platform to connect you with exciting contract opportunities and discuss projects on behalf of the companies we partner with. Job Opportunity: Senior Data Engineer (Azure & Dataverse Focus) We are looking for an experienced Data Engineer to join our team and help design, build, and optimize data solutions that power critical business processes. The ideal candidate will bring strong expertise in Azure data services, Dataverse, and large-scale data architecture. This role is perfect for someone who thrives in handling complex data challenges and collaborating with cross-functional teams to deliver scalable, high-performance solutions. Skills Needed: Responsibilities: • Manage and maintain multi-terabyte datasets on Dataverse, utilizing platforms like Azure SQL and Azure Cosmos DB. • Design and implement scalable data models (both relational and non-relational) with a focus on optimization and performance tuning. • Perform data archival processes and support reconciliation of large datasets. • Develop and maintain data warehousing solutions, ideally with experience in tools such as: • Microsoft Fabric (preferred) • Snowflake (nice to have) • Build and maintain ETL pipelines using: • Azure Data Factory • Azure Databricks • Other Azure-native integration services • Collaborate with cross-functional teams including developers, architects, and business analysts to deliver scalable data solutions. Requirements • 5+ years of experience in data engineering and database optimization. • Strong hands-on experience with Azure cloud data services. • Deep understanding of Dataverse and Microsoft Dynamics 365 data architecture. • Proficiency in SQL and Python for data manipulation and pipeline development. • Familiarity with data governance, security, and compliance in cloud environments. • Excellent problem-solving and communication skills. Nice to have • Experience with Microsoft Fabric or Snowflake. • Exposure to Power Platform, especially Power Apps and Power Automate. • Knowledge of data visualization tools like Power BI.