Senior Data Engineer

Senior Data Engineer Sheffield, UK 6 Months contract Experience 7 to 11 Responsibilitie • sDesign build and maintain largescale data pipelines and ETL workflows across enterprise dataset • sIngest provision and manage raw enriched and curated data assets for analytics platform • sImprove reliability scalability and realtime data ingestion capabilitie • sSupport and enhance cloudbased data ingestion infrastructure and platform service • sAcquire transport clean transform and integrate data from internal and external source • sPerform exploratory data analysis and onboard new data source • sDevelop automated data engineering workflows and optimize data processing pipeline • sManage data modelling data warehousing data integration and data cataloguing activitie • sSupport realtime analytics and streaming data platform • sContribute to cloud infrastructure engineering platform operations and production suppor • tImplement cloud cost optimization and platform efficiency improvement • sCollaborate with engineering analytics infrastructure and cybersecurity team • sSupport DevOps automation monitoring and operational excellence initiative • sMaintain documentation governance standards and operational procedure s To be successful in this role you should ha • veExperience with SRE principles and Azure DevO • psStrong scripting skills using Bash PowerShell and Azure C • LIProgramming experience with Python C Java and objectoriented developme • ntStrong SQL and Kusto Query Language KQL experien • ceExperience with GitHub source control systems and CICD pipelin • esStrong Linux administration and scripting experien • ceKnowledge of networking operating systems storage technologies and infrastructure fundamenta • lsExperience in Data Acquisition and CloudBased Data Pipelin • esExperience with Data Transport Data Cleaning and Data Integrati • onStrong Data Engineering pipeline automation productionization and optimization skil • lsExperience designing and maintaining ETL workflows and largescale data pipelin • esKnowledge of Data Warehousing Data Modeling and Data Catalogui • ngExperience with RealTime Analytics and Streaming Data Platfor • msCloud Cost Optimization experien • ceStrong Azure platform knowledge including Azure AD Azure IAM Networking Compute Storage Databases and Containe • rsExperience with Azure Data Factory Azure Databricks Unity Catalog Azure Functions Azure Logic Apps Azure Monitor Azure Log Analytics Azure Data Lake Synapse Analytics and Power • BIExperience with Kubernetes and CloudNative platfor • msKnowledge of Nginx Apache CosmosDB Linux Prometheus Grafana and Elasticsear • chExperience with Infrastructure as Code tools such as Terraform ARM Chef and Ansib • leExperience with Azure Event Hubs Kafka and Spark Streami • ngExposure to SIEM and SOAR platforms is advantageo • usExperience working in highly regulated enterprise environments is preferr ed Ski llsMandatory Skills : Azure, Data Engineering, Data Acquisition, Azure Data Factory, Azure Databricks, ETL, Data Pipelines, Python, SQL, Azure Dev Ops