Data Engineer 6 months Redhill, Surrey - hybrid working (2-3 days pw in office) Up to £500 per day (inside IR35) Reporting into the Head of Data & Analytics, this role sits in the Data & Analytics team alongside Data Developers and Data Engineers. Key Responsibilities: • Development and automation of ingestion flows, data curation and access layers - Define technical solutions and take part in the development and deployment of applications in accordance with central standard and guidelines - Contribute to the improvement of standards, compliance and processes to guide Data Lake evolution - Design, develop, test and deploy data ingestion flows, data marts and core target data components - Implement tools and end-to-end monitoring to ensure high availability of production data processing, data quality and reliability • Maintenance of data transformation routes in the Data Lake - Maintenance of BAU including reporting regularly on performance, risks and issues Key Skills: • Experience working within multi-disciplinary data teams • Fluent with the Big Data stack in cloud environment (ADLS, Databricks, ADF, Azure DevOps etc) • Knowledge and experience of reporting solution design including Azure platforms, Pegasus, Attunity, Wax, R, SQL, Python, Spark, Power BI, Business Objects • Proficient in RESTful API design, implementation and consumption • You have a deep understanding of data lake technologies, interrogation of structures and unstructured data, data warehouse and data schema design for optimised reporting performance • You have a very good understanding of spark processes • You are fluent in multiple development languages • You have a good understanding of the software development process (git, ci/cd etc.) Please note that we are unable to offer visa sponsorship. We are committed to creating an inclusive recruitment experience. If you have a disability or long-term health condition and require adjustments to the recruitment process, our Adjustment Concierge Service is here to support you. Please reach out to us at adjustments@robertwalters.com to discuss further.