Data Engineer

Job Description • Take ownership of the data initiatives across EnergyOne • Design, build, and maintain scalable, reliable data pipelines for efficient data collection, transformation, and storage • Develop and maintain data/delta warehouses and data lakes for centralised access • Implement data security measures to protect sensitive information and ensure compliance with privacy standards • Contribute to the EnergyOne data experience through the delivery of innovative data solutions in support of broader strategies. • Oversee the full data lifecycle • Mentor and support other members of the Technology team in building industry-leading products using robust data architectural practices. • Manage day-to-day data maintenance and data support activities. • Create and maintain data processes in response to the industry market and customers' requirements • Integrate data from diverse sources, creating a unified and comprehensive organisational data views Analysis and Reporting • Design, install, test, and maintain robust, scalable data management systems aligned with business needs and industry best practices • Clean, transform, and prepare raw data for analysis, ensuring accuracy, completeness, and readiness for modelling • Integrate data from diverse sources, creating a unified and comprehensive organisational data view • Continuously assess and improve data quality, reliability, and consistency to ensure trustworthy data for analysis • Identify, evaluate, and integrate new data sources to enhance data infrastructure • Design and develop tools and programs to streamline data processing, analysis, and reporting • Analyse and interpret data using a range of techniques, identifying trends, testing solutions, sourcing additional related information where appropriate, and reporting on progress through briefings or formal reports • Apply initiative to devise varied solutions, approaching problems from different perspectives and “thinking outside the box” • Manage the development lifecycle of the data platforms, making recommendations for improvements in data and information provision (e.g. new hardware and software provision) • Gather and manipulate routine data so that it can be incorporated into the company and customers workflows Customer/Service Support • Provide and disseminate specialist technical advice on issues relating to the service, interpreting or assessing customer needs and exercising judgement to make decisions when solutions are not obvious • Interpret policy, legislation, regulations and good industry practice, advising on the implications of noncompliance, responding to and applying any necessary changes in the area of work. • Identify additional service/system requirements or shortfalls and design/propose the delivery of innovative solutions to maximise service quality, efficiency and continuity • Ensure professional and quality service standards are maintained and applied within own area of activity • Design and deliver training sessions/workshops within a brief to a sizeable, mixed interest groups or groups with diverse levels of understanding of the subject matter • Receive and respond to enquiries from/to customers, including more complex queries, judging when to forward on to or involve others • Use and understand common systems relevant to the area of work to enable manipulation of information and initial investigation of customer queries/problems • Recognise and understand the impact of IT data-related incidents arising and raise issues of concern where necessary to ensure appropriate resolution of customer enquiries/issues • Respond to general issues/problems and administrative matters in the manager’s absence • Demonstrate or explain the services available and/or the use of facilities to customers Planning and Organising • Project manage small to medium development activities to facilitate software service changes of typically a departmental section impact • Monitor and take responsibility for small to medium scale resources, following established procedures within defined project and/or area of work Liaison • Represent and promote the data service and/or provide specialist input at both internal and external meetings/events, influencing differing opinions and handling questions/objections as required, to ensure that departmental issues are appropriately represented • Consult and cooperate with other departments to develop new/improved processes and supporting data systems • Network with colleagues in the data industry and/or other industry institutions and other sectors to share best practices and facilitate future exchange of information Continuous Improvement • Contribute to the team's skills development and improvements • Relay customer feedback and comments, and contribute to proposals for improvements to current working methods • Keep skills up to date and develop competence through learning from colleagues and/or gaining experience • Identify needs and deliver professional skills training sessions to  colleagues • Mentor the team members and advise them as the data subject matter expert People Management • Organise and prioritise the project workload/tasks, ensuring they are completed correctly and scheduled • Provide guidance and support to junior colleagues through informal (on-the-job) training/coaching in own area • Show sensitivity and consideration to other people’s customer needs and feelings, which may include dealing with signs of obvious distress • Co-operate with and offer mutual support to colleagues in a team/work unit, adopting a flexible approach to delivering work objectives. Other Responsibilities • Any other duties as appropriate to the seniority and the role • The jobholder will occasionally be required to travel to other locations for meetings or training purposes Job Requirements Essential requirement Good knowledge and experience working with cloud data platforms such as Data/Delta Lakes, Databricks, Azure Data Factory or equivalents. Knowledge of source code control systems (e.g., Git) and Continuous Integration (CI) tools Knowledge of big data processing frameworks, data warehousing concepts and experience with platforms like Azure Data Factory, Databricks, Snowflake Knowledge of Agile methodology Hands on experience with major cloud platforms like AWS, Azure Desirable Knowledge of NodeJS, Ionic, Angular or Python Knowledge of ML principles and/or mobile applications development lifecycle Knowledge of CQRS and Domain Driven Development Experience in leading small development teams