
Technical Data Engineer (CR1437) - Fixed-Term Appointment
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a "Technical Data Engineer" on a fixed-term contract until 31st March 2026, offering a salary of £41,220 - £49,020. Key skills include Python, SQL, cloud solutions (Azure/AWS), and experience with data pipelines. Location options include multiple UK cities.
🌎 - Country
United Kingdom
💱 - Currency
£ GBP
-
💰 - Day rate
222.8181818182
-
🗓️ - Date discovered
July 5, 2025
🕒 - Project duration
More than 6 months
-
🏝️ - Location type
On-site
-
📄 - Contract type
Fixed Term
-
🔒 - Security clearance
Yes
-
📍 - Location detailed
Newcastle upon Tyne
-
🧠 - Skills detailed
#Migration #Data Security #Python #SQL (Structured Query Language) #Deployment #Presto #AI (Artificial Intelligence) #GIT #Data Warehouse #AWS (Amazon Web Services) #Data Analysis #Databases #Security #Automation #Data Science #BI (Business Intelligence) #Programming #Storage #Tableau #Strategy #Data Pipeline #Data Engineering #GitHub #Cloud #Data Ingestion #Infrastructure as Code (IaC) #Datasets #Data Processing #GDPR (General Data Protection Regulation) #Azure
Role description
Heading 1
Heading 2
Heading 3
Heading 4
Heading 5
Heading 6
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur.
Block quote
Ordered list
- Item 1
- Item 2
- Item 3
Unordered list
- Item A
- Item B
- Item C
Bold text
Emphasis
Superscript
Subscript
Details
Reference number
413627
Salary
£41,220 - £44,500
National: £41,220 - £45,400 London: £44,500 - £49,020 Pro-rata for job share
A Civil Service Pension with an employer contribution of 28.97%
GBP
Job grade
Senior Executive Officer
Senior Scientific Officer
Contract type
Fixed term
Length of employment
Until 31st March 2026
Business area
APHA – Science - Surveillance and Laboratory Services Department (SLSD)
Type of role
Science
Working pattern
Full-time, Job share
Number of jobs available
1
Contents
Location
About the job
Benefits
Things you need to know
Apply and further information
Location
Bristol, Cardiff, Carlisle, Carmarthen, Crewe, Exeter, Leicester, Newcastle-upon-Tyne, Nottingham, Perth, Preston, Weybridge, Winchester, York
About the job
Job summary
The Animal and Plant Health Agency (APHA) is an executive agency of the Department for Environment, Food & Rural Affairs, and works on behalf of the Scottish Government and Welsh Government. Our diverse teams of over 3,000 skilled and committed professionals come together to provide research, advice and support to UK Government for safeguarding animal, public and plant health for benefit of the environment and economy.
The Science Directorate (SD) delivers high quality, high impact and highly relevant multidisciplinary science. Our People are diverse, talented, engaged and inspired to deliver innovative outcomes.
This is an exciting opportunity for a Technical Data Engineer to be involved in new improvements being made to APHA’s data that informs intelligence for animal diseases. This post is a fixed-term appointment, funded through the Cabinet Office as part of the National Biosurveillance Network Private Vet Labs Project.
The APHA’s Surveillance Intelligence Unit (SIU) is a multidisciplinary team that is responsible for collecting, collating, presenting and analysing livestock scanning (passive) surveillance data generated within APHA. Increasingly, data from third parties (including commercial private veterinary laboratories, veterinary practitioners and abattoirs) is also being harnessed to augment scanning surveillance outputs. The data and analyses are used to produce routine reports and other outputs relating to endemic diseases of animals in Great Britain for the benefit of a wide range of stakeholders, including the livestock industry, private veterinary surgeons and producers.
This new post is funded through the National Biosurveillance Programme (NBN), which is a component of the UK’s Biological Security Strategy (BSS), which outlines the UK’s cross government mission to achieve resilience to a spectrum of biological threats. The NBN aims to improve the UK’s ability to characterise and report biological risks across the One Health spectrum, reliably and rapidly. This includes improving ways of working to better record, share and utilise surveillance outputs, and bringing data together to generate a holistic picture of risks.
The post sits within a dedicated multidisciplinary NBN team in APHA and will work closely with the SIU team, in particular the team of Data Analysts within SIU.
Job description
This role will provide a data and information management function directly contributing to the outputs of the animal health scanning surveillance network in Great Britain.
The successful applicant will be directly involved in the collection, curation and analysis of animal health scanning surveillance data primarily by building, updating and maintaining automated data ingestion and processing pipelines in a cloud-based environment using existing APHA surveillance data as well as animal health data from third party sources that augments current outputs and enhances APHA’s scanning surveillance capabilities.
The post-holder will initially work with an existing developer team to define data handling capabilities within the SIU team and will be subsequently responsible for maintaining and scaling data ingestion processes to an increasing number of datasets. The post-holder will also provide functional management of other members of the SIU team, identifying suitable training opportunities and providing support and mentoring as required to deliver resilience of skills and experience across the team.
The SIU is a geographically dispersed team that works effectively at a distance using tools such as Microsoft Teams. However, it will be necessary to travel occasionally to other locations for training sessions and workshops where face-to-face participation is beneficial for both the individual and the team.
More information about the work of these teams is available at https://www.gov.uk/guidance/animal-disease-scanning-surveillance-at-apha
As part of on-going efforts to utilise scanning surveillance data from multiple external providers and collaborators, APHA is working to develop modern, cloud-based tools that will enable efficient and consistent data preparation, visualisation and analysis. Currently, a contractor delivery team is developing a system to enable secure data submissions through an online portal and the development of pipelines that will automate many of the data-handling tasks that are currently performed manually.
The post will work with the SIU and delivery teams to understand data-handling requirements for data from multiple providers and to make full use of the tools being developed to write and implement data pipelines that will efficiently – and where possible, automatically – ingest, process, store and prepare data for visualisation and further analysis.
The post will also help to characterise business change requirements as new tools enter business-as-usual workflow and will support and mentor existing members of the SIU team by identifying training requirements and appropriate learning opportunities to build team resilience and maximise potential benefits.
More specifically, in this role you will:
Work with data providers and the delivery team to determine data processing and access needs and how best to deliver them.
Create and support data pipelines and storage solutions (e.g. data warehouses).
Develop and deliver automation of data infrastructure and deployments.
Mentor team members to build resilience and expertise in data pipeline.
Help improve the team’s data capabilities.
Person specification
You will need to demonstrate the following:
Significant experience working on data pipelines, platforms and projects.
Experience in developing solutions in one or more of the main Cloud providers (e.g. Azure, AWS).
Strong background in Python programming language.
Working with a variety of databases, data warehouses and distributed file systems in production environments.
Strong experience in SQL and data modelling.
Experience of using dashboarding tools, preferably Tableau.
Working with source control and infrastructure as code (e.g. Git/Github) and CI/CD tools.
Exposure with data processing at scale.
Knowledge about GDPR and data security.
Understanding and being able to support data scientists or business intelligence teams in data preparation, mentoring and support functions.
Strong collaboration and communication skills, including the ability to communicate effectively while working with nationally distributed teams.
Willingness and ability to travel as required to face to face events, such as training and workshops.
Interest in animal health surveillance systems in England and Wales.
A valid full driving licence is necessary or access to an alternative means of transport.
Behaviours
We'll assess you against these behaviours during the selection process:
Changing and Improving
Working Together
Developing Self and Others
Seeing the Big Picture
We only ask for evidence of these behaviours on your application form:
Changing and Improving
Working Together
Benefits
Alongside your salary of £41,220, Animal and Plant Health Agency contributes £11,941 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.
In return for your dedication and hard work, we will support your ongoing personal development through appropriate training as inclusion, support and the development of our people matter to us. We aim to support the career and personal wellbeing of everyone in APHA. Our benefits include generous annual leave, a generous employer contributory pension, staff bonuses and recognition, salary sacrifice benefit options, and an employee discount scheme, reward vouchers and in-year bonuses. We also offer additional days off if accrued extra hours (flexi-time –if accumulated), three paid volunteering day per year. We also have a social committee who run team building and fun events at the Weybridge site. Further details can be found in the APHA Information Pack.
Everyone in APHA is supported to develop their skills and capabilities. When you join the Directorate, you will be welcomed into your new team through an induction programme that will provide you with helpful information on the civil service, our work and our policies. Your line manager will also work with you to establish your priorities for the year, developing a performance, learning and development plan tailored to you and your role.
Things you need to know
Selection process details
This vacancy is using Success Profiles , and will assess your Behaviours and Experience.
Application Process
As part of the application process, you will be asked to complete a CV, a 500-word Personal Statement, and two 250-word Behaviour statements.
Further details around what this will entail are listed on the application form.
Sift
Should a large number of applications be received, an initial sift may be conducted using the lead Behaviour, Changing and Improving. Candidates who pass the initial sift may be progressed to a full sift or progressed straight to assessment/interview.
Sift and interview dates to be confirmed.
Interview
If successful at application stage, you will be invited to interview where you will be assessed on Behaviours and your skills and experience.
A presentation or additional exercise may also be assessed.
Please use the STAR technique (Situation, Task, Action, Result) to provide evidence of each behaviour.
Your interview will either be conducted face to face or by video. You will be notified of the location if you are selected for interview.
Location
Please be aware that this role will be contractually based in a Defra/APHA group workplace/office. The successful candidate is required to carry out all their duties from a UK location and cannot do so from an overseas location at any time.
As part of the pre-employment process, successful candidate(s) will be able to agree a contractual workplace from those locations listed in this advert. The agreed contractual workplace is then the substantive and permanent place of work for the successful candidate(s).
Where the location is 'National' the successful appointee should discuss and agree an appropriate contractual location in line with both Defra’s location policy and site capacity, prior to proceeding with pre-employment processes.
Successful applicants currently employed by the hiring Defra organisation for this post may choose to remain in their current contractual location or may choose to change contractual location to one of those listed above. This should be discussed and agreed prior to proceeding with pre-employment processes.
The agreed amount of time spent at a workplace for this post will reflect the requirement for Civil Servants to spend at least 60% of their working time in an organisation workplace with the option to work the remaining time flexibly from home. Working time spent at a workplace may include time spent at other organisational locations including field-based operational locations, together with supplier, customer or partner locations. This is a non-contractual agreement which is consistent with common Civil Service expectations.
Travel costs to non-contractual workplaces will be subject to departmental travel and subsistence policies. Travel costs to contractual workplaces are the responsibility of the employee.
Defra includes the core department, APHA, RPA, Cefas and VMD.
This post can be located at any of the listed APHA sites.
Salary
New entrants are expected to start on the minimum of the pay band.
Reserve List
A reserve list may be held for a period of 12 months from which further appointments can be made.
Childcare Vouchers
Any move to DEFRA from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax Free Childcare; for further information visit the Childcare Choices website.
Reasonable Adjustment
If a person with disabilities is put at a substantial disadvantage compared to a non-disabled person, we have a duty to make reasonable changes to our processes.
If you need a change to be made so that you can make your application, you should:
Contact Government Recruitment Service via defrarecruitment.grs@cabinetoffice.gov.uk as soon as possible before the closing date to discuss your needs.
Complete the ‘Assistance required’ section in the ‘Additional requirements’ page of your application form to tell us what changes or help you might need further on in the recruitment process. For instance, you may need wheelchair access at interview, or if you’re deaf, a Language Service Professional.
Accessibility
If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the 'Contact point for applicants' section.
Visa Sponsorship Statement
Please take note that Defra does not hold a UK Visa & Immigration (UKVI) Skilled Worker License sponsor and are unable to sponsor any individuals for Skilled Worker Sponsorship.
Merit Lists
Where more than one location is advertised, candidates will be appointed in merit order for each location. You will be asked to state your location preference on your application.
Criminal Record Check
If successful and transferring from another Government Department, a criminal record check may be carried out.
In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service/Disclosure Scotland on your behalf.
However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct. If you will be doing this, please advise Government Recruitment Service of your intention by emailing Pre-EmploymentChecks.grs@cabinetoffice.gov.uk stating the job reference number in the subject heading.
For further information on the Disclosure Scotland confidential checking service telephone: the Disclosure Scotland Helpline on 0870 609 6006 and ask to speak to the operations manager in confidence, or email Info@disclosurescotland.co.uk
Use of Artificial Intelligence (AI) in applications
The Civil Service values honesty and integrity and expects all candidates to abide by these principles. Please ensure that all examples provided in your application are taken directly from your own experience and that you describe the examples in your own words. Applications will be carefully reviewed and if evidence of plagiarism or copying examples/answers from other sources is found, your application will be withdrawn.
We understand that you might use artificial intelligence (AI) and other resources for your application; however, we also value the personal touch and urge applicants to write statements without the use of AI to emphasise their own unique experiences. Please ensure all information you provide is factually accurate, truthful, and original and doesn’t include ideas or work that isn’t your own. This is so that your application is authentically and credibly your own.
Internal Fraud Database Check
Applicants who are successful at interview will be, as part of pre-employment screening, subject to a check on the Internal Fraud Database (IFD). This check will provide information about employees who have been dismissed for fraud or dishonesty offences. This check also applies to employees who resign or otherwise leave before being dismissed for fraud or dishonesty had their employment continued. Any applicant’s details held on the IFD will be refused employment.
A candidate is not eligible to apply for a role within the Civil Service if the application is made within a 5 year period following a dismissal for carrying out internal fraud against government.
Full Time Only
This role is full time only. Applicants who wish to work an alternative pattern are welcome to apply however your preferred working pattern may not be available and you should discuss this with the vacancy holder before applying. We may consider two part-time staff on a job share basis if continuity can be arranged.
Higher Security Clearance
The Weybridge site is a strategically important national asset due to its role as a reference laboratory supporting the Government’s response to national emergencies including disease outbreaks. For this reason, all postholders based on the APHA Weybridge site must hold a valid Counter Terrorist Check (CTC) security clearance or above. It is up to each person applying for a post at APHA Weybridge to ensure they meet the residency criteria. Applicants must be currently resident in the UK & have at least three years continuous UK residency as this is a requirement to work at the Weybridge site where the team and work is situated. CTC is only required if based at Weybridge.
Please be aware the levels of national security clearance are changing which may impact on the level needed for this role by the time of appointment. All efforts will be made to keep candidates informed of any changes and what that will mean in terms of vetting criteria. For more information please See our vetting charter
For further information on National Security Vetting please visit the Demystifying Vetting website.
Loan and Fixed Term Appointments
Existing Civil Servants and applicants from accredited NDPBs are eligible to apply but will only be considered on loan basis (Civil Servants) or secondment (accredited NDPBs). Prior agreement to be released on a loan basis must be obtained before commencing the application process. In the case of Civil Servants, the terms of the loan will be agreed between the home and host department and the Civil Servant. This includes grade on return.
The post is not permanent. It is time limited due to a fixed funding period or as part of a specific project. The fixed term will end when the funding or the project expires.
This post will therefore begin from your agreed start date and end on 31st March 2026.
Feedback Feedback will only be provided if you attend an interview or assessment.
Security
Successful candidates must undergo a criminal record check.
People working with government assets must complete baseline personnel security standard (opens in new window) checks.
Medical
Successful candidates will be expected to have a medical.
Nationality requirements
This job is broadly open to the following groups:
UK nationals
nationals of the Republic of Ireland
nationals of Commonwealth countries who have the right to work in the UK
nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS)
nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service
Further information on nationality requirements
Working for the Civil Service
The Civil Service Code sets out the standards of behaviour expected of civil servants. We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles .
The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.
The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.
Diversity and Inclusion
The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan and the Civil Service Diversity and Inclusion Strategy .
Apply and further information
This vacancy is part of the Great Place to Work for Veterans initiative.
The Civil Service welcomes applications from people who have recently left prison or have an unspent conviction. Read more about prison leaver recruitment (opens in new window).
Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.
Contact point for applicants
Job contact :
Name : Science Directorate HR
Email : Science.DirectorateHR@apha.gov.uk
Recruitment team
Email : defrarecruitment.grs@cabinetoffice.gov.uk
Further information
If you feel your application has not been treated in accordance with the Recruitment Principles and you wish to make a complaint, in the first instance, you should contact Government Recruitment Services via email: defrarecruitment.grs@cabinetoffice.gov.uk If you are not satisfied with the response you receive from the Department, you can contact the Civil Service Commission: here