Archival Data Analyst

As the living, growing home of our national story, The National Archives is already a special place to work. We’re an institution nearly 200 years old with a collection spanning 1,000 years of history. But it’s where we go next that makes things really interesting. In our strategic vision: Archives for Everyone, we set ourselves the challenge of becoming the 21st Century national archive - a different kind of cultural and heritage institution: Inclusive, Entrepreneurial, Disruptive. We won’t become this overnight. It will take time, focus, effort and daring. That’s where you come in. Because we can’t do this without you. Job Overview Salary: £40,000 per annum Contract type: Fixed Term Appointment for 22 months Band: F / Senior Executive Officer Closing date: Monday 16th June 2025 at midnight Be part of our transformation. Archives matter. Without records, we could not hold government to account, carry out pioneering research or learn from the past. The National Archives is the archive of UK Government and the courts. Our business strategy, Archives for Everyone, describes our vision to become an inclusive, entrepreneurial, and disruptive archive that harnesses emerging technology to reaffirm and transform our historic mission for the digital age. The Cataloguing, Taxonomy and Data department’s role is to deliver the control, quality, currency and ongoing development of our catalogue records and the systems in which they reside. We specialise in manipulating and enhancing at scale the metadata which lies at the heart of activities across the organisation. You’ll validate, transform and process complex textual data, working across SQL, JSON, and XML-based structures to ensure that the UK’s digital history remains structured, searchable, and usable. This is a full time post. However, requests for part-time working, flexible working and job share will be considered, taking into account at all times the operational needs of the Department. A combination of onsite and home working is available and applicants should be able to regularly travel to our Kew site for a minimum of 60% of their work time. The Selection Process Will Consist Of • Initial written application • Phone interviews w/c 16th June • Candidates who are successful following the phone interviews will be invited to an onsite technical test and interview on 2nd & 3rd July 2025 How To Apply To submit your application please click the 'Apply' button on this page. You will be asked to provide details of your work experience and write a personal statement, not exceeding 1200 words. In your statement please explain, using examples, how you meet the essential criteria below. You may draw on knowledge, skills, abilities, experience gained from paid work, domestic responsibilities, education, leisure interests and voluntary activities. Please note selection for interview will largely be based on the information you provide in this section, so please make full use of the word limit. We understand that you might use artificial intelligence (AI) and other resources to assist with your application; however, please ensure all information you provide is factually accurate, truthful, and original and doesn’t include ideas or work that isn’t your own. We encourage you to showcase your unique knowledge and skills using your own voice. SC-level Security Clearance or willingness to obtain SC clearance is mandatory for this role and requires that you have lived in the UK for the last 3 years. Please do not apply if you have not lived in the UK for the last 3 years as your application will be rejected. Job Description Job Purpose Context Archives are the homes for our collective memories, past and future. The National Archives is the archive of government, archives sector lead and one of the world’s leading national archives. Archives for Everyone, our business strategy, sets the ambition to become an inclusive, entrepreneurial and disruptive digital archive, and sets our priorities for sustaining the custodianship of our historic, collections and increasing opportunities for people to connect with them. In the coming years, the infrastructure and methods for processing our collections metadata will change significantly as we update our technology to handle ever-increasing amounts of data about our physical and digital collections. This process of transformation is already in train with new workflows being developed to manage the metadata associated with both the transfer of over 10 million service personnel files from the Ministry of Defence and the relocation of the Parliamentary Archives. Purpose As our Archival Data Analyst, you will be responsible for analysing textual data in depth to understand the possibilities and challenges within such datasets. You will work closely with archivists to meet their needs by supporting existing and developing new textual transformations, workflows and integrations for the publication of this data. This will facilitate more automation in respect of business priorities including a) the processing of the metadata associated with the current transfer of service personnel records, b) the integration into The National Archives’ systems of metadata relating to relocated Parliamentary collections and c) the regular export of metadata about collections held at The National Archives for submission to the Archives Portal Europe. You will thrive in an open, transparent and collaborative environment, engaging with internal and external communities to share your work and learn from others. You will drive the data transformation development and have the opportunity to develop your expertise in existing and emerging technologies that can be applied to enhance archival content and enable the re-use of public data. Note that this role does not utilise Power BI. Role and Responsibilities This role corresponds to the DDaT Data Analyst role, with elements of the Data Engineer and Data Scientist roles. Data Analysis • Develop models and structures (for example, schemas or ontologies) that describe TNA’s textual archival data. • Develop code, scripts and tools to automate routine textual data processing, including data cleansing, standardisation, enrichment and enhancement. • Develop and implement tools and approaches for textual data validation, error checking, migration and transformation. • Research and implement tools for entity extraction and semantic tagging to improve the usability and findability of archival data. Programming To Prepare And Load Data • Create scripts, programs and applications to validate and manipulate datasets. • Contribute to the development of systems and services to process and publish data received into the archive. Technical Consultancy • Develop relationships with, and support and influence, archivists, subject specialists and senior staff responsible for data standards, schemas and archival data policies, across the UK and international government and archives sectors. • Take a wider view of sources for solutions beyond TNA. Ways Of Working • Work in the open, contribute to code review, produce clear and relevant documentation, and share code internally and externally as appropriate. • Share your work internally and externally through blog posts, ‘show and tells’, papers and presentations. Working Conditions • Normal office environment. • Display Screen Equipment user. • Possible exposure to distressing material. Person Specification Essential • Data technologies: Excellent skills in Python and experience using XSLT. Familiarity with pattern analysis and a broad knowledge and experience of relevant technologies for encoding, cleansing, manipulating and analysing complex structured and unstructured data. For example, data encoded in XML, CSV and JSON. • ETL Processes: Knowledge of how to extract data from various sources, including databases, APIs, and flat files. Demonstrable ability to clean, format, and transform textual data to meet the requirements of the target system. Skills in loading transformed data into target destinations or data models and vocabularies. Familiarity with relevant tools (for example, Talend, Informatica, Stitch, Pentaho) or willingness to learn. • Data Governance: Understanding of data governance practices, including data quality; reference and master data; data interoperability. An appreciation of how data governance works with other governance structures within the organisation. • Problem-Solving: Ability to identify and resolve issues that arise during the ETL and data migration processes. Experience in preparing and validating textual data and optimising ETL workflows for better usability, demonstrating a proactive and solutions focused approach to problems. • Communication and relationships: Strong communication and relationship building skills, suitable for working with multidisciplinary stakeholders at all levels; able to lead and facilitate work to gather user requirements from non-technical colleagues and to explain technical concepts clearly to non-technical staff. • Approach to work: Highly motivated to work independently and as a project team member. Ability to prioritise tasks and deliver high quality work to agreed deadlines. A commitment to developing new skills and sharing your expertise with others. Desirable • Good understanding of the value of records and archives • A strong focus on meeting user needs • Experience or awareness of Agile methodologies • Experience of working with data standards relevant to digital archiving and archival description. The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan and the Civil Service D&I Strategy. Benefits Generous benefits package, including pension, sports and social club facilities, onsite gym, discounted rates at our on-site cafe and opportunities for training and development. Annual leave entitlement of 22 days per calendar year (rising to 25 after the first year, and incrementally to 30 days after six years) and 10½ days public and privilege holidays per annum. Any move to The National Archives from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax-Free Childcare. Determine your eligibility at  https://www.childcarechoices.gov.uk/ (opens in new window) Reasonable adjustments If a person with disabilities is put at a substantial disadvantage compared to a non-disabled person, we have a duty to make reasonable changes to our processes. If you need a change to be made so that you can make your application, you should: • Contact The National Archives via careers@nationalarchives.gov.uk as soon as possible before the closing date to discuss your needs • Complete the ‘Reasonable Adjustments’ section of your application form to tell us what changes or help you might need further on in the recruitment process. For instance, you may need wheelchair access at interview, or if you’re deaf, a Language Service Professional Feedback will only be provided if you attend an interview or assessment. Security Successful candidates must pass a disclosure and barring security check. People working with government assets must complete basic personnel security standard checks (opens in new window) Nationality Requirements This job is broadly open to the following groups: • UK nationals • nationals of the Republic of Ireland • nationals of Commonwealth countries who have the right to work in the UK • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window) • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS) • individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020 • Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service Further information on nationality requirements (opens in new window) Working for the Civil Service The Civil Service Code  (opens in new window) sets out the standards of behaviour expected of civil servants. We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles. (opens in new window) The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria. The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy. This vacancy is part of the Great Place to Work for Veterans initiative. (opens in new window) Contact Point For Applicants • Name: The National Archives Recruitment Team • Email: careers@nationalarchives.gov.uk Further information If you feel your application has not been treated in accordance with the Recruitment Principles and you wish to make a complaint, in the first instance, you should contact The National Archives via email: careers@nationalarchives.gov.uk If you are not satisfied with the response you receive from the Department, you can contact the Civil Service Commission at https://civilservicecommission.independent.gov.uk/recruitment/recruitment-complaints/ (opens in new window)