Data Engineer

Job summary

Shape the Future of the Nation’s Memory

At The National Archives, we are more than custodians of the past – we are pioneers in digital archiving, ensuring the UK’s public records are robust, connected, and accessible for generations to come. As a Data Engineer in our small, dynamic Digital Archiving team, you’ll help transform how archival data is managed, structured, and enriched, unlocking its value for public use and discovery.

This Job Would Suit…
If you’ve been working in an entry-level data role and are ready to take the next step, this is an ideal opportunity to grow your skills and responsibilities. We welcome those who are passionate about data, eager to learn, and keen to make a real impact. Data skills are highly valued at The National Archives, and you’ll be part of an active internal data community where specialists from across the organisation share knowledge, collaborate, and solve problems together.

Why Join Us?
• Your work will directly support the preservation and accessibility of the UK’s documentary heritage, including a new Parliamentary Archives project.
• We nurture talent, value every voice, and support personal and professional development. You’ll join a collaborative, forward-looking team where your ideas are heard and your growth is championed.
• Work with a modern tech stack including Python, SQL, Shell scripting, Talend, XSLT, XML, CSV, JSON, RDF, RDBMS, NoSQL, and graph databases. You’ll help design and build scalable data pipelines, automate data processing, and develop tools for data enrichment and integration
• We invest in your learning, offering opportunities to develop your skills in emerging technologies and data practices that enhance public access to archives.

Ready to help shape the future of digital archiving?

Apply now and join a team where your work matters – for today, and for generations to come.

Job description

What You’ll Do
• Design and develop scalable, repeatable data pipelines (ETL/ELT) to process, transform, and load archival data.
• Automate data cleansing, validation, standardisation, and enrichment.
• Develop and document schemas, ontologies, and models for archival data.
• Integrate data from diverse sources and formats, supporting better discovery and reuse.
• Collaborate with product teams, archivists, and developers to deliver practical, data-centric solutions.
• Contribute to a culture of openness, quality, and continuous improvement.

Please see the attached job description for a full list of responsibilities.

This is a full time post. However, requests for part-time working, flexible working and job share will be considered, taking into account at all times the operational needs of the Department.

A combination of onsite and home working is available and applicants should be able to regularly travel to our Kew site for a minimum of 60% of their work time.

Person specification

Essential skills and experience:

• Data manipulation Strong experience of accurate, reliable, large-scale analysis and manipulation of complex datasets using relevant programming languages and tools (e.g. Shell scripting, SQL or XSLT).
• Database technologies Practical knowledge of database technologies (e.g. RDBMS, noSQL, graph databases or linked data stores).
• Analysis and problem solving Excellent analytical skills, with a structured and proactive approach to solving technical problems. Able to apply a range of techniques to capture, document and communicate requirements, issues, designs and solutions.
• Communication and relationships Strong relationship building and communication skills, with an excellent user focus. Able to work collaboratively in multidisciplinary teams and explain technical issues clearly to non-technical colleagues.
• Prioritisation and organisation Ability to work with high accuracy, attention to detail and organisation, both independently and as a project team member. Able to prioritise competing tasks and deliver high-quality work to agreed deadlines.

Desirable knowledge and experience:

• Solid understanding of working with different data formats (e.g. XML, CSV, JSON or RDF)
• Awareness of the value and meaning of archival data and the ethical responsibilities that come with working with public records.
• Understanding of probabilistic, messy, or uncertain data handling.
• Experience in Agile development environments.
• Familiarity with archival principles or metadata standards (e.g. EAD, ISAD(G) or Dublin Core)

SC clearance/willingness to obtain SC clearance will be required for this role. This requires candidates to have been resident in the UK for at least the past five years. Please do not apply if you have been resident in the UK for less than five years as your application will be rejected.

Application Process

• Interview: Interviews will be held on-site, ideally week commencing 2nd November 2026. The interview will include a technical test.

• Personal Statement: We ask all applicants to upload their CV and to submit a personal statement of 600-700 words total.

Selection for interview will be based on the 3 ‘essential’ criteria listed below so please ensure that your application demonstrates in detail how you meet these requirements.

• Data manipulation Strong experience of accurate, reliable, large-scale analysis and manipulation of complex datasets using relevant programming languages and tools (e.g. Shell scripting, SQL or XSLT).
• Database technologies Practical knowledge of database technologies (e.g. RDBMS, noSQL, graph databases or linked data stores).
• Analysis and problem solving Excellent analytical skills, with a structured and proactive approach to solving technical problems. Able to apply a range of techniques to capture, document and communicate requirements, issues, designs and solutions.

Applicants invited to interview will be assessed against ALL of the essential criteria (see above).

Benefits

Alongside your salary of £43,367, The National Archives contributes £12,563 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides (opens in a new window).Generous benefits package, including pension, sports and social club facilities, onsite gym, discounted rates at our on-site cafe and opportunities for training and development.

Any move to The National Archives from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax-Free Childcare. Determine your eligibility at https://www.childcarechoices.gov.uk;

Things you need to know

Artificial intelligence

Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance (opens in a new window) for more information on appropriat