
Digital archiving: keeping documents valid for as long as they must be kept
Digital archiving looks solved the moment everything has been scanned onto a drive. But an archive has to do something storage does not: show that a document is, years later, exactly what it was, and find it within reasonable time. This article is about documents; email has its own article on email archiving.
An archive is not a folder and not a backup. It promises that a document stays unaltered, complete and findable until its retention period ends, and that it is gone after that.
Whether an archive carries evidential weight does not come from one product but from four things together: unalterable storage, a log of who did what, a file format that lasts, and a documented procedure.
Which period applies and which paper originals you must keep is for your accountant or legal adviser. IT makes sure the archive can carry out that decision and prove it.
Digital archiving is not the same as storage
A file share, a cloud folder or a document management system holds documents you are working on. You change them, move them, and anyone with the rights can delete them. That is exactly right for working documents and exactly wrong for an archive.
An archive promises the opposite. What goes in no longer changes, not even by an administrator. It stays complete: nothing slips through the cracks. It can be found on attributes recorded when it was archived. And it only disappears when the retention period is over, and then it really does.
A backup is not an archive either. A backup exists to restore a system, is overwritten after a while and was never designed to find one invoice from six years ago. Most organisations need all three: workplace, archive and backup, each with its own job.
What keeps an archive valid
An archive is valid when it survives scrutiny: an auditor, a tax inspector or a court can rely on what it holds being the original, or a faithful copy of it. In the UK, BS 10008 is the standard that describes how to manage electronic information so that its evidential weight holds up. Whichever framework you follow, the same requirements keep coming back:
- Unalterable. An archived document cannot be edited or overwritten. A new version becomes a new item, next to the old one.
- Complete. Everything that must be archived gets in, and nothing is lost when it is moved.
- Traceable. A log records who archived, retrieved or, at the end of the period, destroyed what and when.
- Findable and readable. Within reasonable time, on the attributes that matter, and in a form you can still open by then.
- Documented. There is a description of how the archive works: what goes in, who may do what, how long things stay. Without it, a good set-up cannot be demonstrated.
That last point is the one most often forgotten, and the first thing a reviewer asks for.
Scanning paper, and when the original may go
If you want to archive paper digitally, you scan it. Whether the paper may then go is not an IT question but one for your accountant or legal adviser: for most records it can, for some documents you must keep the original, and the rules differ between countries. Ask before you scan the first box empty.
What IT does handle is making sure the scan faithfully replaces the original. That takes a fixed procedure, in writing:
- Who scans, and on which device. A document scanner with fixed settings, not the phone of whoever happens to be at the desk.
- What quality. Resolution and colour set so that everything stays legible, including a stamp, a signature and the small print on the back.
- How it is checked. Does the page count match, is every page legible, and who signs that off.
- When the paper is destroyed. Only after that check, and only once it is clear the original does not have to be kept.
Which scanners suit this is on our page about document scanners.
The file format: still openable in ten years
An archive that must last ten years will outlive several versions of the software the documents were made with. So choose a format independent of that software. For documents that is usually PDF/A, a standardised form of PDF (ISO 19005) that stores everything needed to display the document inside the file itself, such as fonts, and allows no content that has to be fetched from elsewhere.
But do not convert everything blindly. An electronic invoice in a structured format, such as an XML file, is itself the original; the PDF you see is a rendering. Keep the file as it arrived. The same goes for a spreadsheet with formulas: a PDF shows the result, not how it was reached.
And keep the attributes with the document: date, sender, case, document type. An archive of thousands of PDFs without attributes is a pile of paper in a different form.
Making it unalterable: what the technology must do
Unalterability is a property of the storage and the permissions, not of a promise. For any solution, whether a cloud archive service or a system you run yourself, ask how these four points are handled:
- Storage that cannot be overwritten. A retention lock on the storage (often called WORM: write once, read many) that even an administrator cannot bypass before the period ends.
- Separate admin rights. Whoever runs IT does not automatically run the archive. Setting and shortening retention periods belongs to a different role, with a log behind it.
- A fingerprint per document. A hash value taken at archiving, optionally with a timestamp from a trusted service, so you can later show the file has not changed.
- A copy in a second place. An archive that exists once is one failure away from gone. The archive belongs in the backup too.
How such an unalterable copy works in practice is covered in our article on immutable backup.
The retention period, and disposal
Every type of document has a period, and it comes from legislation, your sector or a contract. HMRC, Companies House and sector regulators each have their own rules, and they are not the same for every record. Have the list per document type drawn up by your accountant or legal adviser, and have the archive carry it out.
Disposal belongs to archiving as much as keeping does. UK GDPR requires that you do not keep personal data longer than necessary. An archive that never destroys anything mostly stores risk after a few years. Have it delete automatically at the end of the period, with an entry in the log, and put a legal hold only on items needed for an ongoing dispute or investigation.
An archive outlives its supplier
A ten-year retention period is longer than most contracts with a software vendor. The archive must therefore be able to move without losing its evidential weight, and that is settled when you choose, not when you leave.
- An export with everything. The documents, their attributes, the hash values and the log, in an open format. Without the log you lose traceability.
- A test export every year. Take a sample out and check you can read and verify it outside the system.
- Review formats. Every few years, check that the archived formats still open in common software, and if not, plan a conversion that is itself recorded.
Where our work stops
What we do. We set up the technology: scanners and the scanning procedure, unalterable storage, separate permissions, the log, the backup of the archive and the link to the workplace. We help document the procedure as it has been set up technically, and show that it is in place.
What we do not do. We are not lawyers or tax advisers. We do not determine which retention period applies to which document, which paper originals you must keep, or whether your archive meets a legal requirement. That is for your accountant, tax adviser or lawyer. Nor do we certify archives: our own ISO certifications cover how we work, not your archive.
Questions we get about this
The five that come up most often.
What is digital archiving?
Digital archiving means keeping documents electronically so that they stay unaltered, complete, findable and readable until their retention period ends, with a log of who did what. It differs from storage, where documents can still change, and from backup, which exists to restore systems. At the end of the period the documents are deleted.
Is a backup the same as a digital archive?
No. A backup exists to restore systems and is overwritten after a while. An archive keeps documents unaltered until the end of their retention period and makes them findable on attributes. Most organisations need both, and the archive itself belongs in the backup.
Can I throw away paper documents after scanning them?
For many records yes, for some documents no, and it differs between countries. Ask your accountant or legal adviser before you start. Also put a scanning procedure in writing with fixed settings and a check per document, and only destroy the paper once that check is done.
Which file format is best for digital archiving?
For most documents PDF/A, a standardised form of PDF that stores everything needed to display the document inside the file. An electronic invoice in a structured format should be kept as it arrived, because that file is the original. Always keep the attributes with it.
Can you tell us how long we must keep documents?
No. We are not lawyers or tax advisers, and we do not determine which period applies or whether an archive meets a legal requirement. That is for your accountant, tax adviser or lawyer. We set up the archive according to what they decide and show that it is in place.
Further reading
What the archive connects to.
Setting up an archive you can stand behind?
Send us the list of document types and periods your accountant has drawn up. We will tell you how to make that technically unalterable, findable and portable.
Practical IT knowledge in your inbox
New guides on management, security and the workplace, written by the people doing the work. No sales talk, and you can unsubscribe in one click.