Public Protocol
Platform

Element 13.19

Storage and data durability on reused disks

Sheet
13.19
Chapter
13 Digital infrastructure
State
Drafted
Release
16 November 2026
Editor
Contributed by Praecise as open research
Reviewers
To be named at review
Safety
S1, as the chapter
Licence
CC BY-SA 4.0
Resources
8

The element

Requirement

The community's data survives the failure of any single disk or machine on the storage itself, damaged data is detected rather than silently served, and backups follow the 3-2-1 rule.

How to tell
  • The storage layout tolerates at least one disk failure. In ZFS, a mirror of N disks survives N-1 failures and RAID-Z with P parity disks survives P failures (zpoolconcepts: overview of ZFS storage pools).
  • Data is checksummed: ZFS checksums all data and metadata and repairs bad data from a good copy where redundancy exists (zpoolconcepts: overview of ZFS storage pools).
  • Disk health is monitored continuously (smartmontools).
  • Backups meet the 3-2-1 rule as CISA states it: three copies of important files, on two different types of storage media, with one copy stored off site; with scheduled recovery tests and the ability to roll back at least seven days (Back Up Business Data).
Options
  • ZFS on one machine. Mirrors, RAID-Z with one to three parity disks, dRAID with distributed spares and faster rebuilding, and hot spares (zpoolconcepts: overview of ZFS storage pools). OpenZFS recommends at least 2 GB of memory and calls ECC memory highly recommended (OpenZFS FAQ).
  • Ceph across several machines. Distributed storage across hosts; its guidance states that more, smaller nodes are safer than fewer, denser ones, and advises bonded links across two switches (Ceph hardware recommendations).
  • Hardware RAID controllers. Proxmox states that neither ZFS nor Ceph is compatible with a hardware RAID controller (Proxmox VE System Requirements); use either a hardware RAID or one of these, not both.
  • Reuse of disks. Memory and storage are a large share of embodied carbon in the systems studied (Sustainability in HPC: Vision and Opportunities); disks that pass health checks are worth keeping in service, inside a redundant layout.
Settled, open, contested

Settled. Redundancy is not backup; the 3-2-1 rule and tested restores are agreed guidance (Back Up Business Data). Checksumming file systems detect silent damage (zpoolconcepts: overview of ZFS storage pools). Open. How long reused disks of a given age last in community service is not documented in the sources opened. Contested. ZFS on one host against Ceph across several: ZFS is simpler to run; Ceph survives the loss of a whole host but asks for more machines, more network and more skill (Ceph hardware recommendations).

The four stages

Resources at each stage

What changes between 30 adults and 300 people

At 30 adults one machine with a two-disk mirror and the backups of 13.5 is enough. At 300 people storage is either a larger RAID-Z pool with spares or Ceph across three or more hosts (Ceph hardware recommendations), with its own monitoring and a rota for disk replacement.

Reference designs

Open for contributions Designs with drawings, specifications and a bill of materials. Add to it

Parts list

Every resource that supports this element. Those marked External carry the label “External resource. Not made or verified by Public Protocol”.

ResourceTypeOriginMaturitySafetyLicence, as stated at its source
Ceph hardware recommendationsGuideExternalEstablishedS1Not stated on the page opened
Back Up Business DataGuideExternalEstablishedS1Not stated on the page opened
Dell EMC PowerEdge R740 Technical Specifications: environmental specificationsGuideExternalEstablishedS0Not stated on the page opened
OpenZFS FAQGuideExternalEstablishedS1Not stated on the page opened
zpoolconcepts: overview of ZFS storage poolsGuideExternalEstablishedS1Not stated on the page opened
Proxmox VE System RequirementsGuideExternalEstablishedS0Not stated on the page opened
smartmontoolsToolExternalEstablishedS0GNU General Public License, version 2
Sustainability in HPC: Vision and OpportunitiesPaperExternalConceptS0Not stated on the page opened

Depends on, and completes

Depends on 13.5, 13.4.

It is one of 25 elements that complete Digital infrastructure.

The standing questions

Who can afford this: redundancy doubles or more the disks needed. Who does the work: a keeper who reads disk alerts and swaps disks. Who decides: what data is stored and for how long (13.4, 15.4).

Environments

No source found on how storage choices change by setting. Heat and humidity limits for the machines that hold the disks are in the server room element (Dell EMC PowerEdge R740 Technical Specifications: environmental specifications).

Safety

State and evidence

Drafted

An editor has written the element's text from the resources listed under it, citing them. It is checked when it is reviewed.

Evidence from a real place or system is recorded here, with what did not work. What the states mean

History