pc storage

I mainly use the harddisks in the PCs I run for storage of Hidef movies and TV series.

Current storage situation

Machine	Bruto*	Redundancy	Netto*	Disks
livingroom PC	3.5TB	single disk	3.5TB	500GB Crucial MX500 SSD, 1TB Crucial MX500, 1.05TB MX300 Crucial, 1TB Samsung EVO970 nvme
livingroom HTPC	256GB	single disk	256GB	256GB Crucial M4 SSD
NasPC	112TB	60GB Boot 14x4T RAIDZ2 14x4T RAIDZ2	96TB	60GB Intel 330 series, 14x4TB Seagate, 14x4TB Seagate
NasPC2	96TB	120GB Boot 12x8T RAIDZ2	80TB	120GB Intel 330, 12x8TB Seagate Constellation
LinuxPC	36TB	SSD 30G for boot SSD 60G share 12x3TB RAIDZ2 ZFS	30TB	128GB Crucial C300 SSD, 12x3TB Seagate
ServerPC	5TB	SSD 120G for boot SSD 5x 1TB RAIDZ1 ZFS	4TB	120GB Crucial M500 SSD, 5x1.05TB Crucial SSD
Atom Low power PC (11W)	256GB	1x30GB boot 226G	226GB	500GB Crucial BX100 SSD (220G unformatted)
old pc win7	2.7TB	single disk	2.5TB	256GB Crucial M4 SSD, 480GB Crucial M500, 1x 2TB Seagate
Total:	255TB	.	215TB	.

I store all data to ZFS on Linux since version 0.6.2. Recently ZFS on Linux (0.8.6) was integrated in OpenZFS 2.0 sharing sourcecode with FreeBSD and Illumos the opensource version of Solaris where ZFS was first developed under Sun Microsystems. The previous LVM raid 0 volumes have been moved to ZFS pools with RAIDZ1 or RAIDZ2.
RAIDZ1 is like RAID5 and can withstand 1 disk breaking. RAIDZ2 can withstand 2 disks breaking. But after disk failure recovery is only needed for the data, not the entire disk so it is much quicker than plain RAID5 or RAID6.
ZFS keeps checksums on all data to ensure data integrity at all times. For RAIDZ1 there is the space of 1 spare disk, for RAIDZ2 (like RAID6) the space of 2 spare disks is needed and used for CRC data and other ZFS overhead data. Besides that ZFS/RAIDZ takes about 5% of the volume size for additional overhead.
Currently the 10x2T are retired and the healthy ones were sold.
I have 12x3T in raidz2, integrated in my linux desktop PC.
In Nas1 there are 14x4T in RAIDZ2 plus another 14x4T in RAIDZ2. So 2 pools with 1 vdev each.
In Nas2 I have 12x8T in RAIDZ2.
The always on XeonD server has 5x 1TB SSD in RAIDZ1.
I keep separate pools in order to be able to swap them out to different PC's. I have removed the 10x2T because 2 disks were failing and 3 more were pending failure. No data was lost.
The main NAS PC has 8 onboard sata interfaces and 24 extra sata interfaces through a sas card, there are 24 regular bays (2x10 + one 4in3 bay) and I have stacked 1 seperate 4 drive bay inside the case. Currently 28 bays are in use. The free PCI-E 4x slot is now used for a 10Gbe Intel X520-DA1 network card with SFP+.
The second NAS PC has 14 onboard sata interfaces, 1x for boot 12x in use for the data disks, 1x free sata. It has a 10Gbe Intel X520-DA2 network card with SFP+. It is managed via IPMI (Supermicro).
The XeonD has 6 sata interfaces. 1x boot plus 5x data. It has onboard 10Gbe RJ45. It also has IPMI (Supermicro) for management.

Disk inventory ::
12x Seagate 8.0TB : ST8000NM0055 (7200 rpm) (sata3, 256MB)
27x Seagate 4.0TB : ST4000DM000 (5900 rpm) (sata3, 64MB)
1x Seagate 4.0TB : ST4000DM005 (5900 rpm) (sata3, 64MB)
12x Seagate 3.0TB : ST3000DM001 (7200 rpm) (sata3, 64MB) (1x broken)
1x Seagate 3.0TB : ST3000DM007 (5900 rpm) (20mm thin disk,SMR,256MB)
9x Seagate 2.0TB : ST2000DL003 (5900 rpm) (sata3, 64MB) (2x broken)
1x Seagate 2.0TB : ST2000DM001 (7200 rpm)
2x Seagate 2.0TB : ST32000542AS (5900 rpm)
2x WesternDigital 2.0TB : WD20EARS Caviar Green 2TB, 64MB (1x broken)
4x Samsung 1.5TB : HD154UI Green (5400 rpm)
4x Seagate 1.5TB : ST31500341AS
6x Samsung 1TB : HD103UJ
5x Samsung 750G : HD753LJ
4x Samsung 500G : HD501LJ
7x SSD : 60GB + 120GB Intel 330 , 128GB Crucial C300, 2x 256GB Crucial M4, 120GB + 480GB Crucial M500
9x SSD : 6x 1TB Crucial MX300, 500GB Crucial BX100, 1x 1TB Crucial MX500, 1x 1TB Samsung EVO970 nvme
3x SSD external : 2x Samung T5 500GB usb-c and 1x Samsung T5 1TB usb-c

This table shows Linux kernel versions and ZFS/SPL versions used currently :

ZFS version (git zfs)	kernel	SPL	ZFS	OS version
atom64	5.15.38	none	none	Slackware 15.0
riwilinux	5.15.161	2.2.6-1	2.2.6-1	Slackware 15.0
riwinas	5.15.19	2.2.6-1	2.2.6-1	Slackware 15.0
riwinas2	5.15.19	2.2.6-1	2.2.6-1	Slackware 15.0
riwixeon	5.15.161	2.2.6-1	2.2.6-1	Slackware 15.0

This table shows the storage usage per pool:

drive

total

used

free

graph bar

riwilinux:/pool3

26639G

21021G

5618G

79%

riwinas:/pool4

43973G

38925G

5048G

89%

riwinas:/pool5

43973G

27876G

16097G

63%

riwinas2:/pool8

70680G

35075G

35605G

50%

riwixeon:/pool0

3948G

2215G

1733G

56%

total

189213G

125112G

64101G

66%

This table shows the health of each individual disk as well as some statistics.

device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwilinux:/dev/sda	-none	C300-CTFDDAC128MAG	00000000104602FF3866	none	6731	1040	0	0	0	2048
riwilinux:/dev/sdb	zfs-pool3	ST3000DM001-1CH166	Z1F1PTZ7	34 C	6419	1334	0	0	0	0
riwilinux:/dev/sdc	zfs-pool3	ST3000DM001-1CH166	Z1F31RN5	34 C	5536	1134	0	0	0	0
riwilinux:/dev/sdd	zfs-pool3	ST3000DM007-1WY10G	ZFN35WNB	36 C	299	97	0	0	0	0
riwilinux:/dev/sde	zfs-pool3	ST3000DM001-1CH166	Z1F1P72Z	34 C	6429	1342	0	0	0	0
riwilinux:/dev/sdf	zfs-pool3	ST3000DM001-1CH166	Z1F1PR6B	34 C	6429	1335	0	0	0	0
riwilinux:/dev/sdg	zfs-pool3	ST3000DM001-1CH166	Z1F1NLX9	35 C	6420	1336	0	0	0	0
riwilinux:/dev/sdh	zfs-pool3	ST3000DM001-1CH166	Z1F1QAT8	35 C	6425	1337	0	0	0	0
riwilinux:/dev/sdi	zfs-pool3	ST3000DM001-1CH166	Z1F1MLHG	34 C	6427	1334	0	0	0	0
riwilinux:/dev/sdj	zfs-pool3	ST3000DM001-1CH166	W1F39TEE	33 C	4629	971	0	0	0	0
riwilinux:/dev/sdk	zfs-pool3	ST3000DM001-1CH166	W1F39TEB	35 C	4620	969	0	0	0	0
riwilinux:/dev/sdl	zfs-pool3	ST3000DM001-1ER166	Z501H1Q7	34 C	1493	385	1	0	0	8
riwilinux:/dev/sdm	zfs-pool3	ST3000DM001-1ER166	Z501KWLN	34 C	1502	381	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwinas:/dev/sda	-none	INTEL SSDSC2CT060A3	CVMP215605Q1060AGN	none	12674	1825	0	0	0	0
riwinas:/dev/sdaa	zfs-pool5	ST4000DM000-1F2168	Z300V3KX	29 C	4559	830	0	0	0	0
riwinas:/dev/sdab	zfs-pool5	ST4000DM000-1F2168	Z3013WLW	30 C	4641	830	0	0	0	0
riwinas:/dev/sdac	zfs-pool4	ST4000DM000-1F2168	Z300K11N	31 C	8006	1566	0	0	0	0
riwinas:/dev/sdb	zfs-pool4	ST4000DM000-1F2168	Z301GP5Q	28 C	4023	825	0	0	0	0
riwinas:/dev/sdc	zfs-pool4	ST4000DM000-1F2168	Z301GE5S	28 C	4024	825	0	0	0	0
riwinas:/dev/sdd	zfs-pool4	ST4000DM000-1F2168	Z304WYTA	28 C	22	811	0	0	0	0
riwinas:/dev/sde	zfs-pool4	ST4000DM000-1F2168	Z303Y4ZP	28 C	22	808	0	0	0	0
riwinas:/dev/sdf	zfs-pool4	ST4000DM000-1F2168	Z300K08K	31 C	8021	1566	0	0	0	0
riwinas:/dev/sdg	zfs-pool5	ST4000DM000-1F2168	Z3013VNL	29 C	4612	828	0	0	0	0
riwinas:/dev/sdh	zfs-pool5	ST4000DM000-1F2168	Z300V3G1	29 C	4651	829	0	0	0	0
riwinas:/dev/sdi	zfs-pool5	ST4000DM000-1F2168	Z30146PF	29 C	4607	832	0	0	0	0
riwinas:/dev/sdj	zfs-pool4	ST4000DM000-1F2168	Z300MC1Z	31 C	8013	1566	0	0	0	0
riwinas:/dev/sdk	zfs-pool4	ST4000DM000-1F2168	Z300MB1C	31 C	8010	1566	0	0	0	0
riwinas:/dev/sdl	zfs-pool4	ST4000DM000-1F2168	Z300MB1L	31 C	8015	1566	0	0	0	0
riwinas:/dev/sdm	zfs-pool4	ST4000DM000-1F2168	Z300K0PQ	30 C	8015	1566	0	0	0	0
riwinas:/dev/sdn	zfs-pool5	ST4000DM000-1F2168	Z301GNNK	28 C	4160	760	0	0	0	0
riwinas:/dev/sdo	zfs-pool5	ST4000DM000-1F2168	Z301GDD3	28 C	4160	760	0	0	0	0
riwinas:/dev/sdp	zfs-pool5	ST4000DM000-1F2168	Z301GRFN	28 C	4161	760	0	0	0	0
riwinas:/dev/sdq	zfs-pool5	ST4000DM005-2DP166	ZDH1BGYF	27 C	2793	540	0	0	0	0
riwinas:/dev/sdr	zfs-pool4	ST4000DM000-1F2168	Z30156CH	30 C	6867	1362	0	0	0	0
riwinas:/dev/sds	zfs-pool4	ST4000DM000-1F2168	Z30147QZ	31 C	6869	1362	0	0	0	0
riwinas:/dev/sdt	zfs-pool4	ST4000DM000-1F2168	W300BMH0	31 C	7714	1502	0	0	0	0
riwinas:/dev/sdu	zfs-pool4	ST4000DM000-1F2168	W300G8KQ	30 C	7715	1502	0	0	0	0
riwinas:/dev/sdv	zfs-pool5	ST4000DM000-1F2168	Z3013VLC	29 C	4614	829	0	0	0	0
riwinas:/dev/sdw	zfs-pool5	ST4000DM000-1F2168	Z3013W9T	30 C	4613	830	0	0	0	0
riwinas:/dev/sdx	zfs-pool5	ST4000DM000-1F2168	Z3013YJL	29 C	4610	830	0	0	0	0
riwinas:/dev/sdy	zfs-pool5	ST4000DM000-1F2168	Z3013XE4	30 C	4562	830	0	0	0	0
riwinas:/dev/sdz	zfs-pool5	ST4000DM000-1F2168	Z300V342	29 C	4648	830	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwinas2:/dev/sda	-none	INTEL SSDSC2CT120A3	CVMP2152038G120BGN	none	20076	502	0	0	0	0
riwinas2:/dev/sdb	zfs-pool8	ST8000NM0055-1RM112	ZA174S1D	37 C	858	235	0	0	0	0
riwinas2:/dev/sdc	zfs-pool8	ST8000NM0055-1RM112	ZA16ZH1W	38 C	885	235	0	0	0	0
riwinas2:/dev/sdd	zfs-pool8	ST8000NM0055-1RM112	ZA174RC1	38 C	899	235	0	0	0	0
riwinas2:/dev/sde	zfs-pool8	ST8000NM0055-1RM112	ZA16ZE7L	41 C	884	235	0	0	0	0
riwinas2:/dev/sdf	zfs-pool8	ST8000NM0055-1RM112	ZA174RLC	42 C	884	235	0	0	0	0
riwinas2:/dev/sdg	zfs-pool8	ST8000NM0055-1RM112	ZA174RMR	42 C	729	285	0	0	0	0
riwinas2:/dev/sdh	zfs-pool8	ST8000NM0055-1RM112	ZA174RV2	42 C	733	235	0	0	0	0
riwinas2:/dev/sdi	zfs-pool8	ST8000NM0055-1RM112	ZA16ZRXH	42 C	719	281	0	0	0	0
riwinas2:/dev/sdj	zfs-pool8	ST8000NM0055-1RM112	ZA174RDB	40 C	731	291	0	0	0	0
riwinas2:/dev/sdk	zfs-pool8	ST8000NM0055-1RM112	ZA15H4W8	42 C	735	235	0	0	0	0
riwinas2:/dev/sdl	zfs-pool8	ST8000NM0055-1RM112	ZA174RE6	41 C	719	284	0	0	0	0
riwinas2:/dev/sdm	zfs-pool8	ST8000NM0055-1RM112	ZA174SDG	41 C	725	235	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwixeon:/dev/sda	-none	Crucial_CT120M500SSD1	1308092BD91E	37 C	82772	76	0	0	0	0
riwixeon:/dev/sdb	zfs-pool0	Crucial_CT1050MX300SSD1	163813FCCF24	40 C	75005	28	0	0	0	1
riwixeon:/dev/sdc	zfs-pool0	Crucial_CT1050MX300SSD1	163813FCD7FE	40 C	75005	28	0	0	0	0
riwixeon:/dev/sdd	zfs-pool0	Crucial_CT1050MX300SSD1	1631137A4205	38 C	73552	29	0	0	0	0
riwixeon:/dev/sde	zfs-pool0	Crucial_CT1050MX300SSD1	1631137A1D38	37 C	73593	28	0	0	0	1
riwixeon:/dev/sdf	zfs-pool0	Crucial_CT1050MX300SSD1	163813FCCD4D	38 C	74289	29	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
atom64:/dev/sda	-none	CT500BX100SSD1	1449F000999E	34 C	1748	26	0	0	0	0