raw# zpool status -v
pool: serverh
state: ONLINE
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A
scan: resilvered 0B in 02:02:41 with 0 errors on Sat Dec 17 17:29:15 2022
config:
NAME STATE READ WRITE CKSUM
serverh ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
3c8b2333-7b7a-46f8-b515-d9163679a83b ONLINE 0 0 4
973f071f-ecf4-47da-a2c7-243d918cbbc7 ONLINE 0 0 4
special
mirror-3 ONLINE 0 0 0
84ea3d26-04 ONLINE 0 0 0
61b88409-04 ONLINE 0 0 0
logs
mirror-2 ONLINE 0 0 0
84ea3d26-01 ONLINE 0 0 0
61b88409-01 ONLINE 0 0 0
cache
84ea3d26-03 ONLINE 0 0 0
61b88409-03 ONLINE 0 0 0
errors: Permanent errors have been detected in the following files:
serverh/virt-windowsvm1:<0x1>
pool: servers
state: ONLINE
status: Some supported and requested features are not enabled on the pool.
The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(7) for details.
scan: scrub repaired 0B in 00:00:15 with 0 errors on Sun Dec 11 00:24:20 2022
config:
NAME STATE READ WRITE CKSUM
servers ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
84ea3d26-02 ONLINE 0 0 0
61b88409-02 ONLINE 0 0 0
errors: No known data errors
# zfs get all | grep windows
serverh/virt-windowsvm0 type volume -
serverh/virt-windowsvm0 creation Fri Dec 2 11:48 2022 -
serverh/virt-windowsvm0 used 24.2G -
serverh/virt-windowsvm0 available 354G -
serverh/virt-windowsvm0 referenced 19.8G -
serverh/virt-windowsvm0 compressratio 1.19x -
serverh/virt-windowsvm0 reservation none default
serverh/virt-windowsvm0 volsize 40G local
serverh/virt-windowsvm0 volblocksize 8K default
serverh/virt-windowsvm0 checksum on default
serverh/virt-windowsvm0 compression lz4 inherited from serverh
serverh/virt-windowsvm0 readonly off default
serverh/virt-windowsvm0 createtxg 10406178 -
serverh/virt-windowsvm0 copies 1 default
serverh/virt-windowsvm0 refreservation none local
serverh/virt-windowsvm0 guid 11207487241737076084 -
serverh/virt-windowsvm0 primarycache all default
serverh/virt-windowsvm0 secondarycache all default
serverh/virt-windowsvm0 usedbysnapshots 4.41G -
serverh/virt-windowsvm0 usedbydataset 19.8G -
serverh/virt-windowsvm0 usedbychildren 0B -
serverh/virt-windowsvm0 usedbyrefreservation 0B -
serverh/virt-windowsvm0 logbias latency default
serverh/virt-windowsvm0 objsetid 13322 -
serverh/virt-windowsvm0 dedup off default
serverh/virt-windowsvm0 mlslabel none default
serverh/virt-windowsvm0 sync always local
serverh/virt-windowsvm0 refcompressratio 1.20x -
serverh/virt-windowsvm0 written 13.8G -
serverh/virt-windowsvm0 logicalused 28.6G -
serverh/virt-windowsvm0 logicalreferenced 23.6G -
serverh/virt-windowsvm0 volmode default default
serverh/virt-windowsvm0 snapshot_limit none default
serverh/virt-windowsvm0 snapshot_count none default
serverh/virt-windowsvm0 snapdev hidden default
serverh/virt-windowsvm0 context none default
serverh/virt-windowsvm0 fscontext none default
serverh/virt-windowsvm0 defcontext none default
serverh/virt-windowsvm0 rootcontext none default
serverh/virt-windowsvm0 redundant_metadata all default
serverh/virt-windowsvm0 encryption aes-256-gcm -
serverh/virt-windowsvm0 keylocation none default
serverh/virt-windowsvm0 keyformat raw -
serverh/virt-windowsvm0 pbkdf2iters 0 default
serverh/virt-windowsvm0 encryptionroot serverh -
serverh/virt-windowsvm0 keystatus available -
serverh/virt-windowsvm0@20221203_fresh_install type snapshot -
serverh/virt-windowsvm0@20221203_fresh_install creation Sat Dec 3 19:34 2022 -
serverh/virt-windowsvm0@20221203_fresh_install used 4.41G -
serverh/virt-windowsvm0@20221203_fresh_install referenced 10.4G -
serverh/virt-windowsvm0@20221203_fresh_install compressratio 1.14x -
serverh/virt-windowsvm0@20221203_fresh_install volsize 40G local
serverh/virt-windowsvm0@20221203_fresh_install createtxg 10439575 -
serverh/virt-windowsvm0@20221203_fresh_install guid 14956087430293257985 -
serverh/virt-windowsvm0@20221203_fresh_install primarycache all default
serverh/virt-windowsvm0@20221203_fresh_install secondarycache all default
serverh/virt-windowsvm0@20221203_fresh_install defer_destroy off -
serverh/virt-windowsvm0@20221203_fresh_install userrefs 0 -
serverh/virt-windowsvm0@20221203_fresh_install objsetid 46535 -
serverh/virt-windowsvm0@20221203_fresh_install mlslabel none default
serverh/virt-windowsvm0@20221203_fresh_install refcompressratio 1.14x -
serverh/virt-windowsvm0@20221203_fresh_install written 10.4G -
serverh/virt-windowsvm0@20221203_fresh_install logicalreferenced 11.8G -
serverh/virt-windowsvm0@20221203_fresh_install context none default
serverh/virt-windowsvm0@20221203_fresh_install fscontext none default
serverh/virt-windowsvm0@20221203_fresh_install defcontext none default
serverh/virt-windowsvm0@20221203_fresh_install rootcontext none default
serverh/virt-windowsvm0@20221203_fresh_install encryption aes-256-gcm -
serverh/virt-windowsvm0@20221203_fresh_install encryptionroot serverh -
serverh/virt-windowsvm0@20221203_fresh_install keystatus available -
serverh/virt-windowsvm1 type volume -
serverh/virt-windowsvm1 creation Sat Dec 3 19:41 2022 -
serverh/virt-windowsvm1 used 183G -
serverh/virt-windowsvm1 available 354G -
serverh/virt-windowsvm1 referenced 183G -
serverh/virt-windowsvm1 compressratio 1.00x -
serverh/virt-windowsvm1 reservation none default
serverh/virt-windowsvm1 volsize 400G local
serverh/virt-windowsvm1 volblocksize 8K default
serverh/virt-windowsvm1 checksum on default
serverh/virt-windowsvm1 compression lz4 inherited from serverh
serverh/virt-windowsvm1 readonly off default
serverh/virt-windowsvm1 createtxg 10439708 -
serverh/virt-windowsvm1 copies 1 default
serverh/virt-windowsvm1 refreservation none local
serverh/virt-windowsvm1 guid 2664709986551831935 -
serverh/virt-windowsvm1 primarycache all default
serverh/virt-windowsvm1 secondarycache all default
serverh/virt-windowsvm1 usedbysnapshots 0B -
serverh/virt-windowsvm1 usedbydataset 183G -
serverh/virt-windowsvm1 usedbychildren 0B -
serverh/virt-windowsvm1 usedbyrefreservation 0B -
serverh/virt-windowsvm1 logbias latency default
serverh/virt-windowsvm1 objsetid 46423 -
serverh/virt-windowsvm1 dedup off default
serverh/virt-windowsvm1 mlslabel none default
serverh/virt-windowsvm1 sync always local
serverh/virt-windowsvm1 refcompressratio 1.00x -
serverh/virt-windowsvm1 written 183G -
serverh/virt-windowsvm1 logicalused 182G -
serverh/virt-windowsvm1 logicalreferenced 182G -
serverh/virt-windowsvm1 volmode default default
serverh/virt-windowsvm1 snapshot_limit none default
serverh/virt-windowsvm1 snapshot_count none default
serverh/virt-windowsvm1 snapdev hidden default
serverh/virt-windowsvm1 context none default
serverh/virt-windowsvm1 fscontext none default
serverh/virt-windowsvm1 defcontext none default
serverh/virt-windowsvm1 rootcontext none default
serverh/virt-windowsvm1 redundant_metadata all default
serverh/virt-windowsvm1 encryption aes-256-gcm -
serverh/virt-windowsvm1 keylocation none default
serverh/virt-windowsvm1 keyformat raw -
serverh/virt-windowsvm1 pbkdf2iters 0 default
serverh/virt-windowsvm1 encryptionroot serverh -
serverh/virt-windowsvm1 keystatus available -
# dmesg | grep 'Buffer I/O ' | tail
[624196.254744] Buffer I/O error on dev zd0, logical block 42448516, async page read
[624197.263609] Buffer I/O error on dev zd0, logical block 42448516, async page read
[624198.264699] Buffer I/O error on dev zd0, logical block 42448516, async page read
[624198.265712] Buffer I/O error on dev zd0, logical block 42448516, async page read
[624199.329293] Buffer I/O error on dev zd0, logical block 42448516, async page read
[624200.336659] Buffer I/O error on dev zd0, logical block 42448516, async page read
[624201.342334] Buffer I/O error on dev zd0, logical block 42448516, async page read
[624202.346839] Buffer I/O error on dev zd0, logical block 42448516, async page read
[708214.312688] Buffer I/O error on dev zd0, logical block 42025802, async page read
[708214.772361] Buffer I/O error on dev zd0, logical block 42025802, async page read
# zgrep 'Buffer I/O error on dev' syslog* | awk '{ print $15 }' | sort | uniq -c
35 42025802,
1 42025803,
79 42052336,
7 42052337,
155 42345494,
53 42369212,
6 42369213,
21 42448516,
1 42448517,
4 43413716,
11 44048162,
5 45643964,
# dpkg -l | grep -e linux -e zfs
ii binutils-x86-64-linux-gnu 2.35.2-2 amd64 GNU binary utilities, for x86-64-linux-gnu target
ii console-setup-linux 1.205 all Linux specific part of console-setup
ii firmware-linux-free 20200122-1 all Binary firmware for various drivers in the Linux kernel
ii libnvpair3linux 2.1.6-3~bpo11+1 amd64 Solaris name-value library for Linux
ii libselinux1:amd64 3.1-3 amd64 SELinux runtime shared libraries
ii libuutil3linux 2.1.6-3~bpo11+1 amd64 Solaris userland utility library for Linux
ii libvirt-daemon-driver-storage-zfs 7.0.0-3 amd64 Virtualization daemon ZFS storage driver
ii libzfs4linux 2.1.6-3~bpo11+1 amd64 OpenZFS filesystem library for Linux - general support
ii libzpool5linux 2.1.6-3~bpo11+1 amd64 OpenZFS pool library for Linux
ii linux-base 4.6 all Linux image base package
ii linux-compiler-gcc-10-x86 5.10.149-2 amd64 Compiler for Linux on x86 (meta-package)
ii linux-headers-5.10.0-19-amd64 5.10.149-2 amd64 Header files for Linux 5.10.0-19-amd64
ii linux-headers-5.10.0-19-common 5.10.149-2 all Common header files for Linux 5.10.0-19
ii linux-headers-6.0.0-0.deb11.2-amd64 6.0.3-1~bpo11+1 amd64 Header files for Linux 6.0.0-0.deb11.2-amd64
ii linux-headers-6.0.0-0.deb11.2-common 6.0.3-1~bpo11+1 all Common header files for Linux 6.0.0-0.deb11.2
ii linux-headers-amd64 6.0.3-1~bpo11+1 amd64 Header files for Linux amd64 configuration (meta-package)
ii linux-image-5.10.0-19-amd64 5.10.149-2 amd64 Linux 5.10 for 64-bit PCs (signed)
ii linux-image-6.0.0-0.deb11.2-amd64 6.0.3-1~bpo11+1 amd64 Linux 6.0 for 64-bit PCs (signed)
ii linux-image-amd64 6.0.3-1~bpo11+1 amd64 Linux for 64-bit PCs (meta-package)
ii linux-kbuild-5.10 5.10.149-2 amd64 Kbuild infrastructure for Linux 5.10
ii linux-kbuild-6.0 6.0.3-1~bpo11+1 amd64 Kbuild infrastructure for Linux 6.0
ii linux-libc-dev:amd64 5.10.149-2 amd64 Linux support headers for userspace development
ii util-linux 2.36.1-8+deb11u1 amd64 miscellaneous system utilities
ii zfs-dkms 2.1.6-3~bpo11+1 all OpenZFS filesystem kernel modules for Linux
ii zfsutils-linux 2.1.6-3~bpo11+1 amd64 command-line tools to manage OpenZFS filesystems
# uname -a
Linux server.example.com 6.0.0-0.deb11.2-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.0.3-1~bpo11+1 (2022-10-29) x86_64 GNU/Linux
# smartctl -a /dev/sda
smartctl 7.2 2020-12-30 r5155 [x86_64-linux-6.0.0-0.deb11.2-amd64] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Toshiba 3.5" MG04ACA... Enterprise HDD
Device Model: TOSHIBA MG04ACA400EY
Serial Number: Y7MPK03FF7GB
LU WWN Device Id: 5 000039 82c302228
Firmware Version: FQ1B
User Capacity: 4,000,787,030,016 bytes [4.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 7200 rpm
Form Factor: 3.5 inches
Device is: In smartctl database [for details use: -P show]
ATA Version is: ATA8-ACS (minor revision not indicated)
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Sat Dec 17 20:39:44 2022 UTC
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 120) seconds.
Offline data collection
capabilities: (0x5b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
No Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 473) minutes.
SCT capabilities: (0x003d) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000b 100 100 050 Pre-fail Always - 0
2 Throughput_Performance 0x0005 100 100 050 Pre-fail Offline - 0
3 Spin_Up_Time 0x0027 100 100 001 Pre-fail Always - 7206
4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 26
5 Reallocated_Sector_Ct 0x0033 100 100 050 Pre-fail Always - 0
7 Seek_Error_Rate 0x000b 100 100 050 Pre-fail Always - 0
8 Seek_Time_Performance 0x0005 100 100 050 Pre-fail Offline - 0
9 Power_On_Hours 0x0032 007 007 000 Old_age Always - 37517
10 Spin_Retry_Count 0x0033 100 100 030 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 25
191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 1436322
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 11
193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 257
194 Temperature_Celsius 0x0022 100 100 000 Old_age Always - 35 (Min/Max 23/51)
196 Reallocated_Event_Count 0x0032 100 100 000 Old_age Always - 0
197 Current_Pending_Sector 0x0032 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0030 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0
220 Disk_Shift 0x0002 100 100 000 Old_age Always - 0
222 Loaded_Hours 0x0032 007 007 000 Old_age Always - 37353
223 Load_Retry_Count 0x0032 100 100 000 Old_age Always - 0
224 Load_Friction 0x0022 100 100 000 Old_age Always - 0
226 Load-in_Time 0x0026 100 100 000 Old_age Always - 632
240 Head_Flying_Hours 0x0001 100 100 001 Pre-fail Offline - 0
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error
# 1 Short offline Completed without error 00% 9767 -
# 2 Short offline Completed without error 00% 9766 -
# 3 Extended offline Completed without error 00% 9764 -
# 4 Short offline Completed without error 00% 9753 -
# 5 Extended offline Completed without error 00% 9739 -
# 6 Short offline Completed without error 00% 9728 -
# 7 Extended offline Completed without error 00% 9713 -
# 8 Extended offline Completed without error 00% 9694 -
# 9 Short offline Completed without error 00% 1 -
#10 Short offline Completed without error 00% 0 -
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
# smartctl -a /dev/sdb
smartctl 7.2 2020-12-30 r5155 [x86_64-linux-6.0.0-0.deb11.2-amd64] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Toshiba 3.5" MG04ACA... Enterprise HDD
Device Model: TOSHIBA MG04ACA400EY
Serial Number: Y7MTK02FF7GB
LU WWN Device Id: 5 000039 82c501b20
Firmware Version: FQ1B
User Capacity: 4,000,787,030,016 bytes [4.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 7200 rpm
Form Factor: 3.5 inches
Device is: In smartctl database [for details use: -P show]
ATA Version is: ATA8-ACS (minor revision not indicated)
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Sat Dec 17 20:39:45 2022 UTC
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 120) seconds.
Offline data collection
capabilities: (0x5b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
No Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 477) minutes.
SCT capabilities: (0x003d) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000b 100 100 050 Pre-fail Always - 0
2 Throughput_Performance 0x0005 100 100 050 Pre-fail Offline - 0
3 Spin_Up_Time 0x0027 100 100 001 Pre-fail Always - 7015
4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 26
5 Reallocated_Sector_Ct 0x0033 100 100 050 Pre-fail Always - 0
7 Seek_Error_Rate 0x000b 100 100 050 Pre-fail Always - 0
8 Seek_Time_Performance 0x0005 100 100 050 Pre-fail Offline - 0
9 Power_On_Hours 0x0032 007 007 000 Old_age Always - 37555
10 Spin_Retry_Count 0x0033 100 100 030 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 25
191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 15220635
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 13
193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 269
194 Temperature_Celsius 0x0022 100 100 000 Old_age Always - 32 (Min/Max 22/51)
196 Reallocated_Event_Count 0x0032 100 100 000 Old_age Always - 0
197 Current_Pending_Sector 0x0032 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0030 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x0032 200 253 000 Old_age Always - 0
220 Disk_Shift 0x0002 100 100 000 Old_age Always - 0
222 Loaded_Hours 0x0032 007 007 000 Old_age Always - 37359
223 Load_Retry_Count 0x0032 100 100 000 Old_age Always - 0
224 Load_Friction 0x0022 100 100 000 Old_age Always - 0
226 Load-in_Time 0x0026 100 100 000 Old_age Always - 639
240 Head_Flying_Hours 0x0001 100 100 001 Pre-fail Offline - 0
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error
# 1 Short offline Completed without error 00% 9805 -
# 2 Short offline Completed without error 00% 9804 -
# 3 Extended offline Completed without error 00% 9802 -
# 4 Short offline Completed without error 00% 9791 -
# 5 Extended offline Completed without error 00% 9735 -
# 6 Short offline Completed without error 00% 9720 -
# 7 Extended offline Completed without error 00% 9713 -
# 8 Extended offline Completed without error 00% 9694 -
# 9 Short offline Completed without error 00% 1 -
#10 Short offline Completed without error 00% 0 -
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
# zpool history serverh
History for 'serverh':
2021-10-12.08:15:27 zpool create -o ashift=12 -O encryption=aes-256-gcm -O keylocation=file:///usr/share/zfs_key.wpool -O keyformat=raw -O acltype=posixacl -O compression=lz4 -O dnodesize=auto -O normalization=formD -O relatime=on -O xattr=sa -O mountpoint=none serverh /dev/disk/by-partuuid/3c8b2333-7b7a-46f8-b515-d9163679a83b
2021-10-12.08:15:56 zfs create -o mountpoint=/mnt/new/home serverh/home
2021-10-12.08:16:00 zfs create -o mountpoint=/mnt/new/var serverh/var
2021-10-12.08:16:05 zfs create -o mountpoint=/mnt/new/lxc serverh/lxc
2021-10-12.08:16:09 zfs create serverh/lxc/mail
2021-10-12.08:16:09 zfs create serverh/lxc/misc
2021-10-12.08:16:15 zfs create serverh/lxc/web
2021-10-14.21:45:59 zfs set mountpoint=/home serverh/home
2021-10-14.21:46:06 zfs set mountpoint=/var serverh/var
2021-10-14.21:47:37 zpool import -c /etc/zfs/zpool.cache -aN
2021-10-14.21:47:37 zfs load-key -a
2021-10-14.21:52:46 zpool import -c /etc/zfs/zpool.cache -aN
2021-10-14.21:52:46 zfs load-key -a
2021-10-14.21:58:16 zpool import -c /etc/zfs/zpool.cache -aN
2021-10-14.21:58:16 zfs load-key -a
2021-10-14.22:13:44 zpool import -c /etc/zfs/zpool.cache -aN
2021-10-14.22:13:44 zfs load-key -a
2021-10-14.22:20:37 zpool import -c /etc/zfs/zpool.cache -aN
2021-10-14.22:20:37 zfs load-key -a
2021-10-14.22:53:34 zpool import -c /etc/zfs/zpool.cache -aN
2021-10-14.22:53:34 zfs load-key -a
2021-10-14.22:54:54 zfs create -o mountpoint=/mnt/new/tmp serverh/tmp
2021-10-14.22:56:32 zfs set mountpoint=/tmp serverh/tmp
2021-10-14.22:58:09 zpool import -c /etc/zfs/zpool.cache -aN
2021-10-14.22:58:09 zfs load-key -a
2021-10-14.23:14:44 zpool add serverh log /dev/disk/by-partuuid/84ea3d26-01
2021-10-14.23:15:04 zpool add serverh cache /dev/disk/by-partuuid/84ea3d26-03
2021-10-14.23:43:35 zfs set mountpoint=/lxc/mail serverh/lxc/mail
2021-10-17.10:26:25 zfs set mountpoint=/lxc/web serverh/lxc/web
2021-10-17.11:51:03 zpool set autotrim=on serverh
2021-10-18.22:13:44 zfs set mountpoint=/lxc/misc serverh/lxc/misc
2021-10-18.22:24:23 zfs set mountpoint=/mnt/new/lxc/misc serverh/lxc/misc
2021-10-19.08:09:47 zfs create -o mountpoint=/mnt/new/lxc/experimental serverh/lxc/experimental
2021-10-19.21:31:57 zfs set mountpoint=/lxc/misc serverh/lxc/misc
2021-10-19.21:37:47 zfs create -o mountpoint=/lxc/misc/rootfs/var/lib/docker serverh/lxc/misc-docker
2021-10-19.21:58:48 zfs destroy serverh/lxc/misc-docker
2021-10-19.22:34:08 zfs set mountpoint=/lxc/experimental serverh/lxc/experimental
2021-10-19.22:39:34 zfs set mountpoint=/lxc serverh/lxc
2021-10-20.21:04:32 zpool attach serverh /dev/disk/by-partuuid/84ea3d26-01 /dev/disk/by-partuuid/61b88409-01
2021-10-20.21:50:34 zpool add serverh cache /dev/disk/by-partuuid/61b88409-03
2021-10-20.21:52:19 zpool attach serverh /dev/disk/by-partuuid/3c8b2333-7b7a-46f8-b515-d9163679a83b /dev/disk/by-partuuid/973f071f-ecf4-47da-a2c7-243d918cbbc7
2021-11-14.00:24:08 zpool scrub serverh
2021-12-12.00:24:09 zpool scrub serverh
2022-01-09.00:24:12 zpool scrub serverh
2022-02-13.00:24:12 zpool scrub serverh
2022-03-13.00:24:09 zpool scrub serverh
2022-04-10.00:24:04 zpool scrub serverh
2022-05-08.00:24:10 zpool scrub serverh
2022-06-12.00:24:10 zpool scrub serverh
2022-07-10.00:24:09 zpool scrub serverh
2022-08-14.00:24:06 zpool scrub serverh
2022-09-11.00:24:05 zpool scrub serverh
2022-10-09.00:24:10 zpool scrub serverh
2022-11-13.00:24:12 zpool scrub serverh
2022-12-01.21:44:25 zfs create -o mountpoint=/lxc/virt serverh/lxc/virt
2022-12-02.11:40:24 zfs create -o mountpoint=/var/lib/libvirt serverh/libvirt
2022-12-02.11:47:23 zfs create -V 41943040K serverh/windowsvm0
2022-12-02.11:48:02 zfs destroy serverh/windowsvm0
2022-12-02.11:48:12 zfs create -V 41943040K serverh/virt-windowsvm0
2022-12-03.19:34:35 zfs snap serverh/virt-windowsvm0@20221203_fresh_install
2022-12-03.19:41:21 zfs create -V 419430400K serverh/virt-windowsvm1
2022-12-05.10:13:28 zfs destroy serverh/lxc/virt
2022-12-06.17:45:02 zfs set sync=always serverh/virt-windowsvm0
2022-12-06.17:45:07 zfs set sync=always serverh/virt-windowsvm1
2022-12-11.00:24:04 zpool scrub serverh
2022-12-17.13:47:22 zfs rename serverh/virt-windowsvm0 serverh/virt-windowsvm0.old
2022-12-17.14:41:21 zfs rename serverh/virt-windowsvm0.old serverh/virt-windowsvm0
2022-12-17.14:42:50 zfs clone serverh/virt-windowsvm0@20221203_fresh_install serverh/virt-windowsvm0-fresh
2022-12-17.14:45:45 zfs set refreservation=none serverh/virt-windowsvm1
2022-12-17.14:46:19 zfs set refreservation=none serverh/virt-windowsvm0
2022-12-17.15:19:29 zpool detach serverh 84ea3d26-01
2022-12-17.15:20:54 zpool remove serverh 61b88409-01
2022-12-17.15:26:12 zpool add serverh log /dev/disk/by-partuuid/84ea3d26-01
2022-12-17.15:26:41 zpool attach serverh /dev/disk/by-partuuid/84ea3d26-01 /dev/disk/by-partuuid/61b88409-01
2022-12-17.15:31:36 zpool add serverh -o ashift=12 special mirror /dev/disk/by-partuuid/84ea3d26-04 /dev/disk/by-partuuid/61b88409-04
2022-12-17.17:38:25 zpool clear serverh
2022-12-17.20:14:57 zfs destroy serverh/virt-windowsvm0-fresh