i wonder if i could move my NVME #zfs zpool to a Thunderbolt-equipped NAS like the #ugreen models, install #trueNAS Scale, and slide my NVME flash storage pool to a filer, instead of my creative workstation, which would free up 4-8 lanes on PCI-E for me?
current mood: pool compatibility flags for zfs-on-#macOS
How's this for click bait?
Remember that resilver I did a week or so ago? I have to do it again. I messed up. The cause of the mess up was not something I did during the replace/resilver. It was something I did 19 months ago.
https://dan.langille.org/2025/04/21/what-drive-did-i-just-remove-from-the-system/
This is a typical FreshPorts daily database backup being rsync'd from AWS to the #homelab :
It just so happens the the output of pg_dump for the #PostgreSQL database more-or-less keeps the data in the same order each time. So the actual daily transfer SEEMS to be only the new data.
On disk, I rely upon #ZFS compression to do the disk savings for me. That compression also speeds up disk throughput - the CPU can uncompressed faster than the disk can provide the data.
In today's case, the amount copied down seems to be 360MB.
This speed-up by rsync, which recognizes what has and has not been transferred, is also why do not dump in compressed mode.
dumping freshports.org
receiving incremental file list
postgresql/
postgresql/freshports.org.dump
3,621,784,708 100% 77.73MB/s 0:00:44 (xfr#1, to-chk=1/4)
postgresql/globals.sql
3,963 100% 58.64kB/s 0:00:00 (xfr#2, to-chk=0/4)
Number of files: 4 (reg: 2, dir: 2)
Number of created files: 0
Number of deleted files: 0
Number of regular files transferred: 2
Total file size: 3,621,788,671 bytes
Total transferred file size: 3,621,788,671 bytes
Literal data: 355,867,046 bytes
Matched data: 3,265,921,625 bytes
File list size: 142
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 481,559
Total bytes received: 356,171,297
sent 481,559 bytes received 356,171,297 bytes 6,925,298.17 bytes/sec
total size is 3,621,788,671 speedup is 10.15
Latest 𝗩𝗮𝗹𝘂𝗮𝗯𝗹𝗲 𝗡𝗲𝘄𝘀 - 𝟮𝟬𝟮𝟱/𝟬𝟰/𝟮𝟭 (Valuable News - 2025/04/21) available.
https://vermaden.wordpress.com/2025/04/21/valuable-news-2025-04-21/
Past releases: https://vermaden.wordpress.com/news/
OpenZFS is great and it comes with awesome features. But for newbies or even users who don’t use all the features every day, it can be sometimes a little bit overwhelming.
The FreeBSD foundation has generously created an OpenZFS cheat cheat covering all the basic stuff that is important in daily use.
Great work and worth sharing!
As expected, #Kubuntu 25.04 is an awesome #KDE #Plasma 6.3 showcase! I installed it yesterday with a #ZFS + #ZFSBootMenu setup and I love it!
RAID vs ZFS
RAID: tecnología que agrupa discos para mejorar rendimiento o seguridad según el nivel que elijas (RAID 0, 1, etc.). Es simple, útil y eficiente para muchas tareas.
ZFS : sistema de archivos + gestor de volúmenes que incluye su propio tipo de RAID, snapshots, compresión, verificación de integridad...
¿Lo básico? RAID.
¿Potencia y control? ZFS es el camino.
Descubre más en nuestra sección de tutoriales en la web:
https://slimbook.com/blog/tutoriales-2/post/raid-y-zfs-que-son-y-para-que-sirven-453
SDDM, KDE Plasma, root-on-OpenZFS – simple. On Linux.
Yes, I'll install the theme snaps.
Will I install zectl – a ZFS boot environment manager for Linux? Maybe …
<https://ramsdenj.com/posts/2020-03-18-zectl-zfs-boot-environment-manager-for-linux/> | <https://github.com/johnramsden/zectl>
@vermaden @justine
Addendum: prefix "pkg upgrade" with "make-snapshots" to be able to rollback the file systems(s) without fuss ...
make-snapshots \
&& pkg upgrade && make-snapshots \
&& pkg autoremove && make-snapshots \
&& pkg clean && make-snapshots
... I had made the change before the issue of {missing,disappearing}-packages-on-upgrade that various other peoples are experiencing currently.
I've never seen so much activity on my #HomeServer before.
#ZFS is replacing / resilvering the 2nd member of the old mirror.
One of the old HDDs is getting zeroed for resale.
new 18TB mirror: sda & sdb via SATA
old 10TB mirror: sdc & sdd via USB
fuckkkk ZFS why you do this. guess i know what i'm spending tonight doing.
any #zfs experts out there able to help me recover my pool? i apparently broke things quite significantly lol
Today, out of nowhere, my shell started to misbehave. My prompt suddenly reverted to default. Some unexpected "command not found" errors started popping up. Something was off.
I went to check my shell configuration. The directory was not there. I then went look into ~/.config. Half of the directories inside were simply gone.
I immediately flipped into what the fuck is happening mode.
This system is an Alpine root-on-ZFS. I have a script called by cron every 20 minutes that snapshots everything.
First I went into the snapshot directory and started copying some things. I soon noticed it was just too much missing. How to map out what was gone in the first place? Even so, copying would only go so far because I was duplicating things.
I looked to my left at the resource monitor. I had less than 1 GB left of free space. That was not going to work.
I flip some pages, looking for an incantation...
% zfs rollback zroot/home@20m
A long second hanged in the air. Then all the resource monitor's bars flipped at once to green: 53% free space.
"Blessed be the ZFS Daemons and the Authors who conjured Them."
The system was still confused, so I rebooted. It let its conscience drift - as it is used to -, uncertainty still heavy in the air. Then it resurfaced... every line of output unconcerned.
Back up, no trace was left of the seconds leading up to the warp. The only suspicion came from a cryptography guardian, who noticed something was wrong about the timestamps. "Please re-enter the passcodes", it asked. Every other blob was either unconcerned or unimpressed with the glitch.
Like any time travel, the only trace left was in my memory. No history anywhere has me looking for that spell. I booted 20 minutes into the past and that's from when I am writing to you.
Latest 𝗩𝗮𝗹𝘂𝗮𝗯𝗹𝗲 𝗡𝗲𝘄𝘀 - 𝟮𝟬𝟮𝟱/𝟬𝟰/𝟭𝟰 (Valuable News - 2025/04/14) available.
https://vermaden.wordpress.com/2025/04/14/valuable-news-2025-04-14/
Past releases: https://vermaden.wordpress.com/news/