<?xml version="1.0" encoding="utf-8" standalone="yes" ?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>Self-Hosting on Leo&#39;s Technical Log</title>
    <link>https://jksoftcn.com/en/tags/self-hosting/</link>
    <description>Recent content in Self-Hosting on Leo&#39;s Technical Log</description>
    <generator>Hugo</generator>
    <language>en</language>
    <lastBuildDate>Mon, 01 Dec 2025 00:00:00 +0000</lastBuildDate>
      <atom:link href="https://jksoftcn.com/en/tags/self-hosting/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Do You Really Need ZFS? A Practical Storage Guide for Home and Power Users</title>
      <link>https://jksoftcn.com/en/blog/00-do-you-need-to-use-zfs/</link>
      <pubDate>Mon, 01 Dec 2025 00:00:00 +0000</pubDate>
      <guid>https://jksoftcn.com/en/blog/00-do-you-need-to-use-zfs/</guid>
      <description>&lt;div class=&#34;mermaid&#34;&gt;&#xD;&#xA;graph TD&#xD;&#xA;    Start[Start Choosing a Storage Solution] --&gt; Q1{Is your total data&lt;br/&gt;under 4TB?}&#xD;&#xA;    &#xD;&#xA;    Q1 --&gt;|Yes| Q2{Do multiple devices&lt;br/&gt;need access?}&#xD;&#xA;    Q1 --&gt;|No| Q3{Is your budget&lt;br/&gt;over ~$400?}&#xD;&#xA;    &#xD;&#xA;    Q2 --&gt;|No| Q2a{Do you want&lt;br/&gt;automatic backups?}&#xD;&#xA;    Q2 --&gt;|Yes| NAS1[2-bay entry NAS&lt;br/&gt;Synology / QNAP&lt;br/&gt;Built-in filesystem]&#xD;&#xA;    &#xD;&#xA;    Q2a --&gt;|No| HDD[External drive&lt;br/&gt;Cheapest &amp; simplest&lt;br/&gt;Manual backups]&#xD;&#xA;    Q2a --&gt;|Yes| NAS1&#xD;&#xA;    &#xD;&#xA;    Q3 --&gt;|No| HDD&#xD;&#xA;    Q3 --&gt;|Yes| Q4{Linux experience?}&#xD;&#xA;    &#xD;&#xA;    Q4 --&gt;|No| NAS2[4-bay prebuilt NAS&lt;br/&gt;Synology / QNAP&lt;br/&gt;RAID5 / SHR]&#xD;&#xA;    Q4 --&gt;|Yes| Q5{Willing to spend time&lt;br/&gt;learning &amp; maintaining?}&#xD;&#xA;    &#xD;&#xA;    Q5 --&gt;|No| NAS2&#xD;&#xA;    Q5 --&gt;|Yes| Q6{More than 20TB&lt;br/&gt;of data?}&#xD;&#xA;    &#xD;&#xA;    Q6 --&gt;|No| Q7{Is maximum data&lt;br/&gt;integrity critical?}&#xD;&#xA;    Q6 --&gt;|Yes| Q8{Budget over ~$1,400?}&#xD;&#xA;    &#xD;&#xA;    Q7 --&gt;|No| Q7a{Less than&lt;br/&gt;8GB RAM?}&#xD;&#xA;    Q7 --&gt;|Yes| Q7b{At least&lt;br/&gt;16GB RAM?}&#xD;&#xA;    &#xD;&#xA;    Q7a --&gt;|Yes| MDADM1[mdadm RAID1/10&lt;br/&gt;Flexible &amp; cheap]&#xD;&#xA;    Q7a --&gt;|No| Q7b&#xD;&#xA;    &#xD;&#xA;    Q7b --&gt;|No| MDADM1&#xD;&#xA;    Q7b --&gt;|Yes| ZFS1[ZFS on Linux / TrueNAS&lt;br/&gt;Checksums &amp; snapshots]&#xD;&#xA;    &#xD;&#xA;    Q8 --&gt;|No| Q9{At least&lt;br/&gt;32GB RAM?}&#xD;&#xA;    Q8 --&gt;|Yes| Q10{High random I/O&lt;br/&gt;performance needed?}&#xD;&#xA;    &#xD;&#xA;    Q9 --&gt;|No| MDADM2[mdadm RAID6/10&lt;br/&gt;Large arrays]&#xD;&#xA;    Q9 --&gt;|Yes| ZFS2[ZFS RAIDZ2&lt;br/&gt;Large storage pools]&#xD;&#xA;    &#xD;&#xA;    Q10 --&gt;|Yes| HWRAID[Hardware RAID&lt;br/&gt;BBU protected cache]&#xD;&#xA;    Q10 --&gt;|No| ZFS2&#xD;&#xA;&lt;/div&gt;&#xD;&#xA;&lt;h2 id=&#34;introduction&#34;&gt;Introduction&lt;/h2&gt;&#xA;&lt;p&gt;ZFS has a reputation problem.&lt;/p&gt;&#xA;&lt;p&gt;In many tech communities, it is often portrayed as &lt;em&gt;the&lt;/em&gt; &amp;ldquo;correct&amp;rdquo; way to store data—anything else is seen as risky or amateur. At the same time, seasoned admins warn that ZFS is complex, memory-hungry, and easy to misuse.&lt;/p&gt;&#xA;&lt;p&gt;So where does that leave ordinary users, home labbers, and small NAS builders?&lt;/p&gt;&#xA;&lt;p&gt;This article takes a pragmatic, experience-driven look at whether you actually need ZFS, and how to choose a storage solution that fits your data size, budget, and willingness to maintain it.&lt;/p&gt;&#xA;&lt;h2 id=&#34;1-external-drives-vs-nas-start-simple&#34;&gt;1. External Drives vs NAS: Start Simple&lt;/h2&gt;&#xA;&lt;h3 id=&#34;when-an-external-drive-is-enough&#34;&gt;When an External Drive Is Enough&lt;/h3&gt;&#xA;&lt;p&gt;An external hard drive is often dismissed as &amp;ldquo;too simple&amp;rdquo;, but for many people it is the &lt;em&gt;right&lt;/em&gt; answer.&lt;/p&gt;&#xA;&lt;p&gt;External drives work well if:&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Your total data is &lt;strong&gt;under 4TB&lt;/strong&gt;&lt;/li&gt;&#xA;&lt;li&gt;You mainly back up &lt;strong&gt;one machine&lt;/strong&gt;&lt;/li&gt;&#xA;&lt;li&gt;You are on a &lt;strong&gt;tight budget&lt;/strong&gt;&lt;/li&gt;&#xA;&lt;li&gt;Backups are &lt;strong&gt;occasional&lt;/strong&gt;, not continuous&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;p&gt;For example, backing up a laptop with photos, documents, and personal files does not justify a NAS or RAID. A single 2–4TB external drive plus periodic backups is cheap, reliable, and easy to understand.&lt;/p&gt;&#xA;&lt;p&gt;Complexity is a cost. Avoid it unless you truly need it.&lt;/p&gt;&#xA;&lt;h3 id=&#34;when-a-nas-makes-sense&#34;&gt;When a NAS Makes Sense&lt;/h3&gt;&#xA;&lt;p&gt;A NAS becomes attractive once your needs grow beyond a single device.&lt;/p&gt;&#xA;&lt;p&gt;A NAS is a good fit if:&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Multiple devices need &lt;strong&gt;shared access&lt;/strong&gt;&lt;/li&gt;&#xA;&lt;li&gt;You want &lt;strong&gt;automatic, scheduled backups&lt;/strong&gt;&lt;/li&gt;&#xA;&lt;li&gt;Services must be &lt;strong&gt;online 24/7&lt;/strong&gt; (media server, downloads, remote access)&lt;/li&gt;&#xA;&lt;li&gt;Your data volume is &lt;strong&gt;growing steadily&lt;/strong&gt;&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;p&gt;Even a basic 2-bay NAS provides redundancy, convenience, and automation that external drives cannot match.&lt;/p&gt;&#xA;&lt;h2 id=&#34;2-do-nas-users-need-zfs&#34;&gt;2. Do NAS Users Need ZFS?&lt;/h2&gt;&#xA;&lt;h3 id=&#34;prebuilt-nas-usually-no&#34;&gt;Prebuilt NAS: Usually No&lt;/h3&gt;&#xA;&lt;p&gt;If you are using a commercial NAS (Synology, QNAP, etc.), &lt;strong&gt;you almost certainly do not need ZFS&lt;/strong&gt;.&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Synology’s Btrfs implementation already provides snapshots and checksums&lt;/li&gt;&#xA;&lt;li&gt;QNAP’s default filesystems are well-tested and supported&lt;/li&gt;&#xA;&lt;li&gt;Vendor GUIs, updates, and documentation matter more than filesystem purity&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;p&gt;Installing ZFS on a prebuilt NAS usually adds risk and complexity without clear benefits.&lt;/p&gt;&#xA;&lt;h3 id=&#34;self-built-nas-maybe&#34;&gt;Self-Built NAS: Maybe&lt;/h3&gt;&#xA;&lt;p&gt;ZFS becomes interesting once you move into self-built systems.&lt;/p&gt;&#xA;&lt;p&gt;ZFS is worth considering if:&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;&lt;strong&gt;Data integrity truly matters&lt;/strong&gt; (irreplaceable photos, archives, work data)&lt;/li&gt;&#xA;&lt;li&gt;You understand concepts like pools, vdevs, datasets, and scrubs&lt;/li&gt;&#xA;&lt;li&gt;You have &lt;strong&gt;enough RAM&lt;/strong&gt; (16GB minimum is realistic)&lt;/li&gt;&#xA;&lt;li&gt;Your storage layout is &lt;strong&gt;planned long-term&lt;/strong&gt;, not constantly changing&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;p&gt;ZFS’s biggest strength is end-to-end checksumming and self-healing. Silent data corruption &lt;em&gt;does&lt;/em&gt; happen—but whether it matters depends on your data.&lt;/p&gt;&#xA;&lt;h3 id=&#34;a-reality-check-for-most-users&#34;&gt;A Reality Check for Most Users&lt;/h3&gt;&#xA;&lt;p&gt;For most home NAS users:&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Vendor filesystems are &lt;em&gt;good enough&lt;/em&gt;&lt;/li&gt;&#xA;&lt;li&gt;ZFS features are underutilized&lt;/li&gt;&#xA;&lt;li&gt;Proper backups matter more than filesystem choice&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;p&gt;ZFS is powerful—but power only helps if you know how to use it.&lt;/p&gt;&#xA;&lt;h2 id=&#34;3-when-does-a-linux-storage-server-make-sense&#34;&gt;3. When Does a Linux Storage Server Make Sense?&lt;/h2&gt;&#xA;&lt;p&gt;Self-built Linux storage is not about saving money—it is about control.&lt;/p&gt;&#xA;&lt;p&gt;It makes sense if:&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;You enjoy &lt;strong&gt;learning and maintaining systems&lt;/strong&gt;&lt;/li&gt;&#xA;&lt;li&gt;You already use Linux comfortably&lt;/li&gt;&#xA;&lt;li&gt;You need &lt;strong&gt;custom workloads&lt;/strong&gt; (VMs, containers, heavy media processing)&lt;/li&gt;&#xA;&lt;li&gt;Your data exceeds &lt;strong&gt;20TB&lt;/strong&gt; and keeps growing&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;p&gt;If you value your time more than tinkering, a prebuilt NAS is still the better tool.&lt;/p&gt;&#xA;&lt;h2 id=&#34;4-choosing-the-right-storage-technology&#34;&gt;4. Choosing the Right Storage Technology&lt;/h2&gt;&#xA;&lt;h3 id=&#34;mdadm-simple-and-flexible&#34;&gt;mdadm: Simple and Flexible&lt;/h3&gt;&#xA;&lt;p&gt;Linux software RAID (mdadm) is often underrated.&lt;/p&gt;&#xA;&lt;p&gt;It works well when:&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Budgets are limited&lt;/li&gt;&#xA;&lt;li&gt;Arrays are small to medium (4–8 drives)&lt;/li&gt;&#xA;&lt;li&gt;Flexibility matters more than elegance&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;p&gt;&lt;strong&gt;Important caveats&lt;/strong&gt;:&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Rebuilds on large disks can take days&lt;/li&gt;&#xA;&lt;li&gt;RAID5 is risky with modern drive sizes&lt;/li&gt;&#xA;&lt;li&gt;A UPS is not optional&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;p&gt;RAID1 and RAID10 remain the safest mdadm choices.&lt;/p&gt;&#xA;&lt;h3 id=&#34;hardware-raid-still-relevant&#34;&gt;Hardware RAID: Still Relevant&lt;/h3&gt;&#xA;&lt;p&gt;Hardware RAID is unfashionable, but not obsolete.&lt;/p&gt;&#xA;&lt;p&gt;It excels when:&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Random I/O performance is critical&lt;/li&gt;&#xA;&lt;li&gt;Arrays are large (8+ disks)&lt;/li&gt;&#xA;&lt;li&gt;Downtime is unacceptable&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;p&gt;If you go this route:&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Use reputable vendors (LSI/Broadcom)&lt;/li&gt;&#xA;&lt;li&gt;Ensure cache protection (BBU or supercapacitor)&lt;/li&gt;&#xA;&lt;li&gt;Verify OS and drive compatibility&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;h3 id=&#34;zfs-powerful-opinionated-demanding&#34;&gt;ZFS: Powerful, Opinionated, Demanding&lt;/h3&gt;&#xA;&lt;p&gt;ZFS shines when:&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Data integrity is non-negotiable&lt;/li&gt;&#xA;&lt;li&gt;Snapshots and clones are core workflows&lt;/li&gt;&#xA;&lt;li&gt;Plenty of RAM is available&lt;/li&gt;&#xA;&lt;li&gt;The system is designed upfront and left mostly unchanged&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;p&gt;ZFS struggles when:&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;RAM is scarce (&amp;lt;8GB)&lt;/li&gt;&#xA;&lt;li&gt;Storage layouts change frequently&lt;/li&gt;&#xA;&lt;li&gt;Hardware or power is unreliable&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;p&gt;ZFS rewards discipline—and punishes shortcuts.&lt;/p&gt;&#xA;&lt;h2 id=&#34;5-high-level-comparison&#34;&gt;5. High-Level Comparison&lt;/h2&gt;&#xA;&lt;table&gt;&#xA;  &lt;thead&gt;&#xA;      &lt;tr&gt;&#xA;          &lt;th&gt;Solution&lt;/th&gt;&#xA;          &lt;th&gt;Performance&lt;/th&gt;&#xA;          &lt;th&gt;Flexibility&lt;/th&gt;&#xA;          &lt;th&gt;Reliability&lt;/th&gt;&#xA;          &lt;th&gt;Cost&lt;/th&gt;&#xA;          &lt;th&gt;Best For&lt;/th&gt;&#xA;      &lt;/tr&gt;&#xA;  &lt;/thead&gt;&#xA;  &lt;tbody&gt;&#xA;      &lt;tr&gt;&#xA;          &lt;td&gt;mdadm&lt;/td&gt;&#xA;          &lt;td&gt;Medium&lt;/td&gt;&#xA;          &lt;td&gt;High&lt;/td&gt;&#xA;          &lt;td&gt;Medium&lt;/td&gt;&#xA;          &lt;td&gt;Low&lt;/td&gt;&#xA;          &lt;td&gt;Home servers, small arrays&lt;/td&gt;&#xA;      &lt;/tr&gt;&#xA;      &lt;tr&gt;&#xA;          &lt;td&gt;Hardware RAID&lt;/td&gt;&#xA;          &lt;td&gt;High&lt;/td&gt;&#xA;          &lt;td&gt;Low&lt;/td&gt;&#xA;          &lt;td&gt;High&lt;/td&gt;&#xA;          &lt;td&gt;High&lt;/td&gt;&#xA;          &lt;td&gt;Performance-critical workloads&lt;/td&gt;&#xA;      &lt;/tr&gt;&#xA;      &lt;tr&gt;&#xA;          &lt;td&gt;ZFS&lt;/td&gt;&#xA;          &lt;td&gt;Medium–High&lt;/td&gt;&#xA;          &lt;td&gt;Medium&lt;/td&gt;&#xA;          &lt;td&gt;High&lt;/td&gt;&#xA;          &lt;td&gt;Medium&lt;/td&gt;&#xA;          &lt;td&gt;Integrity-focused users&lt;/td&gt;&#xA;      &lt;/tr&gt;&#xA;  &lt;/tbody&gt;&#xA;&lt;/table&gt;&#xA;&lt;h2 id=&#34;6-practical-recommendations&#34;&gt;6. Practical Recommendations&lt;/h2&gt;&#xA;&lt;h3 id=&#34;a-sensible-upgrade-path&#34;&gt;A Sensible Upgrade Path&lt;/h3&gt;&#xA;&lt;p&gt;&lt;strong&gt;Beginner (&amp;lt;4TB)&lt;/strong&gt;&lt;br&gt;&#xA;External drive + manual backups&lt;/p&gt;&#xA;&lt;p&gt;&lt;strong&gt;Intermediate (4–12TB)&lt;/strong&gt;&lt;br&gt;&#xA;2–4 bay NAS with vendor filesystem&lt;/p&gt;&#xA;&lt;p&gt;&lt;strong&gt;Advanced (&amp;gt;12TB, technical users)&lt;/strong&gt;&lt;br&gt;&#xA;Self-built Linux server with ZFS or mdadm&lt;/p&gt;&#xA;&lt;p&gt;&lt;strong&gt;Professional (&amp;gt;50TB, critical data)&lt;/strong&gt;&lt;br&gt;&#xA;Hardware RAID + enterprise drives + UPS + offsite backups&lt;/p&gt;&#xA;&lt;h3 id=&#34;principles-that-actually-matter&#34;&gt;Principles That Actually Matter&lt;/h3&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;&lt;strong&gt;Backups beat RAID&lt;/strong&gt;: RAID does not protect against deletion, malware, or disasters&lt;/li&gt;&#xA;&lt;li&gt;Follow &lt;strong&gt;3-2-1 backups&lt;/strong&gt;: 3 copies, 2 media types, 1 offsite&lt;/li&gt;&#xA;&lt;li&gt;Choose systems you can &lt;strong&gt;maintain long-term&lt;/strong&gt;&lt;/li&gt;&#xA;&lt;li&gt;Simpler systems fail less often&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;h2 id=&#34;conclusion&#34;&gt;Conclusion&lt;/h2&gt;&#xA;&lt;p&gt;Most people do &lt;strong&gt;not&lt;/strong&gt; need ZFS.&lt;/p&gt;&#xA;&lt;p&gt;They need reliable hardware, boring configurations, and tested backups.&lt;/p&gt;&#xA;&lt;p&gt;ZFS is an excellent tool—when used for the right reasons, by users who understand its trade-offs. For everyone else, a simpler solution will be safer, cheaper, and easier to live with.&lt;/p&gt;&#xA;&lt;p&gt;The best storage system is not the most advanced one—it is the one you can keep running correctly for years.&lt;/p&gt;&#xA;</description>
    </item>
  </channel>
</rss>
