Hi, I want to do an “awesome things” list with BTRFS tools

Help me gather them?

Update: see here

General

BTRFS CLI Interface

btrfs-progs

official userpace utilities

BTRFS Assistant

Tool for doing many BTRFS actions graphically

It requires snapper and offers a GUI for it.

butter-manager

Tool for managing snapshots, balancing filesystems and upgrading the system safetly.

Backups & Snapshots

btrbk

Backup utility using BTRFS

Snapper

General system snapshot utility with BTRFS support, used in OpenSUSE Tumbleweed by default. There are also plugins for Fedoras dnf and for Arch pacman.

Timeshift

System restore tool for Linux. Creates filesystem snapshots using rsync+hardlinks, or BTRFS snapshots. Supports scheduled snapshots, multiple backup levels, and exclude filters. Snapshots can be restored while system is running or from Live CD/USB.

Currently maintained by LinuxMint, even though they dont use BTRFS by default, it works better there.

libtuikit / transactional-update

Used in OpenSUSE microOS and the Desktop variants.

provides an application and library to update a Linux operating system in a transactional way, i.e. the update will be performed in the background while the system continues running as it is. Only if the update was the successful as a whole the system will boot into the new snapshot.

Available as a library for other distros.

Yet Another BTRFS Snapshotter

Alternatives don’t supports customized of snapshot location, (e.g. Arch recommended layout). Adhering to such layouts, and rolling back using them, sometime involve non-obvious workarounds. The motivation for yabsnap was to create a simpler, hackable and customizable snapshot system.

btrfs-autosnap

There are 2 separate projects with that name

grub-btrfs

Set BTRFS snapshots as boot options

[btrfs-sxbackup])https://github.com/masc3d/btrfs-sxbackup)

Incremental btrfs snapshot backups with push/pull support via SSH

Small CLI tools

btrfsd - tiny Btrfs maintenance daemon

Btrfsd is a lightweight daemon that takes care of all Btrfs filesystems on a Linux system.

It can:

  • Check for detected errors and broadcast a warning if any were found, or optionally send an email
  • Perform scrub periodically if the system is not on battery
  • Optionally schedule balancing operations as well

dupreremove

Tools for deduplicating file systems

compsize

Takes a list of files on a btrfs filesystem and measures used compression types and effective compression ratio

Used in flatpak-dedup-checker

btdu

sampling disk usage profiler for btrfs For multiple reasons, classic disk usage analyzers such as ncdu cannot provide an accurate depiction of actual disk usage. (btrfs compression in particular is challenging to classic analyzers, and special tools must be used to query compressed usage.)

btrfs-list

Helps listing directories

btrfs-fuse

A read-only btrfs implementation using FUSE (Filesystem in Userspace). Although btrfs is already in mainline Linux kernel, there are still use-cases for such read-only btrfs implementation:

btrfs debugger

The btrfs debugger (pronounced “buttered”).

btrd is a REPL debugger that helps inspect mounted btrfs filesystems. btrd is particularly useful in exploring on-disk structures and has full knowledge of all on-disk types.

ntfs2btrfs

a tool which does in-place conversion of Microsoft’s NTFS filesystem to the open-source filesystem Btrfs, much as btrfs-convert does for ext2. The original image is saved as a reflink copy at image/ntfs.img, and if you want to keep the conversion you can delete this to free up space.

Consists of a Windows and a Linux executable. Does not work on the primary drive.

WinBTRFS

filesystem driver for Windows

Partition managers with support

  • KDE-Partitionamanger
  • GNOME-Disks
  • blivet-gui (Fedora Anaconda setup)
  • gparted ?

Data recovery

When having deleted or corrupted data on a BTRFS partition, these tools can help:

Testdisk?

  • photorec?

Scalpel?

R-Linux

Freeware, not FOSS? Not related to R and “R-Studio” is also not related to RStudio

BTRFS bindings

These allow you to do BTRFS actions in many programming languages

    • boredsquirrelOP
      2·
      18 days ago

      Does timeshift also use BTRFS features, or just the normal method?

      • thingsiplay@beehaw.org
        4·
        18 days ago

        Timeshifts main reason to use is BTRFS functionality. It’s a fantastic tool, but I only used it previously on EXT4, in which case it defaults to slow rsync method. I really like the software, but on my new install decided against using it (I’m on EXT4 yet again). https://github.com/linuxmint/timeshift And while I post this reply, just noticed that Linux Mint is maintaining it now. The old repo is in archive mode: https://github.com/teejee2008/timeshift

        • boredsquirrelOP
          2·
          17 days ago

          Really interesting project.

          Yes I also thought it would be focused on non-BTRFS, especially as Mint doesnt use BTRFS either, right?

          • thingsiplay@beehaw.org
            3·
            17 days ago

            You mean the default filesystem? I actually never used Mint and don’t think it’s the default, but most likely an option at install time. Maybe they plan on switching as the default in the future.

          • thingsiplay@beehaw.org
            4·
            17 days ago

            I never used BTRFS at all. At the moment I do not feel comfortable using BTRFS yet and wait until its proven over long time and ironed out even the weirdest edge cases.

            Edit: Don’t misunderstand me. I know its relative stable now, but reading here and there about the problems makes me very uncomfortable to switch from the battle tested EXT4. I really like its features and evaluated last year to use BTRFS as my system drive. Ultimately decided against it for now. I plan on using it, and clicked this post for this reason, to learn more about it.

            • Chewy@discuss.tchncs.de
              2·
              17 days ago

              Maintaining btrfs is more work than maintaining ext4, which basically doesn’t need any. I.e. running btrfs scrub is important to keep performance up. Monthly scrubs are good because they don’t take as long if done regularly.

              Btrfs balance can free up some space, but otherwise isn’t important on SSDs.

              • boredsquirrelOP
                1·
                17 days ago

                I think BTRFS is especially problematic on Fedora Atomic desktops.

                Afaik the OSTree snapshots use BTRFS deduplication, also the zstd compression helps reduce storage usage and increase SSD use.

                But as the entire system partitions are read only, you cant balance, scrub etc them.

                This is a big issue I think, I will open a Fedora Discussion post about this.

                https://discussion.fedoraproject.org/t/119216

                • Chewy@discuss.tchncs.de
                  2·
                  16 days ago

                  Afaik the OSTree snapshots use BTRFS deduplication […]

                  Note: OSTree will transparently take advantage of some BTRFS features if deployed on it. [1]

                  Interesting, I didn’t know OSTree takes advantage of BTRFS features.

                  On my current system I use ext4 instead of btrfs which I regret specifically because of the missing transparent compression and reflink copy.

                  [1] https://ostreedev.github.io/ostree/introduction/

  • Strit@lemmy.linuxuserspace.show
    5·
    17 days ago

    I’ve used btrfs-autosnap for a while on Arch and it’s brilliant. Whenever you install or remove something with pacman it creates a btrfs snapshot of your subvolumes and if you have grub-btrfs install too they get added to Grub menu. Very handy.

    You can define which subvolumes you want snapshotted and how many snapshots of each you want to keep. Which means it also removes the oldest snapshot when a new is created if it gets over the keep amount.

  • metiulekm@sh.itjust.worksEnglish
    5·
    18 days ago

    I like btdu which is essentially ncdu, but works in a way that is useful even if advanced btrfs features (CoW, compression etc.) are used.

  • Kabe@lemmy.worldEnglish
    4·
    17 days ago

    Nice list.

    Depending on your package manager, there are very handy snapper plugins that do automated pre/post snapshots for package installation/removal.

    For Arch-based systems it’s snap-pac, and Fedora has one too (although I can’t remember the name).

  • DuskyRo@lemmy.world
    4·
    18 days ago

    There is R-Linux for recovering deleted files, altough it doesn’t support btrfs it can recover data from btrfs drives(if anyone knows something better please let me know as I have a drive that completely wiped itself).

    • boredsquirrelOP
      1·
      17 days ago

      Is that R-Linux and R-Studio something different from R the language and RStudio the GUI for it? Damn this is confusing.

      • DuskyRo@lemmy.world
        2·
        17 days ago

        I have no idea. R-Linux is what the package on the AUR is called and it doesn’t require a license unlike R-Studio from the site.

  • DaTingGoBrrr@lemmy.ml
    3·
    17 days ago

    I would like to recommend Yabsnap as an alternative to Snapper. It’s made for Arch, tested on Fedora and might work on other distros. But it needs more eyes and testers!

    Edit: thank you for the list! It’s very nice to see what is available for btrfs

  • bloodfart@lemmy.ml
    1·
    16 days ago

    I’m not saying this to start a fight, but as a person who used btrfs for a situation it was not suited for: there need to be some tools for migrating off btrfs here.

      • bloodfart@lemmy.ml
        2·
        15 days ago

        Not that I was aware of a couple of years ago. I ended up copying to a different media, reformatting and copying back and accepting the loss of the snapshots.