Unix and Linux Stack Exchange
Unix and Linux Stack Exchange

Questions tagged [zstd]

18 questions
16
votes
3 answers

How to set a non default zstd compression level at btrfs filesystem defragment?

# btrfs filesystem defragment -r -v -czstd:15 / ERROR: unknown compression type zstd:15 # btrfs filesystem defragment -r -v -czstd_15 / ERROR: unknown compression type zstd_15 # btrfs filesystem defragment -r -v -czstd15 / ERROR: unknown compression…
Pro Backup
  • 4,686
  • 12
  • 50
  • 82
14
votes
2 answers

compressing and decompressing dd image - zstd instead of gzip

Earlier I was using fsarchiver to create compressed partition image. Due to some weird behavior I am choosing to replace it with dd. However, I like how fsarchiver compressed with zstd. So, I studied, How to make a disk image and restore from it…
Ahmad Ismail
  • 2,478
  • 1
  • 22
  • 47
12
votes
3 answers

zst compression not supported by apt/dpkg

I'm running Debian, namely: # uname -A Linux martlins2 5.10.0-8-amd64 #1 SMP Debian 5.10.46-4 (2021-08-03) x86_64 GNU/Linux and for some time I see some errors telling that some parts of some packages uses unknown compression while doing apt…
martlin
  • 143
  • 1
  • 1
  • 5
7
votes
1 answer

Is there a compression tool with an arbitrarily large dictionary?

I am looking for a compression tool with an arbitrarily large dictionary (and "block size"). Let me explain by way of examples. First let us create 32MB random data and then concatenate it to itself to make a file of twice the length of length…
Simd
  • 325
  • 1
  • 2
  • 11
3
votes
1 answer

Is zstd for zram actually available in Linux 4.15?

I found zstd in /drivers/block/zram/zcomp.c, but I can't find anything zstd-related in /crypto. So is zstd for zram actually available in Linux 4.15 or not?
illiterate
  • 953
  • 7
  • 22
2
votes
0 answers

How do you ssh using zstd dynamic compression?

I want to set up my ssh tunnel to do dynamic compression so that I get maximum throughput for the bandwidth and CPU resources I have available on each end. Since gzip compression is built-in and not pluggable I thought I could use -o ProxyCommand to…
ChinnoDog
  • 21
  • 1
2
votes
2 answers

How can I separate multiple files from single file caused by zstd -r folder -o output.zst?

I didn't read enough the manual and run the following command $ zstd -r folder -o output.zst The following command gave me back a single file called output $ unzstd output.zst The output file has all the contents of the files under the folder…
Tun
  • 161
  • 8
2
votes
0 answers

Avoid pipeline stalls from write caching to usb drive

I have the following process I use for backups: btrfs send snapshots/home-2016-06-04 | zstd --verbose -T4 - | gpg --batch --passphrase-file /tmp/secret --compress-algo none --symmetric - > /mnt/usbdrive/packup.zst.gpg But I find that while it runs…
Luciano
  • 141
  • 5
1
vote
2 answers

Decompress folder.tar.gz with files inside

I'm trying to decompress folder.tar.gz which was previously compressed with zstd, so I did: unzstd folder.tar.gz.zst Now if I try to decompress by using: tar -xvf folder.tar.gz It will decompress two big files inside some folder joined…
user134969
  • 263
  • 2
  • 7
1
vote
1 answer

create initrd image compressed with zstd

I have initrd image compressed with xz. This is how I created it from image file initrd: e2image -ar initrd - | xz -9 --check=crc32 > initrd.xz now I need same image compressed using zstd algorithm. What command/parameters do I have to use, for the…
400 the Cat
  • 819
  • 4
  • 37
  • 85
1
vote
1 answer

How do I uncompress or unarchive the contents of initramfs img file in Arch Linux?

I have been using Arch Linux for a while and studying about the initramfs. I thought of looking into the contents of the file to get a clear idea of it. I googled for various ways to peek through the file but I was not able to. Initially, I checked…
Panther Coder
  • 368
  • 3
  • 8
1
vote
1 answer

How to tell if btrfs subvolumes are actually compressed or not

I have mounted Btrfs subvolumes (including /home) with the compress=no option in /etc/fstab. However, when I run btrfs inspect-internal dump-super -a (both, on the running system, as well as on a live boot and mounting with…
Saurav Sengupta
  • 301
  • 3
  • 11
1
vote
1 answer

Is there an equivalent of zdiff for zstandard

Is there an equivalent of the gzip utility zdiff(1), but for zstandard? I have not been able to find anything in the zstandard repository other than zstdgrep and zstdless.
razeh
  • 569
  • 1
  • 4
  • 4
0
votes
0 answers

Archive qemu image

How do I archive qemu images with the same efficiency as gcloud This command stub show efficiency. Around 80% on pre installed images of OSes notorious for their install size. 40g actual physical files on the disk on a fresh install archived as 5g…
John Peterson
  • 61
  • 1
  • 5
0
votes
1 answer

btrfs mount with compress fails with udisksctl but succeeds with mount?

$ sudo mkfs.btrfs -fL borgbackups /dev/vgxubuntu/borgbackups $ udisksctl mount -o compress=ztsd:15 -b /dev/mapper/vgxubuntu-borgbackups Error mounting /dev/dm-3: GDBus.Error:org.freedesktop.UDisks2.Error.OptionNotPermitted: Mount option…
eugenevd
  • 156
  • 3
1
2