LZ4 version 1.10

I’ve noticed truenas rc1 25.04 has version 1.9.4 of the LZ4 compression. version 1.10 is out as of july 2024 with what seems to be some pretty good features like multithread and few others. Is there anything in the pipeline for that update? It’s probably pretty low for one reason or another but just curious.

Problem/Justification
(What is the problem you are trying to solve with this feature/improvement or why should it be considered?)

Impact
(How is this feature going to impact all TrueNAS users? What are the benefits and advantages? Are there disadvantages?)

User Story
(Please give a short description on how you envision some user taking advantage of this feature, what are the steps a user will follow to accomplish it)

This should come with upstream OpenZFS.

OpenZFS is unlikely to update LZ4 anytime soon, for a variety of reasons. That said, that’s completely independent of the LZ4 application that ships with the OS, and whose update is totally doable.

2 Likes

More or less the same as the reasons why zstd won’t be upgraded any time soon

3 Likes

For sure but aside from the possibility of stability and rigorous testing do you have some specific reasons you’re thinking of or just saying "variety of reasons out of thin air kinda thing?

See @Stux’s link above… This is well-trodden territory and the tl;dr is that any update comes with substantial caveats and ZFS was not designed for an endless variety of compression algorithms, so the community needs to be judicious about doing this.

3 Likes