Skip to content
#

lz4

Here are 88 public repositories matching this topic...

simonjohansson
simonjohansson commented Dec 18, 2018

Howdy and thanks for a awesome library!

We have a use case where we tar up a path and upload it to google cloud storage, which takes a []byte as the object you wish to upload. Later on we might download the tar which again gives us a []byte and untar it to some path.

In v2.0.1 we have the super helpful

Compress(sourceDir string) (tar []byte, err error)
Uncompress(destinationDir st
travisdowns
travisdowns commented Jan 3, 2017

When using

./lzbench -r -elz4 ../corpus/silesia

To run against a directory, memcpy only runs once:

lzbench 1.5 (64-bit Linux)   Assembled by P.Skibinski
Compressor name         Compress. Decompress. Compr. size  Ratio Filename
memcpy                  11571 MB/s 11643 MB/s    10192446 100.00 ../corpus/silesia/dickens
lz4 1.7.3                 267 MB/s  1830 MB/s     642874
pps83
pps83 commented Jun 6, 2019

It should be quite obvious for first time users to see some simplest APIs (to compress/uncompress buffer without dealing with any file io). Strangely, lizard has links to file format, but no clues to basic api use (is it in examples, which one is the "hello world"?. I've been using zlib for more than a decade, and I've never needed to know its file format, perhaps same for 90% of its users.

IMO

jonathanunderwood
jonathanunderwood commented Dec 28, 2019

The streams module currently only supports the double buffer approach, and not the ring buffer approach. The scaffolding for supporting the double buffer approach is in the code, however. This just needs a willing volunteer to implement it.

The streams module was authored by @tSed who may be able to give guidance to a volunteer.

EasyCompressor is an open-source compression abstraction library that supports and implements many compression algorithms such as Zstd, LZMA, LZ4, Snappy, Brotli, GZip and Deflate. It is very useful for using along with distributed caching or storing files in database.

  • Updated Apr 21, 2020
  • C#

Improve this page

Add a description, image, and links to the lz4 topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the lz4 topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.