RealTime Data Compression: LZ4

RealTime Data Compression: LZ4.

LZ4 is a very fast compressor, based on well-known LZ77 (Lempel-Ziv) algorithm.
Originally a fork from LZP2, it provides better compression ratio for text files and reaches impressive decompression speed, in the range and beyond 1GB/s per core (!), especially for binary files. These speeds are scalable with multi-threading modes, quickly reaching RAM speed limits on multi-core systems.

LZ4 compression format is detailed in a dedicated post.

LZ4 is available as a C Open Source project, hosted on Google Code, under aBSD license.

A list of ports to other language (Java, C#, Python, etc.) is also maintained on this page.

The version proposed here is for Windows. It works on 32 and 64 bits systems.
The -c1 mode serves as a living demo for MMC (Morphing Match Chain) search algorithm (explained here).
The -c2 mode is equivalent to lz4hc.

This entry was posted in Uncategorized. Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s