sqlite-zstd: Transparent dictionary-based row-level compression for SQLite - An sqlite extension written in Rust to reduce the database size without losing functionality - phiresky's blog
data is a json blob from the perspective of SQLite, but it is parsed into a strictly typed structure in the Rust application code. After a year of collecting data, the SQLite database is already 7.6 GByte in size. Of course this is an extreme example of redundancy, but storing similar redundant data in databases is pretty common. SQLite doesn’t have any compression features, so of course I had to
GitHub - dblalock/bolt: 10x faster matrix and vector operations
Bolt is an algorithm for compressing vectors of real-valued data and running mathematical operations directly on the compressed representations. If you have a large collection of mostly-dense vectors and can tolerate lossy compression, Bolt can probably save you 10-200x space and compute time. Bolt also has theoretical guarantees bounding the errors in its approximations. EDIT: this repo now also
Broccoli: Syncing faster by syncing less
// By Rishabh Jain and Daniel Reiter Horn • Aug 04, 2020 Dropbox syncs petabytes of data every day across millions of desktop clients. It is vital that we constantly improve the sync experience for our users, to increase our users’ productivity in their everyday lives. We also constantly strive to better leverage our infrastructure, increasing Dropbox’s operational efficiency. Because the files th
GitHub - AgentD/squashfs-tools-ng: A new set of tools and libraries for working with SquashFS images
SMASH: an efficient compression algorithm for microcontrollers - SEGGER Blog
SMASH: an efficient compression algorithm for microcontrollers One of the things that is driven from the top in SEGGER is that we can always do better. Not satisfied with standard schemes, we wanted to optimize emCompress, SEGGER’s compression library, for: Very fast decompression High compression ratio (uncompressed size divided by compressed size) Small decompressor Limited state in RAM when dec
GitHub - powturbo/Turbo-Range-Coder: TurboRC - Fastest Range Coder + Arithmetic Coding / Fastest Asymmetric Numeral Systems
====================================== Fastest (Branchless) Range Coder / Arithmetic Coder 100% C (C++ headers). OS/Arch: Linux amd/intel, arm, PowerPC, s390x, MacOs+Apple M1. Windows: Mingw, visual c++ No other Range Coder / Arithmetic Coder encode or decode faster with better compression Up to 3 times faster than the next fastest range coder with similar compression ratio Can work as bitwise or/
ランã‚ング
ランã‚ング
メンテナンス
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
LZ_XOR
GitHub - Bulat-Ziganshin/FA: FreeArc'Next
wuffs/doc/spec/rac-related-work.md at main · google/wuffs
GitHub - fcorbelli/zpaqfranz: Deduplicating archiver with encryption and paranoid-level tests. Swiss army knife for the serious backup and disaster recovery manager. Ransomware neutralizer. Win/Linux/Unix
GitHub - openacid/slimarray: SlimArray compresses uint32 into several bits, by using a polynomial to describe overall trend of an array.
The Smartest Compression Features on the Market
GitHub - iczelia/bzip3: A better and stronger spiritual successor to BZip2.
Relations between archive formats
GitHub - phoboslab/qoi: The “Quite OK Image Format†for fast, lossless image compression
GitHub - elfshaker/elfshaker: elfshaker stores binary objects efficiently
GitHub - vteromero/VTEnc: VTEnc C library
GitHub - mhx/dwarfs: A fast high-compression read-only file system for Linux, FreeBSD, macOS and Windows
GitHub - emmanuel-marty/lzsa: Byte-aligned, efficient lossless packer that is optimized for fast decompression on 8-bit micros
GitHub - google/brunsli: Practical JPEG Repacker
{{#tags}}- {{label}}
{{/tags}}