snappy -A fast compressor/decompressor - Google Project HostingCode Archive Skip to content Google About Google Privacy Terms
Kazuho@Cybozu Labs: Compressing URLs in your Webapp, for size and speed
Last year I had a chance to talk about the internals of our service: Pathtraq at Percona Performance Conference (slides), in which I described the methods we use to compress the URLs in our database to below 40% of the original size, however had not released the source code since then. I am sorry for the delay, but have finally uploaded the code to github.com/kazuho/url_compress. It is generally
第11回　転置索引ã®åœ§ç¸® | gihyo.jp
ã¯ã˜ã‚㫠第2回ã§ã€ç´¢å¼•ã¯å¤šãã®å ´åˆåœ§ç¸®ã•ã‚Œã¦ã„ã‚‹ã“ã¨ã«è¨€åŠã—ã¾ã—ãŸã€‚ã¾ãŸç¬¬7回ã§ã¯ã€ç´¢å¼•æ§‹ç¯‰æ™‚ã«ã©ã®éƒ¨åˆ†ã§ç´¢å¼•ã‚’圧縮ã™ã‚Œã°ã‚ˆã„ã‹ã‚’疑似コードを用ã„ã¦èª¬æ˜Žã—ã¾ã—ãŸã€‚今回ã¯ã€è»¢ç½®ç´¢å¼•ã®å…·ä½“çš„ãªåœ§ç¸®æ–¹æ³•ã«ã¤ã„ã¦èª¬æ˜Žã—ã¦ã„ãã¾ã™ã€‚ 圧縮ã®ç›®çš„ ä¸è¦æ¨¡ã‹ã‚‰å¤§è¦æ¨¡ãªç´¢å¼•ã®å ´åˆã€è»¢ç½®ãƒªã‚¹ãƒˆã¯éžå¸¸ã«é•·ããªã‚Šã€æ¤œç´¢æ™‚ã«ã¯ãƒ‡ã‚£ã‚¹ã‚¯ã‹ã‚‰ã®å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã®èªã¿å–ã‚ŠãŒè¡Œã‚ã‚Œã¾ã™ã€‚転置索引（を用ã„ãŸæ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ï¼‰ã§ã¯ã€ã“ã‚Œã«ã‚ˆã‚‹æ¤œç´¢å‡¦ç†æ™‚é–“ã®å¢—åŠ ã‚’é˜²ããŸã‚ã«ã€è»¢ç½®ãƒªã‚¹ãƒˆã‚’圧縮ã—ディスクã‹ã‚‰ã®èªã¿è¾¼ã¿æ™‚é–“ã®çŸç¸®ã‚’図りã¾ã™ã€‚ ã“ã®å ´åˆã€åœ§ç¸®ã•ã‚ŒãŸè»¢ç½®ãƒªã‚¹ãƒˆã‚’ディスクã‹ã‚‰èªã¿è¾¼ã¿ã•ã‚‰ã«å¾©å…ƒå‡¦ç†ã‚’è¡Œã†å¿…è¦ãŒã‚ã‚Šã¾ã™ãŒã€é€šå¸¸ã¯æ¬¡ã®ã‚ˆã†ã«ãªã‚Šã¾ã™ã€‚ ã“ã‚Œã¯ã€è¿‘å¹´ã®CPUã¨ãƒ‡ã‚£ã‚¹ã‚¯ã®é€Ÿåº¦å·®ãŒå¤§ãã„ãŸã‚ã€ä¸»ã«CPUã«ãŠã‘る処ç†ã§ã‚る復元処ç†ãŒé«˜é€Ÿã«è¡Œãˆã‚‹ã“ã¨ã«ã‚ˆã‚‹ã‚‚ã®ã§ã™ã€‚よã£ã¦ã€åœ§ç¸®ã¨ã„ã†ã¨å®¹é‡ã‚’節約ã®æ„図ã§ä½¿ã†ã“ã¨ãŒå¤šã„ã¨æ€ã„ã¾
Data Compression Programs
 Data Compression Programs by Matt Mahoney As of July 23, 2009, this page is no longer maintained. The newest version can be found at http://mattmahoney.net/dc/ All software on this page is open source licensed under GPL and believed to be unencumbered by patents. All downloads include Windows executables and C++ source code for Windows or Linux/UNIX. The source code comments explain how the prog
Simple-9ã«ã¤ã„ã¦è§£èª¬ - tsubosakaã®æ—¥è¨˜
å‰å›žã«å¼•ã続ã転置インデックスã®åœ§ç¸®ã‚’実装ã—ã¦ã¿ã‚‹ã€‚今回紹介ã™ã‚‹ã®ã¯[2]ã§æ案ã•ã‚Œã¦ã„ã‚‹Simple-9ã¨ã„ã†ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã§ã‚る。 Simple-9ã¯32bitã®wordã«ã§ãã‚‹ã ã‘æ•°å—ã‚’è©°ã‚ã¦ã„ãã¨ã„ã†åœ§ç¸®ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã§ã‚る。例ãˆã°2bitã®æ•°ãŒ16個ãªã‚‰ã‚“ã§ã„ã‚Œã°32bitã§è¡¨ç¾ã§ãる。ã—ã‹ã—ã€å®Ÿéš›ã¯å¤§ãã„æ•°å—も出ç¾ã™ã‚‹ãŸã‚æ•°å—ã®é•·ã•ã®æƒ…å ±ã‚‚æ ¼ç´ã™ã‚‹å¿…è¦ãŒã‚る。Simple-9ã§ã¯4bitを用ã„ã¦æ®‹ã‚Šã®28bitãŒã©ã†è©°ã‚られã¦ã„ã‚‹ã‹ã‚’表ã™ã€‚ 28bitã®è¡¨ã—æ–¹ã¨ã—ã¦ã¯ 上ä½bit 符å·ã®å€‹æ•° 符å·ã®ãƒ“ット長 0000 28 1 0001 14 2 0010 9 3 0011 7 4 0100 5 5 0101 4 7 0110 3 9 0111 2 14 1000 1 28 ã®9通りãŒã‚ã‚Šã€ã“ã‚ŒãŒSimple-9ã®åå‰ã®ç”±æ¥ã¨ãªã£ã¦ã„る。 例ãˆã° ( 3 , 5 , 0 , 0 ,
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
{{#tags}}- {{label}}
{{/tags}}