[B! compression] hiromarkã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

hiromark id:hiromark

compressionã«é–¢ã™ã‚‹hiromarkã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (51)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

æ§˜ã€…ãªæ“ä½œã‚’é«˜é€Ÿã«ã‚µãƒãƒ¼ãƒˆã™ã‚‹ãƒ‡ãƒ¼ã‚¿åœ§ç¸®æ³•ã«é–¢ã™ã‚‹è«–æ–‡ã‚’å…¬é–‹ã—ã¾ã—ãŸã€‚ - Yasuo Tabeiã®æ—¥è¨˜
æ§˜ã€…ãªæ“ä½œã‚’é«˜é€Ÿã«ã‚µãƒãƒ¼ãƒˆã™ã‚‹ãƒ‡ãƒ¼ã‚¿åœ§ç¸®æ³•ã«é–¢ã™ã‚‹è«–æ–‡ã‚’å…¬é–‹ã—ã¾ã—ãŸã€‚æœ¬è«–æ–‡ã¯ãƒ‡ãƒ¼ã‚¿åœ§ç¸®ã«é–¢ã™ã‚‹å›½éš›ä¼šè° Data Compression Conference (DCC2015)ã«æŽ¡æŠžã•ã‚ŒãŸè«–æ–‡ã§arXivã‹ã‚‰å…¥æ‰‹å‡ºæ¥ã¾ã™ã€‚ Djamal Belazzougui, Travis Gagie, PaweÅ‚ Gawrychowski, Juha KÃ¤rkkÃ¤inen, Alberto OrdÃ³Ã±ez, Simon J. Puglisi, Yasuo Tabei: Queries on LZ-Bounded Encodings, Data Compression Conference (DCC), 2015. è«–æ–‡ã¸ã®ãƒªãƒ³ã‚¯(arXiv) ææ¡ˆæ³•ã¯Lempel-Ziv(LZ)æ³•ã«é¡žä¼¼æ€§ãŒã‚ã‚Šãã®ç°¡æ˜“ç‰ˆã«ãªã£ã¦ã„ã¾ã™ã€‚LZæ³•ã§ã¯å„ãƒ†ã‚ã‚¹ãƒˆä¸Šã®ä½ç½®ã‚ˆã‚Šå‰ã«å‡ºç¾ã™ã‚‹éƒ¨åˆ†æ–‡å—åˆ—ã®æœ€é•·ä¸€è‡´æ–‡å—ã‚’ãƒ†ã‚ã‚¹ãƒˆ
hiromark 2015/01/09
compression

algorithm
ãƒªãƒ³ã‚¯
æ–‡æ³•åœ§ç¸®å…¥é–€ï¼šè¶…é«˜é€Ÿãƒ†ã‚ã‚¹ãƒˆå‡¦ç†ã®ãŸã‚ã®ãƒ‡ãƒ¼ã‚¿åœ§ç¸®ï¼ˆNLP2014ãƒãƒ¥ãƒ¼ãƒˆãƒªã‚¢ãƒ«ï¼‰
è¨€èªžå‡¦ç†å¦ä¼šç¬¬ï¼’ï¼å›žå¹´æ¬¡å¤§ä¼šï¼ˆ2014/3ï¼‰ã®ãƒãƒ¥ãƒ¼ãƒˆãƒªã‚¢ãƒ«è¬›ç¾©è³‡æ–™ã§ã™ã€‚ - è¦æ—¨ - æ–‡æ³•åœ§ç¸®ã¨ã¯ï¼Œå…¥åŠ›ãƒ†ã‚ã‚¹ãƒˆã‚’ã‚ˆã‚Šã‚³ãƒ³ãƒ‘ã‚¯ãƒˆãªæ–‡è„ˆè‡ªç”±æ–‡æ³•ï¼ˆCFGï¼‰ã«å¤‰æ›ã™ã‚‹åœ§ç¸®æ³•ã®ç·ç§°ã§ã‚ã‚‹ï¼Ž æ–‡æ³•åœ§ç¸®ã®å¼·ã¿ã¯åœ§ç¸®ãƒ†ã‚ã‚¹ãƒˆã‚’å±•é–‹ã™ã‚‹ã“ã¨ç„¡ãï¼Œæ¤œç´¢ç‰ã®ãƒ†ã‚ã‚¹ãƒˆå‡¦ç†ã‚’åŠ¹çŽ‡ã‚ˆãè¡Œãˆã‚‹ç‚¹ã«ã‚ã‚‹ï¼Ž é©šãã¹ãã“ã¨ã«ãã®å‡¦ç†é€Ÿåº¦ã¯ï¼Œå…ƒãƒ†ã‚ã‚¹ãƒˆä¸Šã§ã®åŒã˜å‡¦ç†ã‚’ç†è«–çš„ã«ï¼Œæ™‚ã«ã¯å®Ÿéš›ã«ã‚‚å‡Œé§•ã™ã‚‹ï¼Ž ã¾ãŸè¿‘å¹´ï¼Œã‚¦ã‚§ãƒ–ã‚¢ãƒ¼ã‚«ã‚¤ãƒ–ã‚„ãƒã‚°ï¼Œã‚²ãƒŽãƒ é…åˆ—ç‰ã®å¤§è¦æ¨¡å®Ÿãƒ‡ãƒ¼ã‚¿ã‚’é«˜åŠ¹çŽ‡ã«åœ§ç¸®ã§ãã‚‹ã“ã¨ã§æ³¨ç›®ã‚’é›†ã‚ã¦ã„ã‚‹ï¼Ž ã—ã‹ã—ãªãŒã‚‰ï¼Œæ–‡æ³•åœ§ç¸®ã«ã¤ã„ã¦ã®åˆå¦è€…å‘ã‘ã®è§£èª¬è³‡æ–™ã¯ã¾ã ã¾ã å°‘ãªã„ï¼Ž ãã“ã§æœ¬ãƒãƒ¥ãƒ¼ãƒˆãƒªã‚¢ãƒ«ã§ã¯ï¼Œæ–‡æ³•åœ§ç¸®ã®æ´å²çš„èƒŒæ™¯ã‹ã‚‰æœ€æ–°å‹•å‘ã¾ã§ã‚’å¹…åºƒãç´¹ä»‹ã™ã‚‹ï¼Ž å…·ä½“çš„ã«ã¯æ–‡æ³•å¤‰æ›ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ï¼Œåœ§ç¸®ãƒ†ã‚ã‚¹ãƒˆä¸Šã§ã®æ–‡å—åˆ—ãƒ‘ã‚¿ãƒ¼ãƒ³æ¤œç´¢ï¼Œæ–‡æ³•åœ§ç¸®ã«åŸºã¥ãçœãƒ¡ãƒ¢ãƒªãƒ‡ãƒ¼ã‚¿æ§‹é€ ç‰ã®è§£èª¬ã‚’è¡Œã†ï¼ŽRead less
hiromark 2014/03/19
algorithm

compression
ãƒªãƒ³ã‚¯
æ¥“ software: mozjpeg ã¯ã©ã®ã‚ˆã†ã«ã—ã¦åœ§ç¸®çŽ‡ã‚’ä¸Šã’ã¦ã„ã‚‹ã®ã‹ï¼Ÿ
Â« Android å¯¾å¿œå¿…è¦é …ç›®ã¨å·¥æ•°è¦‹ç©ã‚‚ã‚Š | ãƒ¡ã‚¤ãƒ³ | Lanczos3 ã‚’çµ„ã¿è¾¼ã‚“ã Â» 2014å¹´03æœˆ10æ—¥ Misc.:: mozjpeg ã¯ã©ã®ã‚ˆã†ã«ã—ã¦åœ§ç¸®çŽ‡ã‚’ä¸Šã’ã¦ã„ã‚‹ã®ã‹ï¼Ÿ TweetÂ Â Â Â @jin1016ã‚’ãƒ•ã‚©ãƒãƒ¼ ã–ã£ãã‚Šã‚½ãƒ¼ã‚¹ã‚³ãƒ¼ãƒ‰è¦‹ãŸã‚Šã—ãŸã ã‘ãªã®ã§ã€é–“é•ã£ã¦ã„ã‚‹ã‹ã‚‚ã—ã‚Œãªã„ãŒæ›¸ã„ã¦ãŠãã€‚ ä¸€è¨€ã§æ›¸ãã¨ã€Œãƒ—ãƒã‚°ãƒ¬ãƒƒã‚·ãƒ–æ–¹å¼ã§ã€DCæˆåˆ†ã®åˆ†å‰²ã‚µã‚¤ã‚ºã‚’æœ€é©ãªã‚‚ã®ã«ã™ã‚‹ã“ã¨ã§åã‚Šã‚’å¢—ã‚„ã—åœ§ç¸®çŽ‡ã‚’ä¸Šã’ã¦ã„ã‚‹ã€ã¨ã„ã†ã“ã¨ã®ã‚ˆã†ã ã€‚ ã“ã®èª¬æ˜Žã ã¨çŸ¥ã£ã¦ã„ã‚‹äººä»¥å¤–ã«ã¨ã£ã¦ã¯æ„å‘³ä¸æ˜Žã ã¨æ€ã†ã®ã§ã€ã©ã®ã‚ˆã†ã«åœ§ç¸®ã—ã¦ã„ã‚‹ã®ã‹ã‚ã‚‹ç¨‹åº¦èª¬æ˜Žã—ã€ãªãœåœ§ç¸®çŽ‡ãŒä¸ŠãŒã‚‹ã®ã‹èª¬æ˜Žã—ã¦ã¿ã‚‹ã€‚ JPEG ã§ã¯ã€è‰²ç©ºé–“å¤‰æ› â†’ DCT â†’ é‡ååŒ– â†’ ãƒãƒ•ãƒžãƒ³ç¬¦å·åŒ–+ãƒ©ãƒ³ãƒ¬ãƒ³ã‚°ã‚¹ ã¨è¨€ã†æ‰‹é †ã§åœ§ç¸®ã—ã¦ã„ã‚‹ã€‚ ã“ã®ä¸ã§å®Ÿéš›ã«åœ§ç¸®ã‚’è¡Œã£ã¦ã„ã‚‹ã®ã¯ã€ã€Œãƒãƒ•ãƒžãƒ³ç¬¦å·åŒ–ã€ã¨ã€Œãƒ©ãƒ³ãƒ¬ãƒ³ã‚°ã‚¹ã€ã®éƒ¨åˆ†ã€‚ ã“ã‚Œ
hiromark 2014/03/12
image

compression
ãƒªãƒ³ã‚¯
30åˆ†ã§ã‚ã‹ã‚‹é«˜æ€§èƒ½ãªåœ§ç¸®ç¬¦å·vertical code - EchizenBlog-Zwei
æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã®è»¢ç½®ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ãªã©ãƒ‡ãƒ¼ã‚¿åˆ—ã‚’å°ã•ã„ãƒ‡ãƒ¼ã‚¿ã‚µã‚¤ã‚ºã§æŒãŸã›ãŸã„ã€ã¨ã„ã†çŠ¶æ³ãŒã‚ã‚‹ã€‚ã“ã†ã„ã†å ´åˆåœ§ç¸®ç¬¦å·ã‚’ä½¿ã†ã®ãŒä¸€èˆ¬çš„ã§unaryç¬¦å·ã‚„gammaç¬¦å·ã€deltaç¬¦å·ãªã©æ§˜ã€…ãªç¨®é¡žãŒã‚ã‚‹ã€‚ åœ§ç¸®ç¬¦å·ã®ä¸ã§ã‚¤ãƒã‚ªã‚·ãªã®ãŒvertical code(vcode)ã€‚ã“ã‚Œã¯å²¡é‡ŽåŽŸ(@hillbig)æ°ã«ã‚ˆã£ã¦ææ¡ˆã•ã‚ŒãŸåœ§ç¸®ç¬¦å·ã§å˜ç´”ãªä»•çµ„ã¿ã§deltaç¬¦å·ä¸¦ã®æ€§èƒ½ã‚’èª‡ã£ã¦ã„ã‚‹ã€‚ æœ¬è¨˜äº‹ã§ã¯vcodeã®ãƒã‚¤ãƒ³ãƒˆã‚’çµžã£ã¦30åˆ†ã§ã‚ã‹ã‚‹ã‚ˆã†ã«è§£èª¬ã—ã¦ã¿ã‚‹ã€‚ vcodeã¯æœ¬æ£šã«æœ¬ã‚’ä¸¦ã¹ã‚‹ä½œæ¥ã‚’é€£æƒ³ã™ã‚‹ã¨ç†è§£ã—ã‚„ã™ã„ã€‚æœ¬æ£šã¯äºˆã‚é«˜ã•ãŒæ±ºã¾ã£ã¦ã„ã‚‹ã®ã§å…¨ã¦ã®æœ¬ãŒå…¥ã‚‹ã‚ˆã†ãªæœ¬æ£šã‚’ç”¨æ„ã™ã‚‹ã€‚ã¤ã¾ã‚Š ã¨ã„ã†ã‚ˆã†ãªã‚‚ã®ã‚’æƒ³åƒã™ã‚‹ã€‚ ã“ã®æœ¬æ£šã¯8å†Šã®æœ¬ãŒä¸¦ã‚“ã§ã„ã‚‹ãŒå·¦ã‹ã‚‰5å†Šç›®ã®æœ¬ãŒä»–ã‚ˆã‚Šã‚‚èƒŒãŒé«˜ã„ã€‚ã“ã®ãŸã‚5å†Šç›®ã®æœ¬ã«åˆã‚ã›ã¦èƒŒã®é«˜ã„æœ¬æ£šãŒå¿…è¦ã«ãªã‚‹ã€‚ã ãŒä»–ã®æœ¬ã¯5å†Šç›®ã®æœ¬ã»ã©ã«èƒŒãŒé«˜ããªã„ã®ã§ã€5å†Šç›®ãŒ
hiromark 2011/11/13
ã‚ã¨ã§ã‚ˆã‚€ã€‚

algorithm

compression

todo
ãƒªãƒ³ã‚¯
overlasting.net
overlasting.net 2019 Copyright. All Rights Reserved. The Sponsored Listings displayed above are served automatically by a third party. Neither the service provider nor the domain owner maintain any relationship with the advertisers. In case of trademark issues please contact the domain owner directly (contact information can be found in whois). Privacy Policy
hiromark 2011/04/20
ã‚ã¨ã§è¿½ã†ã€‚

hadoop

compression

è¦æ³¨ç›®
ãƒªãƒ³ã‚¯
HTTPã‚³ãƒ³ãƒ†ãƒ³ãƒ„åœ§ç¸®ã¨Plack - blog.nomadscafe.jp
ã€ŒHTTPã‚³ãƒ³ãƒ†ãƒ³ãƒ„åœ§ç¸®ã¯ã©ã®ãƒ¬ã‚¤ãƒ¤ãƒ¼ã§è¡Œã†ã®ãŒã„ã„ã‹ã€ã§æ›¸ã„ãŸã‚Šã—ã¾ã—ãŸãŒã€é«˜ãƒˆãƒ©ãƒ•ã‚£ãƒƒã‚¯ç’°å¢ƒã§ã¯ã€ã‚µãƒ¼ãƒé–“ã®é€šä¿¡é‡ã‚‚å•é¡Œã¨ãªã‚‹ãŸã‚ã€Applicationã‚µãƒ¼ãƒã§ã‚‚HTTPåœ§ç¸®ã‚’ã‹ã‘ãŸã»ã†è‰¯ã•ã’ã§ã™ã€‚Plackã«ã¯æ—¢ã«Plack::Middleware::Deflaterã¨ã„ã†Apacheã®mod_deflateç›¸å½“ã®MiddlewareãŒã‚ã‚‹ã®ã§ã™ãŒã€ã¡ã‚‡ã„ã¡ã‚‡ã„å¼„ã£ã¦ã„ãŸã‚Šã™ã‚‹ã®ã§ãã®ç´¹ä»‹ã€‚ ãã®å‰ã«ã€HTTPã‚³ãƒ³ãƒ†ãƒ³ãƒ„åœ§ç¸®ã®ãŠã•ã‚‰ã„ã§ã™ã€‚HTTPåœ§ç¸®ã¯ãƒªã‚¯ã‚¨ã‚¹ãƒˆã®Accept-Encodingã«gzipã‚„deflateãŒã‚ã£ãŸå ´åˆã«ã€ã‚³ãƒ³ãƒ†ãƒ³ãƒ„ã‚’gzipã€deflateãªã©ã§åœ§ç¸®ã—ã€ãƒ¬ã‚¹ãƒãƒ³ã‚¹ã®Content-Encodingãƒ˜ãƒƒãƒ€ã«åœ§ç¸®ã«ç”¨ã„ãŸæ–¹å¼ã‚’è¡¨è¨˜ã™ã‚‹ã“ã¨ã§å®Ÿç¾ã•ã‚Œã¾ã™ã€‚ã•ã‚‰ã«ã€ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã‚µãƒ¼ãƒé–“ã«ã‚ãƒ£ãƒƒã‚·ãƒ¥ã‚µãƒ¼ãƒãŒå˜åœ¨ã—ãŸå ´åˆã«ã€Accept-Encodingã‚’é€ã£ã¦
hiromark 2011/02/14
http

compression
ãƒªãƒ³ã‚¯
HTTPã‚³ãƒ³ãƒ†ãƒ³ãƒ„åœ§ç¸®ã¯ã©ã®ãƒ¬ã‚¤ãƒ¤ãƒ¼ã§è¡Œã†ã®ãŒã„ã„ã‹ - blog.nomadscafe.jp
Reverse Proxyã¨Application Serverã®2æ®µæ§‹æˆã§Webã‚µãƒ¼ãƒ“ã‚¹ã‚’é‹ç”¨ã—ã¦ã„ã‚‹å ´åˆã€mod_deflateãªã©ã®HTTPã‚³ãƒ³ãƒ†ãƒ³ãƒ„åœ§ç¸®ã‚’ã©ã¡ã‚‰ã§ã‚„ã‚‹ã®ãŒã„ã„ã®ã ã‚ã†ã‹ å°‘ã—è€ƒãˆã¦ã¿ã‚‹ã¨ã€Reverse Proxyã§ä¸€æ‹¬ã—ã¦ã‚³ãƒ³ãƒ†ãƒ³ãƒ„åœ§ç¸®ã™ã‚‹å ´åˆã¯ã€åœ§ç¸®ã«é–¢ã™ã‚‹è¨å®šã‚’1ã‚«æ‰€ã§ã¾ã¨ã‚ã‚‰ã‚Œã‚‹ã¨ã„ã†åˆ©ç‚¹ãŒã‚ã‚‹ã€ãŸã ã—ã€Reverse Proxyã¨Application Serverã¨ã®é–“ã¯æœªåœ§ç¸®ã§æµã‚Œã‚‹ãŸã‚ã€ã“ã®é–“ã§é€šä¿¡é‡ãŒå¤šããªã‚‹ã€‚ é€†ã«Application Serverã§ã‚‚åœ§ç¸®ã—ãŸå ´åˆã¯ã€åœ§ç¸®ã®è¨å®šã‚’ä¸¡æ–¹ã®ã‚µãƒ¼ãƒã«æ›¸ãå¿…è¦ãŒã‚ã‚‹ãŒã€ã‚µãƒ¼ãƒé–“ã§ã®é€šä¿¡é‡ã¯æ¸›ã‚‰ã™ã“ã¨ãŒã§ãã‚‹ã€‚ ãŠãã‚‰ãWebã‚µãƒ¼ãƒ“ã‚¹ã®è¦æ¨¡ãŒå°ã•ã„ã†ã¡ã¯ã€ã‚µãƒ¼ãƒé–“ã§ã®é€šä¿¡é‡ãŒæ°—ã«ãªã‚‹ã“ã¨ã¯ãªã„ã®ã§å‰è€…ã®è¨å®šã‚’ä¸€ã‚«æ‰€ã«ã¾ã¨ã‚ã‚‹ã»ã†ãŒã‚ˆãã€Application Serverã®å°æ•°ãŒ10å°ã€œ20å°ç¨‹åº¦ã«ãªã£ã¦
hiromark 2011/02/02
http

compression
ãƒªãƒ³ã‚¯
ã€Œç¬¬3å›žè‡ªç„¶è¨€èªžå‡¦ç†å‹‰å¼·ä¼šï¼ æ±äº¬ã€ã§CSAã«ã¤ã„ã¦ç™ºè¡¨ã—ã¾ã™ - EchizenBlog-Zwei
@nokunoã•ã‚“ã®å¥½æ„ã§ã€Œç¬¬3å›žè‡ªç„¶è¨€èªžå‡¦ç†å‹‰å¼·ä¼šï¼ æ±äº¬ã€ã§Compressed Suffix Arrayã«ã¤ã„ã¦ç™ºè¡¨ã•ã›ã¦ã„ãŸã ãã“ã¨ã«ãªã‚Šã¾ã—ãŸã€‚ ã¤ãã¾ã—ã¦ã¯å‚è€ƒã®ãŸã‚ç™ºè¡¨è³‡æ–™ã‚’ä»¥ä¸‹ã«ç½®ã„ã¦ãŠãã¾ã™ã€‚å‚åŠ ã•ã‚Œã‚‹æ–¹ã¯ã‚‚ã¡ã‚ã‚“ã€èˆˆå‘³ã®ã‚ã‚‹æ–¹ã¯ã”è¦§ã«ãªã£ã¦ã„ãŸã ã‘ã‚‹ã¨ã†ã‚Œã—ã„ã§ã™ã€‚ ç¬¬3å›žè‡ªç„¶è¨€èªžå‡¦ç†å‹‰å¼·ä¼šï¼ æ±äº¬ : ATND ç¬¬3å›žè‡ªç„¶è¨€èªžå‡¦ç†å‹‰å¼·ä¼šï¼ æ±äº¬ã‚’é–‹å‚¬ã—ã¾ã™ - nokunoã®æ—¥è¨˜ ãªãŠæœ¬è³‡æ–™ã¯ä»¥ä¸‹ã®çš†æ§˜ã®ã‚¢ãƒ‰ãƒã‚¤ã‚¹ã‚’é ‚ãã¾ã—ãŸã€‚ã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã—ãŸ(ã¨ãã«@overlastã•ã‚“ã«ã¯4-5æ™‚é–“ã‚‚ãŠä»˜ãåˆã„é ‚ãã¾ã—ãŸã€‚ãŠã‹ã’ã•ã¾ã§ã‚¹ãƒ©ã‚¤ãƒ‰ã®è³ªãŒå¤§å¹…ã‚¢ãƒƒãƒ—ã—ã¾ã—ãŸã€‚æ„Ÿè¬)ã€‚ @overlastã•ã‚“ @tamago_donburiã•ã‚“ @tsubosakaã•ã‚“ @machyã•ã‚“
hiromark 2010/11/10
ã“ã®è©±ã‚’ã“ã“ã¾ã§ãã‚Œã„ã«ã¾ã¨ã‚ã‚‹ã¨ã¯ã™ã°ã‚‰ã—ã„ã€‚

suffixarray

compression

nlp

ir

algorithm
ãƒªãƒ³ã‚¯
CSAã‚’ä½¿ã£ãŸå…¨æ–‡æ¤œç´¢ãƒ©ã‚¤ãƒ–ãƒ©ãƒªtsubomiã‚’å…¬é–‹ã—ã¦ã¿ã‚‹ - EchizenBlog-Zwei
ã—ã°ã‚‰ãå‰ã‹ã‚‰ä½œã£ã¦ã„ãŸå…¨æ–‡æ¤œç´¢ãƒ©ã‚¤ãƒ–ãƒ©ãƒªtsubomiã‚’å…¬é–‹ã—ã¦ãŠãã€‚ æœ¬ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã¯æŽ¥å°¾è¾žé…åˆ—(Suffix Array)ã¨ã„ã†ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã‚’ä½¿ã£ã¦ã„ã¦ã€å…¥åŠ›ã¨ã—ã¦ä¸ŽãˆãŸã‚ãƒ¼ãƒ¯ãƒ¼ãƒ‰ã‚’å«ã‚€è¡Œã‚’ãƒ†ã‚ã‚¹ãƒˆãƒ‡ãƒ¼ã‚¿ã‹ã‚‰æŽ¢ã—ã¦ã€ãã®è¡Œã¨å‡ºç¾ä½ç½®ã‚’å–å¾—ã§ãã‚‹ã€‚ã•ã‚‰ã«åœ§ç¸®æŽ¥å°¾è¾žé…åˆ—(Compressed Suffix Array)ã«ã‚ˆã‚‹åœ§ç¸®ã‚‚ã‚µãƒãƒ¼ãƒˆã—ã¦ã„ã‚‹ã®ã§ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ã‚µã‚¤ã‚ºã‚’å°ã•ãæŠ‘ãˆã‚‹ã“ã¨ãŒã§ãã‚‹ã€‚ æœ¬ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã¯æ¤œç´¢ã®ãŸã‚ã®APIã®ã»ã‹ã«ã€ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ä½œæˆã€åœ§ç¸®ã€æ¤œç´¢ã‚’è¡Œã†ãƒ„ãƒ¼ãƒ«ãŒä»˜å±žã—ã¦ã„ã‚‹ã€‚ãƒ„ãƒ¼ãƒ«ã‚’ä½¿ã†ã ã‘ã§ã‚‚ã€ã‚ã‚‹ç¨‹åº¦ã®ã“ã¨ãŒã§ãã‚‹ã€‚ ä»¥ä¸‹ã€ç°¡å˜ã«ç´¹ä»‹ã€‚ tsubomiã¯GoogleCodeã§ã‚³ãƒ¼ãƒ‰ã‚’ç®¡ç†ã—ã¦ã„ã‚‹ã€‚è©³ç´°ã¯ä¸‹è¨˜URLã‚’å‚ç…§ã€‚ http://code.google.com/p/tsubomi/ ã‚³ãƒ¼ãƒ‰ç®¡ç†ã«ã¯subversionã‚’ä½¿ã£ã¦ã„ã‚‹ã®ã§ $$ svn checkou
hiromark 2010/09/05
ãŠãŠã€ã“ã‚Œã¯ GJ!

ir

compression

suffixarray

library
ãƒªãƒ³ã‚¯
åœ§ç¸®æŽ¥å°¾è¾žé…åˆ—ãƒ©ã‚¤ãƒ–ãƒ©ãƒª csalibã®åœ§ç¸®çŽ‡ã®é«˜ã•ã¯ç•°å¸¸ - EchizenBlog-Zwei
åœ§ç¸®æŽ¥å°¾è¾žé…åˆ—ã®ç¬¬ä¸€äººè€…ã€å®šå…¼å…ˆç”ŸãŒé–‹ç™ºã€å…¬é–‹ã—ã¦ãã ã•ã£ã¦ã„ã‚‹csalibã‚’è©¦ã—ã¦ã¿ãŸã®ã§ãƒ¡ãƒ¢ã€‚ http://researchmap.jp/sada/csalib/ ã¾ãšã¯googlecodeã‹ã‚‰csalibã¨dbwtã‚’å…¥æ‰‹ã€‚è§£å‡ã—makeã™ã‚‹ã€‚ $$ mkdir csalib/ $$ cd csalib/ $$ wget http://csalib.googlecode.com/file/csalib100810.zip $$ unzip csalib100810.zip $$ make $$ cd .. $$ mkdir dbwt/ $$ cd dbwt/ $$ wget http://csalib.googlecode.com/file/dbwt100730.zip $$ make $$ cd ..ã“ã®ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã¯dbwtã§ãƒ†ã‚ã‚¹ãƒˆã‚’Burrows-Wheelerå¤‰æ›ã—ã€ãã®å¾Œm
hiromark 2010/08/19
ãƒ¡ãƒ¢ãƒ¡ãƒ¢ã€‚

compression

suffixarray
ãƒªãƒ³ã‚¯
5åˆ†ã§ã‚ã‹ã‚‹(ã‹ã‚‚ã—ã‚Œãªã„)åœ§ç¸®ã®åŸºæœ¬ - EchizenBlog-Zwei
å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’æ—¥å¸¸çš„ã«æ‰±ã†äººã«ã¨ã£ã¦ã€ãƒ‡ãƒ¼ã‚¿åœ§ç¸®ã¯åŸºæœ¬ã€‚çµ¶å¯¾ãªã„ã¨å›°ã‚‹ã‚ã‘ã§ã¯ãªã„ã‘ã©ã€ã‚ã‚‹ã¨æ ¼æ®µã«ä¸–ç•ŒãŒåºƒãŒã‚‹ã€‚ãƒ‰ãƒ©ã‚¯ã‚¨ã§è¨€ã†ã¨ã“ã‚ã®ãƒ«ã‚«ãƒ‹ã¿ãŸã„ãªã‚‚ã®ã€‚ ã§ã‚‚åœ§ç¸®ã¨ã„ã†ã¨ãƒ‡ãƒ¼ã‚¿ã‚’ãƒã‚¤ãƒŠãƒªã§æŒãŸãªã„ã¨ã„ã‘ãªã„ã¨ã‹ã€ãªã‚“ã¨ãªãé¢å€’ãªã®ã§ç›®ã‚’èƒŒã‘ãŒã¡ã€‚ãã“ã§5åˆ†ã§ã‚ã‹ã‚‹ã‚ˆã†ãªæ„Ÿã˜ã§èª¬æ˜Žã‚’æ›¸ã„ã¦ãŠãã€‚ åŸºæœ¬çš„ãªåœ§ç¸®ã®æ–¹æ³•ã¯å·®åˆ†åœ§ç¸®ã¨ã„ã†ã®ãŒã‚ã‚‹ã€‚ä»Šå›žã¯ã“ã‚Œã‚’èª¬æ˜Žã™ã‚‹ã€‚ charåž‹ã®ãƒ‡ãƒ¼ã‚¿ãŒ8ã¤ä¸¦ã‚“ã§ã„ã‚‹ã¨è€ƒãˆã‚‹ã€‚ 6 3 2 1 7 5 4 8ã¨ã‚Šã‚ãˆãšãƒã‚¤ãƒŠãƒªã«ã—ã¦ã¿ã‚‹ã€‚ä¾¿å®œä¸Šã€ç¸¦ã«æ›¸ãã€‚ 6 3 2 1 7 5 4 8 =============== 1ã®ä½:0 1 0 1 1 1 0 0 2ã®ä½:1 1 1 0 1 0 0 0 4ã®ä½:1 0 0 0 1 1 1 0 8ã®ä½:0 0 0 0 0 0 0 1 16ã®ä½:0 0 0 0 0 0 0 0 32ã®ä½:0 0 0 0 0 0 0 0
hiromark 2010/08/05
ã‚ã‚ã€ã“ã†èª¬æ˜Žã™ã‚Œã°ã¾ãšã¯ã‚ã‹ã‚Šã‚„ã™ã„ã®ã‹ã€‚ã€‚ã€‚

compression
ãƒªãƒ³ã‚¯
æƒ…å ±åœ§ç¸®ã¨ç‰¹è¨±
â– åˆã‚ã« ã“ã‚Œã¾ã§ã€GIF ã® LZW ã‚’åˆã‚ã¨ã™ã‚‹æƒ…å ±åœ§ç¸®ã«é–¢ã™ã‚‹ç‰¹è¨±ãŒã€æ§˜ã€…ãªã¨ã“ã‚ã§å–ã‚Šä¸Šã’ã‚‰ã‚Œè«–è°ã‚’å‘¼ã‚“ã§ãã¾ã—ãŸãŒã€ã—ã‹ã—ã€å…·ä½“çš„ãªå†…å®¹ã«è¸ã¿è¾¼ã‚“ã ã‚‚ã®ã¯å°‘ãªã‹ã£ãŸã‚ˆã†ã«æ€ã„ã¾ã™ã€‚ ä¾‹ãˆã°ã€LZW ã®ç‰¹è¨±ã«ã—ã¦ã‚‚ã€LZW ã®ã©ã®éƒ¨åˆ†ã«ç‰¹è¨±æ¨©ãŒèªã‚ã‚‰ã‚Œã¦ã„ã‚‹ã®ã‹ã€ã¨è¨€ã†éƒ¨åˆ†ã¯æ®†ã©è§¦ã‚Œã‚‰ã‚Œã¦ã„ãªã‹ã£ãŸã¨æ€ã„ã¾ã™ã€‚ ã—ã‹ã—ã€ã“ã‚Œã§ã¯ç„¡æ„å‘³ãªç‰¹è¨±ä¸å®‰ãŒåºƒãŒã‚‹ã°ã‹ã‚Šã§ã€ä»Šå¾Œã®åœ§ç¸®æŠ€è¡“ã®æ™®åŠã«å¤§ããªå½±ã‚’è½ã¨ã—ã‹ãã¾ã›ã‚“ã€‚å®Ÿéš›ã€ç‰¹è¨±ã«æŠµè§¦ã™ã‚‹ã‹ã‚‚ã—ã‚Œãªã„ã¨è¨€ã†ç†ç”±ã ã‘ã§å…¬é–‹ã‚’åœæ¢ã—ãŸã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã¯å¤šæ•°å˜åœ¨ã—ã¾ã™ã€‚ ãã“ã§ã€ç§ãŒã“ã‚Œã¾ã§ç ”ç©¶ã—ã¦ããŸåœ§ç¸®æŠ€è¡“ã¨ã€èª¿æŸ»ã—ãŸç‰¹è¨±ã«é–¢ã—ã¦ã€ä¸€éƒ¨ä¾‹ã‚’æŒ™ã’ãªãŒã‚‰ã€æ³•å¾‹çš„ãªå´é¢ã€æŠ€è¡“çš„ãªå´é¢ã®ä¸¡é¢ã‹ã‚‰ã€æƒ…å ±åœ§ç¸®ã®ç‰¹è¨±ã«ã¤ã„ã¦è€ƒãˆã¦ã¿ãŸã„ã¨æ€ã„ã¾ã™ã€‚ â– ç‰¹è¨±ã¨ã¯ï¼Ÿ ãã‚Œã§ã¯ç‰¹è¨±ã¨ã¯å…·ä½“çš„ã«ã©ã®ã‚ˆã†ãªæ€§è³ªã®ã‚‚ã®ã§ã—ã‚‡ã†ã‹ï¼Ÿ ç‰¹è¨±ã¨ã¯ã€çŸ¥çš„è²¡ç”£æ¨©åˆ¶åº¦ã®ä¸ã§ã€ç™ºæ˜Ž
hiromark 2010/07/04
patent

compression
ãƒªãƒ³ã‚¯
æ•´æ•°åˆ—åœ§ç¸® ãã®2 - NewPFD -ï½œJAVAã§ãƒ‡ãƒ¼ã‚¿ãƒžã‚¤ãƒ³ã‚°ï¼
JAVAã§ãƒ‡ãƒ¼ã‚¿ãƒžã‚¤ãƒ³ã‚°ï¼ ã€Žæƒ…å ±å·¥å¦ã®é›£ã—ã„ãã†ãªã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã‚’JAVAã§å®Ÿè£…ã—ã¦ã€ã²ãŸã™ã‚‰ãã®çµæžœã‚’å…¬é–‹ã™ã‚‹ã€ãƒ–ãƒã‚°ã«ãªã‚‹äºˆå®šã€‚ PR Calendar <<April>> S M T W T F S 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 Theme NaiveBayes ( 2 ) ã‚¹ãƒ ãƒ¼ã‚¸ãƒ³ã‚° ( 0 ) ã¯ã˜ã‚ã« ( 1 ) è¨ˆç®—ãƒ†ã‚¯ãƒ‹ãƒƒã‚¯ ( 0 ) æ•´æ•°åˆ—åœ§ç¸® ( 2 ) å¤–ã‚Œå€¤é™¤åŽ» ( 0 ) LSH ( 4 ) å”èª¿ãƒ•ã‚£ãƒ«ã‚¿ãƒªãƒ³ã‚° ( 0 ) ãƒ–ãƒ¼ã‚¹ãƒ†ã‚£ãƒ³ã‚° ( 0 ) Kmeans ( 0 ) éšŽå±¤çš„ã‚¯ãƒ©ã‚¹ã‚¿ãƒªãƒ³ã‚° ( 2 ) EMã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ( 0 ) BM ( 0 ) SVD ( 0 ) PLSI ( 0 ) LDA ( 0 ) ãƒ‘ãƒ¼ã‚»ãƒ—ãƒˆãƒ
hiromark 2010/04/07
ã˜ã£ãã‚Šã‚ˆã‚€

compression

algorithm
ãƒªãƒ³ã‚¯
LZMA SDK (Software Development Kit)
What's new: 24.05: New filter for RISC-V executables. 23.01: New filter for ARM64 executables. BCJ2 filter was improved for better compression ratio. Some bugs were fixed. 21.07: Some minor changes and fixes. 21.06: The bug in LZMA encoding function was fixed. 21.03 beta: LZMA dicrionary up to 4 GB. Speed optimizations. 21.02 alpha: macOS and Linux support. Speed optimizations. 19.00: Encryption s
hiromark 2010/03/03
compression

algorithm
ãƒªãƒ³ã‚¯
Daisuke Okanohara on Twitter: ""On Compressing the Textual Web", WSDM 2010, P. Ferragina, å¤§é‡ã®ã‚¦ã‚§ãƒ–ãƒšãƒ¼ã‚¸æœ¬ä½“ã‚’åœ§ç¸®æ ¼ç´ã— (1)ã‚·ãƒ¼ã‚±ãƒ³ã‚·ãƒ£ãƒ« (2)ãƒ©ãƒ³ãƒ€ãƒ ã«ãƒšãƒ¼ã‚¸æ¯Ž, ã«ã‚¢ã‚¯ã‚»ã‚¹ã™ã‚‹å ´åˆã§æ¯”è¼ƒã€‚çµè«–:gzipã§ã¯ãªãlzma, bmiã‚’ä½¿ãˆ"
"On Compressing the Textual Web", WSDM 2010, P. Ferragina, å¤§é‡ã®ã‚¦ã‚§ãƒ–ãƒšãƒ¼ã‚¸æœ¬ä½“ã‚’åœ§ç¸®æ ¼ç´ã— (1)ã‚·ãƒ¼ã‚±ãƒ³ã‚·ãƒ£ãƒ« (2)ãƒ©ãƒ³ãƒ€ãƒ ã«ãƒšãƒ¼ã‚¸æ¯Ž, ã«ã‚¢ã‚¯ã‚»ã‚¹ã™ã‚‹å ´åˆã§æ¯”è¼ƒã€‚çµè«–:gzipã§ã¯ãªãlzma, bmiã‚’ä½¿ãˆ
hiromark 2010/03/03
compression
ãƒªãƒ³ã‚¯
Compressed Suffix Arrayã®è§£èª¬(1) -Suffix Array- - EchizenBlog-Zwei
< ---- < | > Compressed Suffix Arrayã®è§£èª¬(2) -SAã®è¨ˆç®—é‡- > ================================================ æœ€è¿‘(ã§ã‚‚ãªã„ã‹)è©±é¡Œã®Compressed Suffix Array(CSA)ã«ã¤ã„ã¦è§£èª¬ã—ã¦ã¿ã‚‹ã€‚ CSAã¨ã¯Suffix Array(SA)ã®ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ã‚’åœ§ç¸®ã—ã¦å°ã•ãã—ãŸã‚‚ã®ã€‚å¤§è¦æ¨¡ãƒ†ã‚ã‚¹ãƒˆãƒ‡ãƒ¼ã‚¿ã«å¯¾ã™ã‚‹æ¤œç´¢ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ã‚’ä½œã‚‹å ´åˆãªã©å°‘ã—ã§ã‚‚ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ã‚’å°ã•ãã—ãŸã„å ´åˆã«ä½¿ã‚ã‚Œã‚‹ã€‚ CSAã‚’çŸ¥ã‚‹ã«ã¯SAã‹ã‚‰ï¼ã¨ã„ã†ã“ã¨ã§ä»Šå›žã¯SAã®è§£èª¬ã‚’ã€‚ Suffix Array(SA)ã¨ã¯ãƒ‡ãƒ¼ã‚¿æ§‹é€ ã®ä¸€ç¨®ã§äº‹å‰ã«(ã‚µã‚¤ã‚ºãŒNã®)ãƒ†ã‚ã‚¹ãƒˆã«å¯¾ã—ã¦ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ã‚’ä½œã£ã¦ãŠãã“ã¨ã§ã‚ãƒ¼ã¨ãªã‚‹æ–‡å—åˆ—ã‚’å…¥åŠ›ã¨ã—ã¦ä¸Žãˆã‚‹ã¨ãƒ†ã‚ã‚¹ãƒˆã«å«ã¾ã‚Œã‚‹ã‚ãƒ¼ã®ä½ç½®ã‚’O(logN)ã§æŽ¢ç´¢ã§ãã‚‹ã€ã¨ã„ã†ã‚‚ã®ã€‚ ãŸã¨ãˆã°
hiromark 2010/02/24
CSA ã®èª¬æ˜Žã‚’ãŒãƒ¼ã£ã¨èªã¿ãŸã„ã¨ãã«ã€‚

compression

algorithm

suffixarray
ãƒªãƒ³ã‚¯
Compressed Suffix Arrayã®è§£èª¬(4) -unaryè¨˜æ³•- - EchizenBlog-Zwei
< Compressed Suffix Arrayã®è§£èª¬(3) -åœ§ç¸®ã®æ–¹é‡- < | > Compressed Suffix Arrayã®è§£èª¬(5) -Succinct Bit Vector- > ================================================ ã¾ãšã¯ä¸‹æº–å‚™ã€‚æ•°å€¤åˆ—ã‚’unaryè¨˜æ³•ã§bitåˆ—ã«å¤‰æ›ã™ã‚‹æ–¹æ³•ã‚’èª¬æ˜Žã€‚ unary(ãƒ¦ãƒŠãƒªã‚£)è¨˜æ³•ã¨ã„ã†ã®ã¯æ•°å€¤ã®æ•°ã ã‘ã®0ã‚’ä¸¦ã¹ã¦ã€æœ€å¾Œã«1ã‚’ç½®ãã¨ã„ã†ã‚‚ã®ã€‚å…·ä½“ä¾‹ã‚’æŒ™ã’ã‚‹ã¨ æ•°å€¤ unary 0 1 1 01 2 001 3 0001 4 00001 5 000001ã¨ãªã‚‹ã€‚ unaryè¨˜æ³•ã§ã¯1ãŒæ•°å€¤é–“ã®å¢ƒç•Œã‚’è¡¨ã™ãŸã‚ã«å„æ•°å€¤æ¯Žã®bitã‚µã‚¤ã‚ºã‚’å›ºå®šé•·ã«ã™ã‚‹å¿…è¦ãŒãªã„ã€‚ä¾‹ãˆã°æ•°å€¤åˆ— 1 1 2 2 1 2ã¯å„æ•°å€¤ã‚’ãã‚Œãžã‚Œ1byteã§è¡¨ã—ãŸã¨ã™ã‚‹ã¨å…¨ä½“ã§48bit(6byte)å¿…è¦ã«ãªã‚‹ã€‚ä¸€æ–¹ã§
hiromark 2010/02/24
compression

ir

algorithm
ãƒªãƒ³ã‚¯
Run-Length Compressed Suffix Array
This web page will no longer be updated. See the author's web pages for further releases. RLCSA [4, 3, 7] is a compressed suffix array implementation that has been optimized for highly repetitive text collections. Examples of such collections include version control data and individual genomes. This implementation also serves as a testbed for many techniques used with compressed suffix arrays. The
hiromark 2010/02/17
suffixarray

compression
ãƒªãƒ³ã‚¯
Compressed Suffix Arrays - ãŠãªã‹ã™ã„ãŸWikiï¼
hiromark 2010/02/09
ir

compression

algorithm

suffixarray
ãƒªãƒ³ã‚¯
[IR] Google WSDM'09è¬›æ¼”ã§è¿°ã¹ã‚‰ã‚Œã¦ã„ã‚‹ç¬¦å·åŒ–æ–¹å¼ã‚’å®Ÿè£…ã—ã¦ã¿ãŸ - tsubosakaã®æ—¥è¨˜
MGå‹‰å¼·ä¼šã®å¾Œã«id:sleepy_yoshiã•ã‚“ã«æ•™ãˆã¦ã‚‚ã‚‰ã£ãŸWSDM 2009ã«ãŠã‘ã‚‹è¬›æ¼”"Challenges in Building Large-Scale Information Retrieval Systems"ã§è¿°ã¹ã‚‰ã‚Œã¦ã„ã‚‹ç¬¦å·åŒ–æ–¹å¼ã®Group Varint Encodingã‚’å®Ÿè£…ã—ã¦ã¿ãŸã€‚ è³‡æ–™ è¬›æ¼”ã‚¹ãƒ©ã‚¤ãƒ‰ ã‚¹ãƒ©ã‚¤ãƒ‰ã®æ—¥æœ¬èªžã«ã‚ˆã‚‹è§£èª¬è¨˜äº‹ æ•´æ•°ã®ç¬¦å·åŒ–æ–¹å¼ è»¢ç½®ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ãªã©ã§æ–‡ç« ç•ªå·ã®ãƒªã‚¹ãƒˆã‚’å‰ã®å€¤ã¨ã®å·®åˆ†ã§è¡¨ã™ãªã©ã®æ–¹æ³•ã‚’ç”¨ã„ã‚‹ã¨å‡ºç¾ã™ã‚‹ã€ã»ã¨ã‚“ã©ã®å€¤ã¯å°ã•ãªå€¤ã¨ãªã‚‹ãŸã‚ã“ã‚Œã‚’4ãƒã‚¤ãƒˆä½¿ã£ã¦è¡¨ç¾ã™ã‚‹ã®ã¯è¨˜æ†¶å®¹é‡ã®ç„¡é§„ã§ã‚ã‚‹ã€‚ ã“ã®ãŸã‚Varint Encodingã€ã‚¬ãƒ³ãƒžç¬¦å·ã€ãƒ‡ãƒ«ã‚¿ç¬¦å·ã€Rice Codingã€Simple 9ã€pForDeltaãªã©æ§˜ã€…ãªç¬¦å·åŒ–æ–¹å¼ãŒææ¡ˆã•ã‚Œã¦ã„ã‚‹ã€‚ã“ã®ã†ã¡Varint Encodingã¯å®Ÿè£…ãŒæ‰‹è»½ãªã“ã¨ã‹ã‚‰ã‚ˆãç”¨ã„ã‚‰ã‚Œã¦
hiromark 2010/02/08
ir

compression

algorithm
ãƒªãƒ³ã‚¯
1 2 3 æ¬¡ã®ãƒšãƒ¼ã‚¸