[B! dht] yoheiã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

yohei id:yohei

dhtã«é–¢ã™ã‚‹yoheiã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (22)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

ã„ã¾åˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ ãŒé¢ç™½ã„ç†ç”± - Blog by Sadayuki Furuhashi
æœ€è¿‘ ã‚¯ãƒ©ã‚¦ãƒ‰ ã¨ã„ã†å˜èªžãŒæµè¡Œã—ã¦ã„ã¾ã™ãŒã€ã€Œå¤§è¦æ¨¡ãªè¨ˆç®—è³‡æºã‚’ä½Žã‚³ã‚¹ãƒˆã§æä¾›ã—ã¦ãã‚Œã‚‹ãƒˆã‚³ãƒãŒã‚ã‚‹ã‚‰ã—ã„ã®ã§ã€è‡ªå‰ã§æŒã£ã¦ã„ãŸè¨ˆç®—è³‡æºã‚’å§”è¨—ã—ã¡ã‚ƒãˆã°é‹ç”¨ã™ã‚‹æ‰‹é–“ã‚‚çŸ¥è˜ã‚‚è¦ã‚‰ãªã„ã—ã€ãã‚‚ãã‚‚ã‚µãƒ¼ãƒãƒ¼ã‚’è²·ã†è²»ç”¨ã‚’çœã‘ã¡ã‚ƒã†ã‹ã‚‰å¬‰ã—ã„ã€ã¨ã„ã†ç™ºæƒ³ã«åŸºã¥ã„ã¦ã„ã‚‹ã‚‰ã—ãã€ã—ã‹ã—æŠ€è¡“çš„ã«ã¯ å¤§è¦æ¨¡ãªè¨ˆç®—è³‡æºã‚’ä½Žã‚³ã‚¹ãƒˆã§æ§‹ç¯‰ã™ã‚‹æŠ€è¡“ ãŒãƒã‚¤ãƒ³ãƒˆã§ã—ã‚‡ã†ã€‚ å¤§è¦æ¨¡ãªè¨ˆç®—è³‡æºã‚’ã©ã†ã‚„ã£ã¦å®‰ãæ§‹ç¯‰ã™ã‚‹ã‹ã€‚ å¾“æ¥ã¯ã€ã‚·ã‚¹ãƒ†ãƒ ã®èƒ½åŠ›ã‚’é«˜ã‚ã‚‹ãŸã‚ã«ã¯ã€é«˜æ€§èƒ½ãƒ»é«˜æ©Ÿèƒ½ï¼ˆãã‚Œã‚†ãˆé«˜ä¾¡ãªï¼‰ãƒžã‚·ãƒ³ã‚’å°Žå…¥ã™ã‚‹ã¨ã„ã†ã‚¹ã‚±ãƒ¼ãƒ«ã‚¢ãƒƒãƒ—ã®æ‰‹æ³•ãŒæŽ¡ã‚‰ã‚Œã¦ã„ãŸã®ã ãŒã€ã“ã®æ‰‹æ³•ã§ã¯10å€ã«æ€§èƒ½ã‚’ä¸Šã’ã‚‹ãŸã‚ã«ã€ãŸã¨ãˆã°30å€ã®ã‚³ã‚¹ãƒˆãŒã‹ã‹ã‚‹ã‹ã‚‚ã—ã‚Œãªã„ã€‚ã‚¹ã‚±ãƒ¼ãƒ«ã‚¢ãƒƒãƒ—ã¨æ¯”ã¹ã¦ã‚¹ã‚±ãƒ¼ãƒ«ã‚¢ã‚¦ãƒˆã§ã¯ã€å°Žå…¥ã—ãŸã‚³ã‚¹ãƒˆã«ã»ã¼æ¯”ä¾‹ã—ã¦ã€ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ã®å‘ä¸ŠãŒè¦‹è¾¼ã‚ã‚‹ã€‚ ã€ŽUNIX magazine 2009å¹´4æœˆå·ã€ p.31 *1 ä½•ç™¾ä¸‡å††ã‚‚ã™
yohei 2009/04/03
eventuallyconsistent

dht
ãƒªãƒ³ã‚¯
peer-to-peer $B$NJ}$+$iMh$^$7$? (B (key-value store $BJY6/2q (B, February 20, 2009)
$B 2009 $BG/ (B 2 $B7n (B 20 $BF| (B key-value store $BJY6/2q (B $B%9%i%$%I (B: shudo-keyval-20090220.pdf (PDF $B%U%!%$%k (B, 690 KB) $B4XO";qNA (B: $B%*! $B%&%'%V%Z! (21 pages, HTML) scale out $B$N5;=Q (B $B!A (B consistent hashing $BJT (B: $B%&%'%V%Z! (45 pages, HTML) PlanetLab $B$N $B%&%'%V%Z! (36 pages, HTML) consistent hashing $B$J (B key-value store Overlay Weaver $B%5!
yohei 2009/03/17
p2p

dht
ãƒªãƒ³ã‚¯
spiteful.com
yohei 2009/02/27
dht

hash
ãƒªãƒ³ã‚¯
The Overall Architecture of ROMA
The Overall Architecture of ROMA ROMA Rakuten On-Memory Architecture æ¥½å¤©æ ªå¼ä¼šç¤¾ æ¥½å¤©æŠ€è¡“ç ”ç©¶æ‰€ è¥¿æ¾¤ç„¡æˆ‘ | 2009 å¹´ 2 æœˆ 20 æ—¥ 1 ROMA ã«ã¤ã„ã¦ ï® è¤‡æ•°ãƒžã‚·ãƒ³ã‹ã‚‰æ§‹æˆã•ã‚Œã‚‹ P2P ã‚’åˆ©ç”¨ã—ãŸ ï® Ruby å®Ÿè£…ã® key-value store ROMA (key-value store) 2 ROMA ã®ç‰¹å¾´ ï® ç¤¾å†…ã‚¯ãƒ©ã‚¦ãƒ‰ é«˜è² è·ãªçŠ¶æ³ã§ã‚ã£ã¦ã‚‚ã€ååˆ†é«˜é€Ÿãªãƒ‡ãƒ¼ã‚¿ã‚¢ã‚¯ã‚»ã‚¹ â— éƒ¨åˆ†éšœå®³ãŒèµ·ãã¦ã‚‚ã€ãƒ‡ãƒ¼ã‚¿ã‚’å–ªå¤±ã—ã¥ã‚‰ã„ â— GET PUT GET Web ( ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ ) ã‚µãƒ¼ãƒ ã‚¨ãƒ³ãƒ‰ãƒ¦ãƒ¼ã‚¶ ROMA 3 Consistent Hashing ï® Pure P2P ã§è‡ªå¾‹çš„ã«ãƒŽãƒ¼ãƒ‰ã‚’ç®¡ç† ï® ç’°çŠ¶ (Consistent Hashing) å„ãƒŽãƒ¼ãƒ‰ã¯ãƒ¦ãƒ‹ãƒ¼ã‚¯ãªãƒãƒƒã‚·ãƒ¥å€¤ (SHA-
yohei 2009/02/24
dht

ruby
ãƒªãƒ³ã‚¯
ã‚«ã‚¤ãƒãƒ„ãƒ‹ãƒƒã‚(2009-02-24)
_ [ã‚¤ãƒ™ãƒ³ãƒˆ] Key Value Storeå‹‰å¼·ä¼š ã™ã£ã”ã„ã²ã•ã³ã•ã«ãªã£ã¦ã—ã¾ã„ã¾ã—ãŸã€ã™ã„ã¾ã›ã‚“ã€‚ã¾ã ä½•äººã‹ã®æ–¹ã¯èªã‚“ã§ã„ã‚‹ã®ã§ã¯ã€ã¨ã„ã†æœŸå¾…ã¨å…±ã«æ›´æ–°ã—ã¦ã¿ã¾ã™ã€‚ titleé€šã‚Šã€å…ˆæ—¥(2009/02/20)Key Value Storeå‹‰å¼·ä¼šã‚’kzkã•ã‚“ã€ichii386ã€moriyoshiã¨ä¸€ç·’ã«é–‹å‚¬ã•ã›ã¦ã„ãŸã ãã¾ã—ãŸã€ã¨ã„ã†ã‹åƒ•ã¯ã»ã¨ã‚“ã©é‹å–¶ã§ãã¦ã„ãªã„ã®ã§ã€ã¡ã‚‡ã“ã£ã¨ãŠè©±ã•ã›ã¦ã„ãŸã ãã¾ã—ãŸã€ã¨ã„ã†ã®ãŒæ£è§£ã§ã™ã€‚ æ€ãˆã°ã€ç¬¬16å›žã®GREE ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼å‹‰å¼·ä¼šã®æ‡‡è¦ªä¼šã§kzkã•ã‚“ã‚„moriyoshiã¨ã€Œkey-valueãªå‹‰å¼·ä¼šã‚„ã£ãŸã‚‰é¢ç™½ããªã„ï¼Ÿã€ã¨ãŠè©±ã—ã¦ã„ã¦ã€æ¥½å¤©æŠ€ç ”ã®æ–¹ã‹ã‚‰ãƒ¡ãƒ¼ãƒ«ã„ãŸã ã„ãŸã®ã‚’ãã£ã‹ã‘ã«ã‚†ã‚‹ã‚†ã‚‹ã¨æº–å‚™ã‚’å§‹ã‚ã¦ichii386ã‚‚å·»ãè¾¼ã‚“ã§(è¶…æ„Ÿè¬ï¼)ã€ãŠã‹ã’ã•ã¾ã§è¶…è±ªè¯ãªã‹ãŸãŒãŸã®ãŠè©±ã‚’èžã‘ã‚‹æ¿ƒã„å‹‰å¼·ä¼šã«ãªã£ã¦ã¨ã¦ã‚‚å¬‰ã—ã„ã§ã™ã€‚å€‹äººçš„
yohei 2009/02/24
dht
ãƒªãƒ³ã‚¯
Key-Value Store (Strage) å‹‰å¼·ä¼šã«ãŠé‚ªé”ã—ã¦ãã¾ã—ãŸ - cooldaemonã®å‚™å¿˜éŒ²
id:Voluntas ã•ã‚“ã®ã‚³ãƒã§æ½œã‚Šè¾¼ã‚“ã§ãã¾ã—ãŸã€‚ å½“åˆã®ç›®å½“ã¦ã¯ã€id:teahut ã•ã‚“ã«ã‚ˆã‚‹ Kai ã®ç™ºè¡¨ã¨ã€é¦–è—¤ã•ã‚“ã«ã‚ˆã‚‹ Overlay Weaver ã®ç™ºè¡¨ã ã£ãŸã®ã§ã™ãŒã€é¢ç™½ã„ç™ºè¡¨ãŒç›®ç™½æŠ¼ã—ã§éžå¸¸ã«æ¿ƒã„ 5 æ™‚é–“ã‚’éŽã”ã™äº‹ãŒã§ãã¾ã—ãŸã€‚ æ„Ÿæƒ³ ç´ æ™´ã‚‰ã—ã„ã¾ã¨ã‚ãŒ ã“ã“ ã¨ ã“ã“ ã«ã‚ã‚‹ç‚ºã€å¾Œã€…ã®è‡ªåˆ†ã®ç‚ºã«å°è±¡ã«æ®‹ã£ãŸãƒ—ãƒ¬ã‚¼ãƒ³ã®æ„Ÿæƒ³ã ã‘é©å½“ã«æ®‹ã—ã¦ãŠãäº‹ã«ã—ã¾ã—ãŸã€‚ Groonga (Senna ã®å¾Œç¶™) ãƒšã‚¢ãƒ—ãƒ¬ã‚¼ãƒ³ã‚’å§‹ã‚ã¦ç›®ã®å½“ãŸã‚Šã«ã—ãŸã€‚ ãƒ¡ã‚¤ãƒ³ã®è©±è€…ãŒè¨€ã„å¿˜ã‚ŒãŸè£œè¶³ã‚’ã‚µãƒ–ã®è©±è€…ãŒè¡Œã†ç‚ºã€éžå¸¸ã«è§£ã‚Šæ˜“ã„ãƒ—ãƒ¬ã‚¼ãƒ³ã«ãªã£ã¦ã„ãŸã—ã€3å‰²ã»ã©æ¼«æ‰ã®è¦ç´ ãŒå…¥ã£ã¦ã„ãŸã®ã§ç›®ãŒé›¢ã›ãªã‹ã£ãŸï¼ˆï½—ï¼› groonga.org ã®ãƒˆãƒƒãƒ—çµµã¯ id:tasukuchan ã•ã‚“ã®é£¼ã„çŒ«ã ã¨ã®äº‹ã€‚ åˆæœŸã§ç”¨æ„ã™ã‚‹ QL ã« Scheme ã‚’é¸ã‚“ã ã®ã¯ã€Parser ã‚’æ›¸ãã®ãŒæ¥½ã ã£ãŸã‹ã‚‰ãªï¼Ÿ
yohei 2009/02/23
dht
ãƒªãƒ³ã‚¯
Key Value Storeå‹‰å¼·ä¼šã«è¡Œã£ã¦ãã¾ã—ãŸ by kumofsã®ã²ã¨ - Blog by Sadayuki Furuhashi
â€»åˆ†æ•£Key-Valueã‚¹ãƒˆã‚¢ã€Œkumofsã€ã‚’å…¬é–‹ã—ã¾ã—ãŸï¼ å…ˆæ—¥é–‹å‚¬ã•ã‚ŒãŸKey Value Storeå‹‰å¼·ä¼šã«è¡Œã£ã¦ãã¾ã—ãŸã€‚ç§ã®ç™ºè¡¨è³‡æ–™ã¯â†“ã“ã“ã‹ã‚‰ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ã§ãã¾ã™ã€‚ kvs-kumofs.pdf åˆã‚ã›ã¦èªã‚€ã¨ç†è§£ãŒæ·±ã¾ã‚‹ã‹ã‚‚ã—ã‚Œãªã„ï¼š ã‚¹ãƒžãƒ¼ãƒˆãªåˆ†æ•£ã§å¿«é©ã‚ãƒ£ãƒƒã‚·ãƒ¥ãƒ©ã‚¤ãƒ• - mixi Engineer's Blogï¼šConsistent Hashã«ã¤ã„ã¦ ãƒã‚¤ãƒŠãƒªã‚·ãƒªã‚¢ãƒ©ã‚¤ã‚ºå½¢å¼ã€ŒMessagePackã€ï¼škumofsã®ãƒ—ãƒãƒˆã‚³ãƒ«ã€‚é«˜é€Ÿãªã‚¹ãƒˆãƒªãƒ¼ãƒ ãƒãƒƒãƒ•ã‚¡ã¨ã‚¹ãƒˆãƒªãƒ¼ãƒ ãƒ‡ã‚·ãƒªã‚¢ãƒ©ã‚¤ã‚¶ã®å®Ÿè£…ã‚‚å«ã¾ã‚Œã¦ã„ã¾ã™ã€‚ Protocol Buffersã¯é…ã„ï¼šMessagePackã®ãƒ™ãƒ³ãƒãƒžãƒ¼ã‚¯ã¨Protocol Buffersã¨ã®æ¯”è¼ƒã€‚ã‚¿ã‚¤ãƒˆãƒ«ã¯é‡£ã‚Šã€‚ memstoredï¼šIOã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ã®ãƒ—ãƒãƒˆã‚¿ã‚¤ãƒ”ãƒ³ã‚° ãƒžãƒ«ãƒã‚³ã‚¢æ™‚ä»£ã®é«˜ä¸¦åˆ—æ€§IOã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ Wavy memcached
yohei 2009/02/23
kumofsã®fsã¯file systemã§ã¯ãªãfast storageã ã£ãŸ

dht
ãƒªãƒ³ã‚¯
ãŸã‘ã¾ã‚‹ / Key/Value Store å‹‰å¼·ä¼šã§è©±ã—ã¦ãã¾ã—ãŸ
_ Key/Value Store å‹‰å¼·ä¼šã§è©±ã—ã¦ãã¾ã—ãŸ [kvs][kai] 2/20 ã«è¡Œã‚ã‚ŒãŸ Key/Value Store å‹‰å¼·ä¼š ã§ Kai ã‚„ Erlang ã«ã¤ã„ã¦è©± ã—ã¦ãã¾ã—ãŸï¼Žæ£å¼ã‚µã‚¤ãƒˆã¯ãªã•ãã†ãªã®ã§ï¼Œã¯ã¦ãƒ–ã«ãƒªãƒ³ã‚¯ã—ã¦ãŠãã¾ ã™ï¼Ž ã‚¿ã‚°ã€Œkvsã€ã‚’å«ã‚€æ–°ç€ã‚¨ãƒ³ãƒˆãƒªãƒ¼ - ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ Kai ã¨ã„ã† Key/Value Store ã«ã¤ã„ã¦ï¼Œãƒ™ãƒ¼ã‚¹ã«ãªã£ã¦ã„ã‚‹ Dynamo ã‚„é–‹ ç™ºã«åˆ©ç”¨ã—ã¦ã„ã‚‹ Erlang ã®ç‰¹å¾´ã«çµžã£ã¦ç´¹ä»‹ã—ã¾ã—ãŸï¼Ž ç”°èˆŽæš®ã‚‰ã—ã§çµ‚é›»ãŒæ—©ã„ã®ã§ï¼Œé †ç•ªã‚’ç¹°ã‚Šä¸Šã’ã¦ã‚‚ã‚‰ã„ã¾ã—ãŸï¼Žè‡¨æ©Ÿå¿œå¤‰ ã«å¯¾å¿œã—ã¦ãã ã•ã‚Šã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã™ï¼Žç™ºè¡¨é †ãŒç¹°ã‚Šä¸ŠãŒã£ãŸãŠã‹ã’ ã§ï¼Œä¼‘æ†©æ™‚é–“ã«ã„ã‚ã‚“ãªæ–¹ã«è©±ã—ã‹ã‘ã¦ã‚‚ã‚‰ãˆãŸã®ã§è‰¯ã‹ã£ãŸã§ã™ï¼Ž ãªãŠï¼ŒKai ã‚’åˆ©ç”¨ã—ãŸã„æ–¹ã¯ sourceforge.net ã‹ã‚‰ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ã—ã¦ã ã ã•ã„ï¼Žéžå¸¸ã«ç°¡å˜ã«ã§ã™ãŒï¼Œä½¿ã„
yohei 2009/02/23
dht
ãƒªãƒ³ã‚¯
æ¥½å¤©ç‰ˆMapReduceãƒ»Hadoopã¯Rubyã‚’æ´»ç”¨ ï¼ ï¼ IT
2008/12/01 æ¥½å¤©ã¯11æœˆ29æ—¥ã€æ±äº¬ãƒ»å“å·ã®æœ¬ç¤¾ã§é–‹å‚¬ã—ãŸæŠ€è¡“ç³»ã‚¤ãƒ™ãƒ³ãƒˆã€Œæ¥½å¤©ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹2008ã€ã«ãŠã„ã¦ã€è¿‘ã„å°†æ¥ã«åŒç¤¾ã®Eã‚³ãƒžãƒ¼ã‚¹ã‚µãƒ¼ãƒ“ã‚¹ã€Œæ¥½å¤©å¸‚å ´ã€ã‚’æ”¯ãˆã‚‹è¨ˆç”»ãŒã‚ã‚‹Rubyãƒ™ãƒ¼ã‚¹ã®å¤§è¦æ¨¡åˆ†æ•£å‡¦ç†æŠ€è¡“ã€ŒROMAã€ï¼ˆãƒãƒ¼ãƒžï¼‰ã¨ã€Œfairyã€ï¼ˆãƒ•ã‚§ã‚¢ãƒªãƒ¼ï¼‰ã«ã¤ã„ã¦ã€ãã®æ¦‚è¦ã‚’æ˜Žã‚‰ã‹ã«ã—ãŸã€‚ ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ã®å‡¦ç†è‡ªä½“ã¯ã‚·ãƒ³ãƒ—ãƒ« æ¥½å¤©å¸‚å ´ã§ã¯ç¾åœ¨ã€2600ä¸‡ç‚¹ã®å•†å“ã‚’å–ã‚Šæ‰±ã„ã€4200ä¸‡äººã®ä¼šå“¡ã«å¯¾ã—ã¦ã‚µãƒ¼ãƒ“ã‚¹ã‚’æä¾›ã—ã¦ã„ã‚‹ã€‚ã“ã®è¦æ¨¡ã®ä¼šå“¡æ•°ãƒ»å•†å“ç‚¹æ•°ã§ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ï¼ˆå•†å“ã®æŽ¨è–¦ï¼‰ã‚’è¡Œã†ã®ã¯å®¹æ˜“ã§ã¯ãªã„ã€‚ â€»è¨˜äº‹åˆå‡ºæ™‚ã«æ¥½å¤©å¸‚å ´ã®ä¼šå“¡æ•°ã‚’4800ä¸‡äººã¨ã—ã¦ã‚ã‚Šã¾ã—ãŸãŒã€ã“ã‚Œã¯æ¥½å¤©ã‚°ãƒ«ãƒ¼ãƒ—ã®ã‚µãƒ¼ãƒ“ã‚¹åˆ©ç”¨è€…å…¨ä½“ã®æ•°å—ã§ã—ãŸã€‚æ¥½å¤©å¸‚å ´ã®ä¼šå“¡æ•°ã¯æ£ã—ãã¯4200ä¸‡äººã¨ã®ã“ã¨ã§ã™ã€‚ãŠè©«ã³ã—ã¦è¨‚æ£ã„ãŸã—ã¾ã™ã€‚ ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ã®ä»•çµ„ã¿ã¨ã—ã¦åŒç¤¾ã¯ã€ä¸€èˆ¬çš„ã§ã‚·ãƒ³ãƒ—ãƒ«ãªã‚¢
yohei 2009/02/22
dht

rakuten

ruby
ãƒªãƒ³ã‚¯
blog.katsuma.tv
greeã•ã‚“ã§é–‹å‚¬ã•ã‚ŒãŸKey Value Storeå‹‰å¼·ä¼šã«è¡Œã£ã¦ãã¾ã—ãŸã€‚ æ™‚é–“ã«ã—ã¦4æ™‚é–“è¶…ãˆã€å†…å®¹ã‚‚å›½å†…ã®Key-Value Storeãªã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã®æœ€å‰ç·šã®è©±ã°ã‹ã‚Šã§ç›¸å½“ãªãƒœãƒªãƒ¥ãƒ¼ãƒ ã€‚ä»¥ä¸‹ã€ãƒ¡ãƒ¢ã£ã¦ãŸã®ã‚’æ®‹ã—ã¦ãŠããŸã„ã¨æ€ã„ã¾ã™ã€‚ï¼ˆèª¤å—ã€è„±å—ã€å†…å®¹ã«èª¤ã‚Šã‚’å«ã‚€ã‚‚ã®ãªã©ã‚ã‚Šã¾ã—ãŸã‚‰ãŠä¼ãˆãã ã•ã„ï¼‰ã¾ãŸã€ç™ºè¡¨è€…ã®æ–¹ã‚„ãƒ—ãƒãƒ€ã‚¯ãƒˆã«ã¤ã„ã¦ã€ã–ã£ãã‚Šèª¿ã¹ã¦URLè¦‹ã¤ã‘ã‚‰ã‚ŒãŸã‚‚ã®ã«ã¤ã„ã¦ã¯ãƒªãƒ³ã‚¯å¼µã£ã¦ã„ã¾ã™ã€‚ æ£®ã•ã‚“ / æœ«æ°¸ã•ã‚“ Â groonga Sennaã®å¾Œç¶™ã‚¨ãƒ³ã‚¸ãƒ³ èžé€šãŒåŠ¹ã‹ãªã„ã®ãŒSennaã®ãƒ‡ãƒ¡ãƒªãƒƒãƒˆ ã‚¹ã‚³ã‚¢ç®—å‡ºå¼ã®ã‚«ã‚¹ã‚¿ãƒžã‚¤ã‚ºãªã© Sennaã®è»¢ç½®ç´¢å¼• ç´¢å¼•ã®æ§‹æˆéƒ¨å“ã‚’è‡ªç”±ã«çµ„ã¿åˆã‚ã›ã¦ä½¿ãˆã‚‹ APIã‚‚ã„ã‚ã„ã‚ QL DB Low Level memcachedäº’æ›ã®key-value store ãƒã‚¤ãƒŠãƒªã®ã¿å¯¾å¿œ è¨ˆæ¸¬ ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã€€memstorm-0.6.8 mem
yohei 2009/02/22
ã“ã‚Œã¯è±ªè¯

dht
ãƒªãƒ³ã‚¯
åˆ†æ•£ãƒ‡ãƒ¼ã‚¿ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã®ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£æ¯”è¼ƒãƒ¡ãƒ¢ - kuenishi's blog
Key/Valueåž‹ãŒä¸€ç•ªæ¥½ãªã®ã¯ã€å‚ç…§(ãƒã‚±ãƒ¼ã‚·ãƒ§ãƒ³ç™ºè¦‹)ã®åŠ¹çŽ‡ãŒã‚ˆã„ãŸã‚ã§ã€ä»–ã«æ–¹æ³•ãŒãªã•ã’ãªã¨ã“ã‚ã¯ã¿ã‚“ãªåˆ†ã‹ã£ã¦ã„ã‚‹ã‚“ã ã¨æ€ã†ã€‚ name routing balancing schema replication membership consistency Tx*1 BigTable +Megastore layered schema (meta tablet) Centralized åˆ—æŒ‡å‘DB GFSä¾å˜ Chubby lock OK Dynamo Chord DHT ç‰¹ã«ãªã—ï¼Ÿ Quorum-based Gossip vector clock Ã— Cassandra Chord DHT? åˆ—æŒ‡å‘DB? checksum (Act-Sby) Gossip ? Ã— Scalaris Chord# naming rule ãªã— Quorum-based Gossip transa
yohei 2009/01/22
dht
ãƒªãƒ³ã‚¯
Richard Jones | Anti-RDBMS: A list of distributed key-value stores | Richard Jones, Esq.
Please Note: this was written January 2009 - see the comments for updates and additional information. A lot has changed since I wrote this. Perhaps youâ€™re considering using a dedicated key-value or document store instead of a traditional relational database. Reasons for this might include: You're suffering from Cloud-computing Mania. You need an excuse to 'get your Erlang on' You heard CouchDB was
yohei 2009/01/21
dht

couchdb
ãƒªãƒ³ã‚¯
scale out ã®æŠ€è¡“ ã€œ consistent hashing ç·¨ (cloud ç ”ç©¶ä¼š, December 19, 2008)
scale out ã®æŠ€è¡“ ã€œ consistent hashing ç·¨ é¦–è—¤ ä¸€å¹¸ 2008å¹´ 12æœˆ 19æ—¥ cloud ç ”ç©¶ä¼š (ä¸¸å±±ä¸äºŒå¤«æ°ä¸»å®°) ã‚¹ãƒ©ã‚¤ãƒ‰: shudo-cloud-scaleout-20081219.pdf (PDF ãƒ•ã‚¡ã‚¤ãƒ«, 840 KB) é–¢é€£è³‡æ–™: ã‚ªãƒ¼ãƒãƒ¬ã‚¤ã«ã‚ˆã‚‹åˆ†æ•£ã‚ãƒ£ãƒƒã‚·ãƒ¥: ã‚¦ã‚§ãƒ–ãƒšãƒ¼ã‚¸ (21 pages, HTML) Unstructured overlay ã¨ Sturectured overlay: ã‚¦ã‚§ãƒ–ãƒšãƒ¼ã‚¸ (34 pages, HTML) Back to Publications ã®ãƒšãƒ¼ã‚¸ é¦–è—¤ã®ãƒšãƒ¼ã‚¸ scale out ã®æ–¹ç–
yohei 2008/12/22
P2P æŠ€è¡“ã¯ãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰ã§å¤§æ´»èºä¸

dht
ãƒªãƒ³ã‚¯
ãŸã‘ã¾ã‚‹ / ã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã—ãŸ - ç¬¬2å›ž Erlang åˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ å‹‰å¼·ä¼š
_ ã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã—ãŸ - ç¬¬2å›ž Erlang åˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ å‹‰å¼·ä¼š [erlang] (2008-11-22 è¿½è¨˜) ç™ºè¡¨ã®æ¦‚è¦ã¨è³ªç–‘ã«ã¤ã„ã¦ã®ã‚³ãƒ¡ãƒ³ãƒˆã‚’è¿½åŠ ã—ã¾ã—ãŸï¼Ž ãŠé™°æ§˜ã§ï¼Œå¤§ç››æ³ã®ã†ã¡ã« ç¬¬2å›ž Erlang åˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ å‹‰å¼·ä¼š ãŒçµ‚ã‚ã‚Š ã¾ã—ãŸï¼Žå‚åŠ ã—ã¦ã„ãŸã ã„ãŸçš†æ§˜ï¼Œã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã—ãŸï¼Ž ãƒ—ãƒã‚°ãƒ©ãƒ ã«ã¯ 1æ™‚é–“è¿‘ã„ä½™è£•ã‚’ã¿ã¦ã„ãŸã®ã«ï¼Œè°è«–ãŒç™½ç†±ã—ã¦30åˆ†ã‚‚é… ã‚Œã‚‹ã¨ã¯æ€ã„ã¾ã›ã‚“ã§ã—ãŸï¼Žå¾ŒåŠã®ã‚¹ãƒ”ãƒ¼ã‚«ãƒ¼ã®çš†æ§˜ã«ã¯æº€è¶³ã«ãŠè©±ã—ã„ ãŸã ãæ™‚é–“ãŒãªããªã£ã¦ã—ã¾ã„ï¼Œæ®µå–ã‚ŠãŒæ‚ªãã¦ã™ã¿ã¾ã›ã‚“ã§ã—ãŸï¼Žç‰¹ã«ï¼Œ ä¼šå ´ã¨æ‡‡è¦ªä¼šã®æº–å‚™ã‚’ã—ã¦ã„ãŸã ã„ãŸ hamano ã•ã‚“ã«ã”è¿·æƒ‘ã‚’ãŠã‹ã‘ã—ã¾ ã—ãŸï¼ŽLT ã—ã¦ã„ãŸã ãæ™‚é–“ã‚‚ãªããªã£ã¦ã—ã¾ã„ã¾ã—ãŸã—â€¦ï¼Ž åçœã‚’æ´»ã‹ã—ã¦ï¼Œæ¬¡å›žã¯ã‚¿ã‚¤ãƒ ã‚ãƒ¼ãƒ‘ãƒ¼ã‚’è¨ã‘ã¾ã™ï¼Ž ã¨ã“ã‚ã§ï¼Œã“ã®ã‚³ãƒŸãƒ¥ãƒ‹ãƒ†ã‚£ã¯ï¼Œè¨€èªžãã®ã‚‚ã®ã‚ˆã‚Šã‚‚ï¼Œãã‚Œã‚’æ´»ã‹ã™ãŸã‚ ã®ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã‚„ãƒ¡ã‚«ãƒ‹ã‚º
yohei 2008/11/27
erlang

dht
ãƒªãƒ³ã‚¯
ConsistentHashing - ã‚³ãƒ³ã‚·ã‚¹ãƒ†ãƒ³ãƒˆãƒ»ãƒãƒƒã‚·ãƒ¥æ³•
ConsistentHashing - ã‚³ãƒ³ã‚·ã‚¹ãƒ†ãƒ³ãƒˆãƒ»ãƒãƒƒã‚·ãƒ¥æ³• ç›®æ¬¡ ã“ã®æ–‡æ›¸ã«ã¤ã„ã¦ ã‚³ãƒ³ã‚·ã‚¹ãƒ†ãƒ³ãƒˆãƒ»ãƒãƒƒã‚·ãƒ¥æ³• å®Ÿä¾‹ å®Ÿè£… ç”¨é€” ã‚³ãƒ³ã‚·ã‚¹ãƒ†ãƒ³ãƒˆãƒ»ãƒãƒƒã‚·ãƒ¥æ³• ã“ã®æ–‡æ›¸ã«ã¤ã„ã¦ "Tom White's Blog: Consistent Hashing" ã®æ—¥æœ¬èªžè¨³ã§ã™. http://weblogs.java.net/blog/tomwhite/archive/2007/11/consistent_hash.html æŽ¨æ•²æ“è¿Ž: èª¤è¨³, ã‚¿ã‚¤ãƒ, è¨³èªžã®ä¸çµ±ä¸€, ãã®ã»ã‹... åŽŸæ–‡ã®ãƒ©ã‚¤ã‚»ãƒ³ã‚¹: http://creativecommons.org/licenses/by-nc-sa/2.0/ ç§ã¯ä»Šã¾ã§ã«ä½•åº¦ã‹ã‚³ãƒ³ã‚·ã‚¹ãƒ†ãƒ³ãƒˆãƒ»ãƒãƒƒã‚·ãƒ¥æ³•ã«ã¨ã‚Šãã‚“ã ã“ã¨ãŒã‚ã‚‹ã€‚ ã“ã®ã‚¢ã‚¤ãƒ‡ã‚¢ã‚’ã‚ã‚‰ã‚ã—ãŸè«–æ–‡ ( David Karger ã‚‰ã«ã‚ˆã‚‹ Consistent Hashing and R
yohei 2008/07/25
dht
ãƒªãƒ³ã‚¯
ç¬¬4å›žã€€memcachedã®åˆ†æ•£ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ | gihyo.jp
æ ªå¼ä¼šç¤¾ãƒŸã‚¯ã‚·ã‚£ã®é•·é‡Žã§ã™ã€‚ç¬¬2å›žã€ç¬¬3å›žã¨å‰å‚ãŒmemcachedã®å†…éƒ¨ã«ã¤ã„ã¦ç´¹ä»‹ã—ã¾ã—ãŸã€‚ä»Šå›žã¯å†…éƒ¨æ§‹é€ ã‹ã‚‰é›¢ã‚Œã¦ã€memcachedã®åˆ†æ•£ã«ã¤ã„ã¦ã®ç´¹ä»‹ã‚’ã„ãŸã—ã¾ã™ã€‚ memcachedã®åˆ†æ•£ é€£è¼‰ã®1å›žç›®ã«ç´¹ä»‹ã—ã¾ã—ãŸãŒã€memcachedã¯ã€Œåˆ†æ•£ã€ã‚ãƒ£ãƒƒã‚·ãƒ¥ã‚µãƒ¼ãƒã¨è¨€ã‚ã‚Œã¦ã„ã¾ã™ãŒã€ã‚µãƒ¼ãƒå´ã«ã¯ã€Œåˆ†æ•£ã€ã®æ©Ÿèƒ½ã¯å‚™ã‚ã£ã¦ã„ã¾ã›ã‚“ã€‚ã‚µãƒ¼ãƒå´ã«ã¯å½“é€£è¼‰ã®ç¬¬2å›žã€ç¬¬3å›žã§å‰å‚ãŒç´¹ä»‹ã—ãŸãƒ¡ãƒ¢ãƒªã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã®æ©Ÿèƒ½ã®ã¿ãŒçµ„ã¿è¾¼ã¾ã‚Œã¦ãŠã‚Šã€éžå¸¸ã«ã‚·ãƒ³ãƒ—ãƒ«ãªå®Ÿè£…ã¨ãªã£ã¦ã„ã¾ã™ã€‚ã§ã¯ã€memcachedã®åˆ†æ•£ã¯ã©ã®ã‚ˆã†ã«å®Ÿç¾ã—ã¦ã„ã‚‹ã®ã‹ã¨è¨€ã†ã¨ã€ã™ã¹ã¦ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆãƒ©ã‚¤ãƒ–ãƒ©ãƒªã«ã‚ˆã£ã¦å®Ÿç¾ã•ã‚Œã¾ã™ã€‚ã“ã®åˆ†æ•£æ–¹æ³•ã¯memcachedã®å¤§ããªç‰¹å¾´ã§ã™ã€‚ memcachedã®åˆ†æ•£ã¨ã¯ ã“ã“ã¾ã§æ•°åº¦ã€Œåˆ†æ•£ã€ã¨ã„ã†è¨€è‘‰ã‚’ç”¨ã„ã¦ãã¾ã—ãŸãŒã€ã‚ã¾ã‚Šè©³ã—ãè§¦ã‚Œã¦ãã¾ã›ã‚“ã§ã—ãŸã€‚ã“ã“ã§ã¯å„ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã®å®Ÿè£…ã«å…±é€šã™ã‚‹å¤§ã¾
yohei 2008/07/24
memcached

dht
ãƒªãƒ³ã‚¯
http://as.dc.impact-ad.jp/hserver/acc_random=42417163/SITE=IT.GIHYO.DAC/AREA=PAGE/AAMSZ=468X60
yohei 2008/07/24
memcached

dht
ãƒªãƒ³ã‚¯
P2Påˆ†æ•£ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã€ŒCagraã€ - Blog by Sadayuki Furuhashi
id:nyaxtæ°ã¨ã®å…±åŒé–‹ç™ºã®åˆ†æ•£ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã€ŒCagraã€ï¼ˆã‹ãã‚‰ï¼‰ã®ã‚¢ãƒ«ãƒ•ã‚¡ç‰ˆã‚’ãƒªãƒªãƒ¼ã‚¹ã—ã¾ã—ãŸã€‚ cagra Î±3ãƒªãƒªãƒ¼ã‚¹ cagra ãƒ†ã‚¯ãƒ‹ã‚«ãƒ«ãƒ‡ãƒ¢ Î±ï¼’ãƒªãƒªãƒ¼ã‚¹ åˆ†æ•£ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚¨ãƒ³ã‚¸ãƒ³ãƒ†ã‚¯ãƒ‹ã‚«ãƒ«ãƒ‡ãƒ¢ã€€Î±ç‰ˆãƒªãƒªãƒ¼ã‚¹ cagraã®Î±ç‰ˆè©¦ã—ã¦ã¿ãŸã‚ˆ - takumalog Cagraã¯ä»¥ä¸‹ã®ã‚ˆã†ãªç‰¹å¾´ã‚’æŒã£ãŸï¼ˆç›®æŒ‡ã—ãŸï¼‰P2Påˆ†æ•£ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã§ã™ã€‚ Zeroconf ãƒžãƒ«ãƒãƒžã‚¹ã‚¿ã§ãƒ¬ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã™ã‚‹Write é«˜é€Ÿãªåˆ†æ•£Read ã‚ªãƒ—ã‚·ãƒ§ãƒ³ã§é«˜é€ŸãªéžåŒæœŸWrite ã‚¤ãƒ³ã‚¿ãƒ¼ãƒãƒƒãƒˆãƒ¬ãƒ™ãƒ«ã‚ˆã‚Šã‚‚LANãƒ¬ãƒ™ãƒ«ã®ãƒžã‚·ãƒ³å°æ•°ã«ç‰¹åŒ– å·¨å¤§ãƒ‡ãƒ¼ã‚¿ã‚µãƒãƒ¼ãƒˆ é«˜é€Ÿã‚¤ãƒ™ãƒ³ãƒˆé§†å‹•ã‚·ã‚¹ãƒ†ãƒ ã‚³ãƒ¼ãƒ«ï¼‹è»½é‡ã‚¹ãƒ¬ãƒƒãƒ‰ è¶…ã‚¢ã‚¸ãƒ£ã€œã‚¤ãƒ«ãªé–‹ç™ºä½“åˆ¶ ã¾ã Î±ç‰ˆã§å…¨éƒ¨ãŒå®Ÿè£…ã•ã‚Œã¦ã„ã‚‹ã‚ã‘ã§ã¯ãªã„ã§ã™ãŒã€ã¨ã‚Šã‚ãˆãšå‹•ãã¾ã™ã€‚ Zeroconf UDPãƒžãƒ«ãƒã‚ãƒ£ã‚¹ãƒˆã§ãƒŽãƒ¼ãƒ‰ã‚’è‡ªå‹•çš„ã«ç™ºè¦‹ã™ã‚‹ã®ã§ã€ä¸€åˆ‡è¨å®šãƒ•ã‚¡ã‚¤ãƒ«ã‚’æ›¸ã‹ãšã«å‹•ä½œã›ã‚‹
yohei 2008/04/30
dht

distributed

databases
ãƒªãƒ³ã‚¯
http://www-masu.ist.osaka-u.ac.jp/~kakugawa/lecture/2006/fcs/note/slide1/index.html
yohei 2008/04/22
distributed

dht
ãƒªãƒ³ã‚¯
mixi Engineersâ€™ Blog Â» ã‚¹ãƒžãƒ¼ãƒˆãªåˆ†æ•£ã§å¿«é©ã‚ãƒ£ãƒƒã‚·ãƒ¥ãƒ©ã‚¤ãƒ•
ä»Šæ—¥ã¯ä»¥å‰ã®ã‚¨ãƒ³ãƒˆãƒªãƒ¼ã§æ›¸ãã¨è¿°ã¹ãŸConsistent Hashingã«é–¢ã—ã¦èªžã‚‰ã›ã¦é ‚ã“ã†ã‹ã¨æ€ã„ã¾ã™ã€‚ãŸã ã—Consistent Hashingã¯ã‚»ãƒŸãƒŠãƒ¼ã‚„ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ãªã©ã§ã‹ãªã‚Šèªžã‚‰ã‚Œã¦ã„ã‚‹ã¨æ€ã„ã¾ã™ã®ã§ã€ã‚³ãƒ³ã‚»ãƒ—ãƒˆã«é–¢ã—ã¦ã¯æ·±å…¥ã‚Šã›ãšã€å®Ÿç”¨æ€§ã«ç€ç›®ã—ãŸã„ã¨æ€ã„ã¾ã™ã€‚ å•é¡Œå®šç¾© åˆ†æ•£ã•ã‚ŒãŸã‚ãƒ£ãƒƒã‚·ãƒ¥ç’°å¢ƒã«ãŠã„ã¦ã€å…¸åž‹çš„ãªãƒ¬ã‚³ãƒ¼ãƒ‰ã‚’é©åˆ‡ãªãƒŽãƒ¼ãƒ‰ã«æ ¼ç´ã™ã‚‹ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã¯keyã®ãƒãƒƒã‚·ãƒ¥å€¤ã«å¯¾ã—moduloæ¼”ç®—ã‚’è¡Œã„ã€ãã®çµæžœã‚’åŸºã«ãƒŽãƒ¼ãƒ‰ã‚’é¸å‡ºã™ã‚‹äº‹ã§ã™ã€‚ãŸã ã—ã€ã“ã®ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã¯ã„ã†ã¾ã§ã‚‚ãªãã€ãƒŽãƒ¼ãƒ‰æ•°ãŒå¤‰ã‚ã‚‹ã¨ã‚ãƒ£ãƒƒã‚·ãƒ¥ãƒŸã‚¹ã®åµãŒç”Ÿã˜ã¾ã™ã€‚ã¤ã¾ã‚Šå®Ÿä¸–ç•Œã®ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã¨ã—ã¦ã¯åŠ›ä¸è¶³ã§ã™ã€‚ ã‚¦ã‚§ãƒ–ã‚µã‚¤ãƒˆã®ã‚ãƒ£ãƒƒã‚·ãƒ¥ã‚·ã‚¹ãƒ†ãƒ ã®åŸºæœ¬ã¯ã‚ãƒ£ãƒƒã‚·ãƒ¥ãŒãƒ’ãƒƒãƒˆã—ãªã‹ã£ãŸã‚‰ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã«ãƒªã‚¯ã‚¨ã‚¹ãƒˆã‚’ç™ºè¡Œã—ã€ãƒ¬ã‚³ãƒ¼ãƒ‰ãŒå˜åœ¨ã—ãŸã‚‰ã‚ãƒ£ãƒƒã‚·ãƒ¥ã—ã¦ã‚¯ãƒ©ã‚¤ã‚¨ãƒ³ãƒˆã«è¿”ã™ã¨ã„ã†æµã‚Œã§ã™ã€‚ã“ã“ã§å•é¡Œãªã®ãŒä¸€çž¬
yohei 2008/03/11
dht
ãƒªãƒ³ã‚¯
1 2 æ¬¡ã®ãƒšãƒ¼ã‚¸