[B! Hadoop] webmarksjpã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

webmarksjp id:webmarksjp

Hadoopã«é–¢ã™ã‚‹webmarksjpã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (7)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Googleã®èª‡ã‚‹å·¨å¤§ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹BigTableã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚¯ãƒãƒ¼ãƒ³ã€ŒHypertableã€
Googleã®ã‚ã®å·¨å¤§ãªæ¤œç´¢ã‚·ã‚¹ãƒ†ãƒ ãªã©ã‚’æ”¯ãˆã‚‹ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã€ŒBigTableã€ã¯æ›¸ãè¾¼ã¿ãŒæ¯Žç§’700MBã€èªã¿è¾¼ã¿ãŒæ¯Žç§’18GBã¨ã„ã†åŒ–ã‘ç‰©ã‚·ã‚¹ãƒ†ãƒ ãªã®ã§ã™ãŒã€ãã‚Œã®ã‚¯ãƒãƒ¼ãƒ³ã‚’ä½œã‚‹ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã€ŒHyperta bleã€ã¨ã„ã†ã®ãŒã‚ã‚‹ã‚ˆã†ã§ã™ã€‚æ—¢ã«ãƒãƒ¼ã‚¸ãƒ§ãƒ³ãŒä»Šå¹´ã®2æœˆ4æ—¥ã«ã€Œ0.9 Alphaã€ã¾ã§åˆ°é”ã—ã¦ãŠã‚Šã€è¶…å·¨å¤§ãªåˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã‚’è€ƒãˆã¦ã„ã‚‹äººã€…ã‹ã‚‰æ³¨ç›®ã•ã‚Œã¦ã„ã‚‹ã‚ˆã†ã§ã™ã€‚ è©³ç´°ã¯ä»¥ä¸‹ã‹ã‚‰ã€‚ Hyperta ble: An Open Source, High Performance, Scala ble Database http://www.hyperta ble.org/ ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ã¯ä»¥ä¸‹ã‹ã‚‰ã€‚åŒæ¢±ã•ã‚Œã¦ã„ã‚‹ãƒ†ã‚ã‚¹ãƒˆãƒ•ã‚¡ã‚¤ãƒ«ã«ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«æ–¹æ³•ãªã©ãŒè¨˜ã•ã‚Œã¦ã„ã¾ã™ã€‚ Download Hyperta ble å®Ÿéš›ã®ãƒ†ã‚¹ãƒˆçµæžœãªã©ã¯ä»¥ä¸‹ã«æ›¸ã„ã¦ã‚ã‚Šã¾ã™ã€‚ PerformanceTestAO
webmarksjp 2008/07/14
Hypertable

Hadoop

Google

database

opensource

OSS

db

Tips
ãƒªãƒ³ã‚¯
Hadoopã€hBaseã§æ§‹ç¯‰ã™ã‚‹å¤§è¦æ¨¡åˆ†æ•£ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã‚·ã‚¹ãƒ†ãƒ ï¼šCodeZine
ã¯ã˜ã‚ã«ã€€ã“ã®é€£è¼‰ã§ã¯ã€å¤§è¦æ¨¡åˆ†æ•£è¨ˆç®—ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã€ŒHadoopã€ã¨ã€ãã®ä¸Šã«ã¤ãã‚‰ã‚ŒãŸå¤§è¦æ¨¡åˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã€ŒhBaseã€ã®ä»•çµ„ã¿ã¨ç°¡å˜ãªã‚µãƒ³ãƒ—ãƒ«ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‚’ç´¹ä»‹ã—ã¾ã™ã€‚Hadoopã¨hBaseã¯ã€Googleã®åŸºç›¤ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚¯ãƒãƒ¼ãƒ³ã§ã™ã€‚æ©Ÿèƒ½ã‚„ã‚³ãƒ³ã‚»ãƒ—ãƒˆã«ã¤ã„ã¦ã¯ã€GoogleãŒç™ºè¡¨ã—ã¦ã„ã‚‹å¦è¡“è«–æ–‡ã«ä¾ã£ã¦ã„ã¾ã™ã€‚ã€€ã“ã‚Œã‚‰ã®å¦è¡“è«–æ–‡ã«ã‚ˆã‚‹ã¨ã€Googleã§ã¯å¤§è¦æ¨¡åˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã€ŒGoogle File Systemã€ã€å¤§è¦æ¨¡åˆ†æ•£è¨ˆç®—ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã€ŒMapReduceã€ã€å¤§è¦æ¨¡åˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã€ŒBigTableã€ã€åˆ†æ•£ãƒãƒƒã‚¯ã‚µãƒ¼ãƒ“ã‚¹ã€ŒChubbyã€ã¨ã„ã†4ã¤ã®ã‚¤ãƒ³ãƒ•ãƒ©ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ãŒä½¿ã‚ã‚Œã¦ã„ã¾ã™ã€‚ å›³1ã«Googleã®åŸºç›¤æŠ€è¡“é–“ã®ä¾å˜é–¢ä¿‚ã€ãã—ã¦ãã‚Œã«å¯¾å¿œã™ã‚‹OSSã®å¯¾å¿œé–¢ä¿‚ã‚’ç¤ºã—ã¾ã—ãŸã€‚ã¾ãšã¯å¯¾å¿œã™ã‚‹Googleã®åŸºç›¤æŠ€è¡“ãã‚Œãžã‚Œã®æ©Ÿèƒ½ã‚„ç‰¹å¾´ã‚’ã–ã£ãã‚Šã¨
webmarksjp 2008/07/14
åˆ†æ•£å‡¦ç†

æƒ…å ±ã‚¤ãƒ³ãƒ•ãƒ©

google

hadoop

mapreduce

programming

3

oss
ãƒªãƒ³ã‚¯
blogeye.jp : ãƒ–ãƒã‚°ã‚’é€šã—ã¦ç¤¾ä¼šã‚’ã®ãžã
ã€Œæ–°ã—ã„ã‚µãƒ©ãƒªãƒ¼ãƒžãƒ³é‡‘å¤ªéƒŽæœ€æ‚ªã€ ã€Œé‡‘å¤ªéƒŽãƒ»ãƒ»ãƒ»ã€ ã€Œã€ã‚µãƒ©ãƒªãƒ¼ãƒžãƒ³ãªã‚ã‚“ã˜ã‚ƒãã‡ï¼ã€‘ã€ ã€Œã€Œã‚µãƒ©ãƒªãƒ¼ãƒžãƒ³é‡‘å¤ªéƒŽã€ã€ ã€Œé‡‘å¤ªéƒŽã€ ã€Œå¤œä¸ã®TVã€‚ã€ ã€Œã‚µãƒ©ãƒªãƒ¼ãƒžãƒ³é‡‘å¤ªéƒŽã€ ã€Œã‚µãƒ©ãƒªãƒ¼ãƒžãƒ³é‡‘å¤ªéƒŽã€‚ã€ ã€Œã‚µãƒ©ãƒªãƒ¼ãƒžãƒ³é‡‘å¤ªéƒŽï¼ˆ1ï¼‰ã€ ã€Œã©ã†ã‚‚ãƒ¼ã€ ã€Œã‚µãƒ©ãƒªãƒ¼ãƒžãƒ³é‡‘å¤ªéƒŽ 1è©±ã€ ã€Œåˆèžãâ™ªã€ ã€Œãªã‚“ã‹(ç¬‘)ã€ ã€Œã‚µãƒ©ãƒªãƒ¼ãƒžãƒ³ã‚’ãªã‚ã‚“ã˜ã‚ƒãã‡ã€‚ã€ ã€Œæ°¸äº•é‡‘å¤ªéƒŽã€ ã€Œæ€ã£ãŸã‚ˆã‚Šã‚‚ã€ ã€Œã‚·ã‚·ã‚«ãƒãƒ–ãƒ¼ã€
webmarksjp 2008/07/14
æœªè¸

Hadoop

programming

blog

ã‚ã¨ã§èªã‚€

Amazon

google

ã‚ªãƒ³ãƒ©ã‚¤ãƒ³ã‚µãƒ¼ãƒ“ã‚¹

ã‚¢ã‚¯ã‚»ã‚¹è§£æž

web
ãƒªãƒ³ã‚¯
Hadoop Streaming - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼
id:naoya:20080511:1210506301 ã®ã‚¨ãƒ³ãƒˆãƒªã®ã‚³ãƒ¡ãƒ³ãƒˆæ¬„ã§ kzk ã•ã‚“ã«æ•™ãˆã¦ã„ãŸã ã„ãŸ Hadoop Streaming ã‚’è©¦ã—ã¦ã„ã¾ã™ã€‚ Hadoop ã¯ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã® MapReduce + åˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚Java ã§ä½œã‚‰ã‚Œã¦ã„ã¾ã™ã€‚Yahoo! Inc ã®ãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰ã‚„ã€Facebookã€Amazon.com ãªã©ã§ã‚‚åˆ©ç”¨ã•ã‚Œã¦ã„ã‚‹ã¨ã®ã“ã¨ã§ã™ã€‚è©³ã—ãã¯ http://codezine.jp/a/article/aid/2448.aspx (kzk ã•ã‚“ã«ã‚ˆã‚‹é€£è¼‰è¨˜äº‹)ã‚’å‚ç…§ã—ã¦ãã ã•ã„ã€‚ Hadoop Streaming è¨˜äº‹ã«ã‚‚ã‚ã‚Šã¾ã™é€šã‚Šã€Hadoop æ‹¡å¼µã® Hadoop Streaming ã‚’ä½¿ã†ã¨æ¨™æº–å…¥å‡ºåŠ›ã‚’ä»‹ã™ã‚‹ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’è¨˜è¿°ã™ã‚‹ã ã‘ã§ã€Hadoop ã«ã‚ˆã‚‹ MapReduce ã‚’åˆ©ç”¨ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ã¤ã¾ã‚Šã€Java ä»¥å¤–
webmarksjp 2008/07/14
distributed system

perl

hadoop

mapreduce

google

hadoopstreaming

Apache
ãƒªãƒ³ã‚¯
Kansai.pm ã§ã®ç™ºè¡¨è³‡æ–™ (Hadoop Streaming ã§ MapReduce) - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼
Kansai.pm ã«å‚åŠ ã—ã¾ã—ãŸã€‚ã¨ã¦ã‚‚æ¥½ã—ã‹ã£ãŸã§ã™ã€‚è‡ªåˆ†ã‚‚ "Hadoop Streaming ã§ MapReduce" ã¨ã„ã†é¡Œç›®ã§ç™ºè¡¨ã—ã¾ã—ãŸã€‚å–ã‚Šæ€¥ãŽã€è³‡æ–™ã‚’ä»¥ä¸‹ã«å…¬é–‹ã—ã¾ã™ã€‚ http://bloghackers.net/~naoya/ppt/080530kansai pm.ppt MapReduce ã¯ Google ã®ãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰ã§å‹•ã„ã¦ã„ã‚‹åˆ†æ•£ä¸¦åˆ—ãƒãƒƒãƒå‡¦ç†ã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚GFS ã¯ Google ã®åˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚Google ã‚¦ã‚§ã‚¢ã®ã‚¯ãƒãƒ¼ãƒ³ã¨ã—ã¦ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã§é–‹ç™ºã•ã‚Œã¦ã„ã‚‹ã®ãŒ Hadoopã€‚Hadoop ã¯ Yahoo! Inc ã‚„ Facebook, Amazon.com ãªã©ã§ã‚‚åˆ©ç”¨ã•ã‚Œã¦ã„ã‚‹ã¨ã®ã“ã¨ã€‚Hadoop ã¯ Java ã§ã™ãŒã€Hadoop Streaming ã‚’ä½¿ã†ã¨ã€€Java ä»¥å¤–ã§ã‚‚ MapReduce ã§ãã¾ã™ã€‚ ä»¥ä¸‹ã®ã‚¨ãƒ³ãƒˆãƒªã‚‚åˆ
webmarksjp 2008/07/13
mapreduce

hadoop

google

perl

naoya
ãƒªãƒ³ã‚¯
Home | Hypertable - Big Data. Big Performance
Big Data. Big Performance. Hyperta ble delivers scala ble database capacity at maximum performanceÂ to speed up your big data application and reduce your hardware footprint. 100% Hadoop Compatible Hyperta ble seamlessly overlays on top of Hadoop to provide superchargedÂ scala ble database infastructure for your big data application. Less Hardware, Lower Cost Hyperta ble delivers maximum efficiency and su
webmarksjp 2008/07/13
hypertable

bigtable

hadoop

cluster

distributed
ãƒªãƒ³ã‚¯
Hadoopã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã¨ã‚µãƒ³ãƒ—ãƒ«ãƒ—ãƒã‚°ãƒ©ãƒ ã®å®Ÿè¡Œï¼šCodeZine
å‰å›žã¯Googleã®åŸºç›¤æŠ€è¡“ã¨ãã‚Œã«å¯¾å¿œã™ã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã¨ã—ã¦ã€Hadoop & hBaseã‚’ç´¹ä»‹ã—ã¾ã—ãŸï¼ˆå›³1 å‚ç…§ï¼‰ã€‚ä»Šå›žã¯Hadoopã‚’1å°ã«ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã—ã€ã‚µãƒ³ãƒ—ãƒ«ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’å‹•ã‹ã—ã¾ã™ã€‚æ¬¡ã«HDFSã¨MapReduceã®ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ã‚’è§£èª¬ã—ã¾ã™ã€‚æœ€å¾Œã«ã‚µãƒ³ãƒ—ãƒ«ãƒ—ãƒã‚°ãƒ©ãƒ ã®ã‚½ãƒ¼ã‚¹ã‚³ãƒ¼ãƒ‰ã‚’è§£èª¬ã—ã¾ã™ã€‚2. Hadoopã®æ¦‚è¦ã€€Hadoopã¯ä¸»ã«Yahoo! Inc.ã®Doug Cuttingæ°ã«ã‚ˆã£ã¦é–‹ç™ºãŒé€²ã‚ã‚‰ã‚Œã¦ã„ã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§ã€GoogleFileSystemã¨MapReduceã¨ã„ã†Googleã®åŸºç›¤æŠ€è¡“ã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹å®Ÿè£…ã§ã™ã€‚Hadoopã¨ã„ã†åå‰ã¯é–‹ç™ºè€…ã®åä¾›ãŒæŒã£ã¦ã„ã‚‹é»„è‰²ã„è±¡ã®ã¬ã„ãã‚‹ã¿ã®åå‰ã«ç”±æ¥ã—ã¦ã„ã¾ã™ã€‚Hadoopã¯HDFSï¼ˆHadoop Distributed File Systemï¼‰ã€Hadoop MapReduce Fr
webmarksjp 2008/07/13
tutorial

Hadoop

MapReduce

java

google
ãƒªãƒ³ã‚¯
1