[B! MapReduce] abcb2ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

abcb2 id:abcb2

MapReduceã«é–¢ã™ã‚‹abcb2ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (5)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

å›½ç«‹æƒ…å ±å¦ç ”ç©¶æ‰€ ä½è—¤æ•™æŽˆãŒèªžã‚‹ã€Œã‚¯ãƒ©ã‚¦ãƒ‰ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ãƒ†ã‚£ãƒ³ã‚°ã®å°†æ¥å‹•å‘ã€ï¼ˆãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ç·¨ï¼‰
8æœˆ31æ—¥ã‹ã‚‰2æ—¥é–“ã€éƒ½å†…ã§è¡Œã‚ã‚ŒãŸã‚¤ãƒ™ãƒ³ãƒˆã€ŒCloud Computing World Tokyo 2011ã€ã€‚ãã®ã‚¤ãƒ™ãƒ³ãƒˆã¸ã®ç”³ã—è¾¼ã¿æ®µéšŽã§æœ€åˆã«æº€å“¡ã¨ãªã£ãŸã®ãŒã€å›½ç«‹æƒ…å ±å¦ç ”ç©¶æ‰€ ä½è—¤ä¸€éƒŽæ•™æŽˆã®ã‚»ãƒƒã‚·ãƒ§ãƒ³ã€Œã‚¯ãƒ©ã‚¦ãƒ‰ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ãƒ†ã‚£ãƒ³ã‚°ã®å°†æ¥å‹•å‘ã€ã§ã—ãŸã€‚ æŠ€è¡“çš„ãªèƒŒæ™¯ã«åŸºã¥ãã€ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿æ´»ç”¨ã«å¿…è¦ãªæ¡ä»¶ã¨ã¯ä½•ã‹ã€ã‚¯ãƒ©ã‚¦ãƒ‰ã®ãƒ“ã‚¸ãƒã‚¹ãƒ¢ãƒ‡ãƒ«ã¯ã©ã†ãªã‚‹ã®ã‹ã€ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼ã®é€²åŒ–ã®æ–¹å‘æ€§ã€ãªã©ã«ã¤ã„ã¦å…·ä½“çš„ãªè§£èª¬ãŒè¡Œã‚ã‚Œã¦ã„ã¾ã™ã€‚ ã“ã®è¨˜äº‹ã§ã¯ã€ãã®ã‚»ãƒƒã‚·ãƒ§ãƒ³ã®å†…å®¹ã‚’ç´¹ä»‹ã—ã¾ã—ã‚‡ã†ã€‚ ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿æµè¡Œã®èƒŒæ™¯ã¨ãªã£ãŸMapReduce/Hadoop å›½ç«‹æƒ…å ±å¦ç ”ç©¶æ‰€ ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ç§‘å¦ ç ”ç©¶ç³» æ•™æŽˆ ä½è—¤ ä¸€éƒŽæ°ã€‚ åˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ ã®ç ”ç©¶è€…ã‹ã‚‰è¦‹ãŸã€ã‚¯ãƒ©ã‚¦ãƒ‰ã®ã‚¤ãƒ³ãƒ•ãƒ©ã®è©±ã€10å¹´å…ˆã®è©±ã‚’ã—ã‚ˆã†ã¨æ€ã„ã¾ã™ã€‚ 1ã¤ç›®ã¯ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã®è©±é¡Œã€‚ ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã®å‡¦ç†æŠ€è¡“ã€ŒMapReduce/Hadoopã€ã¯ã€
abcb2 2011/09/09
hadoop

MapReduce

çµ±è¨ˆ
ãƒªãƒ³ã‚¯
Perl ã§ MapReduce - Mahout Frequent Pattern Mining Data - - hamadakoichi blog
æœ€è¿‘ã€Perl ã‚‚æ›¸ãå§‹ã‚ã¦ã¿ãŸã®ã§ã€Hadoop ä¸Šã§åˆ†æ•£å®Ÿè¡Œã§ãã‚‹ Perl ã§ã® MapReduce å®Ÿè£…ã‚’ç´¹ä»‹ã™ã‚‹ã€‚å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ãƒžã‚¤ãƒ‹ãƒ³ã‚°ãƒ»æ©Ÿæ¢°å¦ç¿’ã®ãƒ©ã‚¤ãƒ–ãƒ©ãƒª Apache Mahout ã® Parallel Frequent Pattern Mining ã®å…¥åŠ›ãƒ‡ãƒ¼ã‚¿ã‚’ç”Ÿæˆã™ã‚‹ Perl MapReduce å®Ÿè£…ã®ç´¹ä»‹ã€‚ Frequent Pattern Mining å…¥é–€ Frequent Pattern Mining (Association Analysis )ã¯ã€éš ã•ã‚ŒãŸãƒ«ãƒ¼ãƒ«ãƒ‘ã‚¿ãƒ¼ãƒ³ã‚’æŠ½å‡ºã™ã‚‹ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã€‚æœ‰åãªä¾‹ã¨ã—ã¦ã¯ã€1992å¹´ã®ã‚¦ã‚©ãƒ«ãƒžãƒ¼ãƒˆã®ã‚¯ãƒªã‚¹ãƒžã‚¹å•†æˆ¦ã§ã€ŒãŠã‚€ã¤ã‚’è²·ã£ãŸäººã¯åŠãƒ€ãƒ¼ã‚¹ã®ãƒ“ãƒ¼ãƒ«ã‚’è²·ã†å¯èƒ½æ€§ãŒæœ€ã‚‚é«˜ã„ã€ã¨ã„ã†é »å‡ºãƒ«ãƒ¼ãƒ«ã‚’æŠ½å‡ºã—ã€å•†å“é™³åˆ—ã«æ´»ã‹ã—ãŸå£²ä¸Šå‘ä¸Šã—ãŸäº‹ä¾‹ã€‚ å…¥é–€è³‡æ–™ï¼š ç¬¬ï¼•å›žRå‹‰å¼·ä¼šï¼ æ±äº¬ ã§è©±ã—ã¦ããŸ - ã€ŒRè¨€èªžã«ã‚ˆã‚‹ã‚¢ã‚½ã‚·ã‚¨ãƒ¼ã‚·ãƒ§ãƒ³
abcb2 2011/05/19
MapReduce

Hadoop
ãƒªãƒ³ã‚¯
MapReduce - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼
"MapReduce" ã¯ Google ã®ãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰ã§åˆ©ç”¨ã•ã‚Œã¦ã„ã‚‹ä¸¦åˆ—è¨ˆç®—ã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã®ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ä½œæˆã‚’ã¯ã˜ã‚ã¨ã™ã‚‹ã€å¤§è¦æ¨¡ãªå…¥åŠ›ãƒ‡ãƒ¼ã‚¿ã«å¯¾ã™ã‚‹ãƒãƒƒãƒå‡¦ç†ã‚’æƒ³å®šã—ã¦ä½œã‚‰ã‚ŒãŸã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚ MapReduce ã®é¢ç™½ã„ã¨ã“ã‚ã¯ã€map() ã¨ reduce() ã¨ã„ã†äºŒã¤ã®é–¢æ•°ã®çµ„ã¿åˆã‚ã›ã‚’å®šç¾©ã™ã‚‹ã ã‘ã§ã€å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã«å¯¾ã™ã‚‹æ§˜ã€…ãªè¨ˆç®—å•é¡Œã‚’è§£æ±ºã™ã‚‹ã“ã¨ãŒã§ãã‚‹ç‚¹ã§ã™ã€‚ MapReduce ã®è¨ˆç®—ãƒ¢ãƒ‡ãƒ« map() ã«ã¯ãã®è¨ˆç®—å•é¡Œã®ãƒ‡ãƒ¼ã‚¿ã¨ã—ã¦ã® key-value ãƒšã‚¢ãŒæ¬¡ã€…ã«æ¸¡ã£ã¦ãã¾ã™ã€‚map() ã§ã¯ key-value å€¤ã®ãƒšã‚¢ã‚’ç•°ãªã‚‹è¤‡æ•°ã® key-value ãƒšã‚¢ã«å¤‰æ›ã—ã¾ã™ã€‚reduce() ã«ã¯ã€map() ã§ä½œã£ãŸ key-value ãƒšã‚¢ã‚’åŒä¸€ã® key ã§æŸããŸã‚‚ã®ãŒé †ç•ªã«æ¸¡ã£ã¦ãã¾ã™ã€‚ãã® key-values ãƒšã‚¢ã‚’ä»»æ„ã®å½¢å¼ã«å¤‰æ›ã™ã‚‹ã“ã¨
abcb2 2011/04/05
MapReduce

perl

hadoop
ãƒªãƒ³ã‚¯
å¹³æˆï¼’ï¼‘å¹´åº¦ç”£å¦é€£æºã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢å·¥å¦å®Ÿè·µäº‹æ¥ï¼ˆé«˜ä¿¡é ¼ã‚¯ãƒ©ã‚¦ãƒ‰å®Ÿç¾ç”¨ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢é–‹ç™ºï¼ˆåˆ†æ•£åˆ¶å¾¡å‡¦ç†æŠ€è¡“ç‰ã«ä¿‚ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼ã®é«˜ä¿¡é ¼åŒ–ã«å‘ã‘ãŸå®Ÿè¨¼äº‹æ¥ï¼‰ï¼‰äº‹æ¥æˆæžœå ±å‘Šæ›¸
abcb2 2010/09/29
ã‚¯ãƒ©ã‚¦ãƒ‰

MapReduce

Hadoop

Cloud
ãƒªãƒ³ã‚¯
ã‚°ãƒ¼ã‚°ãƒ«ãŒæ§‹ç¯‰ã—ãŸå¤§è¦æ¨¡ã‚·ã‚¹ãƒ†ãƒ ã®ç¾å®Ÿã€ãã—ã¦ãƒ‡ã‚¶ã‚¤ãƒ³ãƒ‘ã‚¿ãƒ¼ãƒ³ï¼ˆ1ï¼‰ï½žMapReduceç·¨
ã‚°ãƒ¼ã‚°ãƒ«ãŒã€ŒEvolution and Future Directions of Large-Scale Storage and Computation Systems at Googleã€ï¼ˆã‚°ãƒ¼ã‚°ãƒ«ã«ãŠã‘ã‚‹ã€å¤§è¦æ¨¡ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã¨ã‚³ãƒ³ãƒ”ãƒ¥ãƒ†ãƒ¼ã‚·ãƒ§ãƒ³ã®é€²åŒ–ã¨å°†æ¥ã®æ–¹å‘æ€§ï¼‰ã¨ã„ã†è¬›æ¼”ã‚’ã€6æœˆã«è¡Œã‚ã‚ŒãŸACMï¼ˆç±³å›½è¨ˆç®—æ©Ÿå¦ä¼šï¼‰ä¸»å‚¬ã®ã‚¯ãƒ©ã‚¦ãƒ‰ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ãƒ†ã‚£ãƒ³ã‚°ã®ã‚·ãƒ³ãƒã‚¸ã‚¦ãƒ ã€ŒACM Symposium on Cloud Computing 2010ã€ã§è¡Œã£ã¦ã„ã¾ã™ã€‚ ã‚°ãƒ¼ã‚°ãƒ«ã¯ã©ã®ã‚ˆã†ã«ã—ã¦å¤§è¦æ¨¡åˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ ã‚’æ§‹ç¯‰ã—ã¦ããŸã®ã‹ã€ãã—ã¦ã€ãã“ã‹ã‚‰ã©ã®ã‚ˆã†ãªã“ã¨ã‚’å¦ã‚“ã ã®ã‹ãŒèªžã‚‰ã‚Œã¦ã„ã¾ã™ã—ã€å¾ŒåŠã§ã¯å¤§è¦æ¨¡åˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ ã®ãƒ‡ã‚¶ã‚¤ãƒ³ãƒ‘ã‚¿ãƒ¼ãƒ³ã¨ã„ã†ã€éžå¸¸ã«èˆˆå‘³æ·±ã„ãƒŽã‚¦ãƒã‚¦ã‚‚å…¬é–‹ã—ã¦ã„ã‚‹ã€éžå¸¸ã«æƒ…å ±é‡ã®å¤šã„è¬›æ¼”ã§ã™ã€‚ ãã®è¬›æ¼”ã®å†…å®¹ã‚’ã€å…¨éƒ¨ã§4ã¤ã®è¨˜äº‹ã€MapReduceç·¨ã€BigTableç·¨ã€æ•™è¨“ç·¨ã€ãƒ‡ã‚¶ã‚¤ãƒ³
abcb2 2010/08/24
MapReduce

cloud

google

ã‚¯ãƒ©ã‚¦ãƒ‰
ãƒªãƒ³ã‚¯
1