[B! MapReduce] tsupoã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

tsupo id:tsupo

MapReduceã«é–¢ã™ã‚‹tsupoã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (8)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

è©¦ã™ã®ãŒé›£ã—ã„â€•æ©Ÿæ¢°å¦ç¿’ã®å¸¸è˜ã¯Mahoutã§å¤‰ã‚ã‚‹
ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿æ™‚ä»£â€•ãªãœã€ã„ã¾æ©Ÿæ¢°å¦ç¿’ãªã®ã‹ Apache Hadoopï¼ˆä»¥ä¸‹ã€Hadoopï¼‰ã®ç™»å ´ã§ã€ä»Šã¾ã§æ¨ã¦ã¦ã„ãŸãƒ‡ãƒ¼ã‚¿ã€è²¯ã‚ã‚‹ã ã‘ã§å‡¦ç†ã—ãã‚Œãªã‹ã£ãŸãƒ‡ãƒ¼ã‚¿ã‚’æ´»ç”¨ã§ãã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã—ãŸã€‚ æ´»ç”¨æ‰‹æ®µã¨ã—ã¦æœ€è¿‘ã¨ã¿ã«æ³¨ç›®ã•ã‚Œã¦ã„ã‚‹æŠ€è¡“ãŒã€Œæ©Ÿæ¢°å¦ç¿’ã€ã§ã‚ã‚Šã€Hadoopã®å¼·ã¿ã‚’ç”Ÿã‹ã—ç°¡å˜ã«æ©Ÿæ¢°å¦ç¿’ã‚’è¡Œã†ãŸã‚ã®ãƒ©ã‚¤ãƒ–ãƒ©ãƒªãŒã€ã€ŒApache Mahoutã€ï¼ˆä»¥ä¸‹ã€Mahoutï¼‰ã§ã™ã€‚ æœ¬ç¨¿ã§ã¯Mahoutã‚’å‹•ã‹ã—ã¦ã¿ã‚‹ã“ã¨ã§ã€æ©Ÿæ¢°å¦ç¿’ã®å¸¸è˜ã‚’èº«ã«ä»˜ã‘ã¾ã™ã€‚ ãã‚‚ãã‚‚ã€æ©Ÿæ¢°å¦ç¿’ã¨ã¯ï¼Ÿ æ©Ÿæ¢°å¦ç¿’ã¨ã¯ã€ä¸€å®šã®ãƒ‡ãƒ¼ã‚¿ã‚’ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ã‚¿ãƒ»ãƒ—ãƒã‚°ãƒ©ãƒ ã«ã€Œå¦ç¿’ã€ã•ã›ï¼ˆã™ãªã‚ã¡ã€ãã®ãƒ‡ãƒ¼ã‚¿ã«æ½œã‚€ãƒ‘ã‚¿ãƒ¼ãƒ³ã‚„è¦å‰‡æ€§ã‚’è¡¨ã™ã€Œãƒ¢ãƒ‡ãƒ«ã€ã‚’è‡ªå‹•çš„ã«æ§‹ç¯‰ã•ã›ï¼‰ã€ä»–ã®ãƒ‡ãƒ¼ã‚¿ã«ãã®ãƒ¢ãƒ‡ãƒ«ã‚’é©ç”¨ã™ã‚Œã°ã€ã‚ãŸã‹ã‚‚äººé–“ã®ã‚ˆã†ã«è¤‡é›‘ã§æŸ”è»Ÿãªåˆ¤æ–ãŒè¡Œãˆã‚‹ã‚ˆã†ã«ã™ã‚‹ã¨ã„ã†è©¦ã¿ã§ã™ã€‚ æ©Ÿæ¢°å¦ç¿’ã‚’ãƒ“ã‚¸ãƒã‚¹ã«æ´»ç”¨ã—ãŸä¾‹ã¯ã€ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‰ï¼ˆãƒ¦ãƒ¼ã‚¶ãƒ¼ã‚„å•†å“
tsupo 2012/03/08
Hadoopã«ã‚ˆã£ã¦ä¸¦åˆ—åˆ†æ•£å‡¦ç†ã®ãƒãƒ¼ãƒ‰ãƒ«ãŒä¸‹ãŒã£ãŸ / ã“ã‚Œã¾ã§ã‚ãã‚‰ã‚ã¦ã„ãŸå¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã«ã‚ˆã‚‹æ©Ÿæ¢°å¦ç¿’ãŒç¾å®Ÿçš„ãªé¸æŠžè‚¢ã«ãªã‚‹ / Mahoutã¯ãƒ’ãƒ³ãƒ‡ã‚£ãƒ¼èªžç”±æ¥ã®ã€Œè±¡ä½¿ã„ã€ã¨ã„ã†æ„å‘³

æ©Ÿæ¢°å¦ç¿’

Hadoop

MapReduce

Mahout

Java

textMining
ãƒªãƒ³ã‚¯
ã„ã¾ã•ã‚‰èžã‘ãªã„Hadoopã¨ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°å…¥é–€
ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿æ™‚ä»£ã®æ•‘ä¸–ä¸»ã€ŒHadoopã€ã¨ã¯ ã€ŒApache Hadoopã€ã¯ä»Šã€æœ€ã‚‚æ³¨ç›®ã‚’é›†ã‚ã¦ã„ã‚‹æŠ€è¡“ã®1ã¤ã§ã™ã€‚Hadoopã¨ã¯ã€å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’æ‰‹è»½ã«è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã—ã¦å‡¦ç†ã§ãã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã§ã™ã€‚ Hadoopã‚’æ´»ç”¨ã—ã¦ã„ã‚‹ä¼æ¥ã¯å¹´ã€…å¢—ãˆç¶šã‘ã¦ã„ã¦ã€ä¸å¯æ¬ ãªæŠ€è¡“ã«ãªã‚Šã¤ã¤ã‚ã‚‹ã¨ã„ãˆã‚‹ã§ã—ã‚‡ã†ã€‚ æœ¬é€£è¼‰ã§ã¯ã€Hadoopã¨ã¯ä½•ã‹ã€HadoopãŒã©ã†æ´»ç”¨ã§ãã‚‹ã®ã‹ã¨ã„ã†ã“ã¨ã‚’ã€ã€Œãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã€ã«ç„¦ç‚¹ã‚’å½“ã¦ã¦è§£èª¬ã—ã¦ã„ããŸã„ã¨æ€ã„ã¾ã™ã€‚ é‡ã„å‡¦ç†ã‚’è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã•ã›ã‚‹ è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«å‡¦ç†ã‚’åˆ†æ•£ã•ã›ã‚‹ã«ã¯ã€ãƒ—ãƒã‚»ã‚¹åŒå£«ã®é€šä¿¡ã€ç›£è¦–ã€éšœå®³æ™‚ã®å¯¾å¿œãªã©ã‚’è€ƒãˆãªã‘ã‚Œã°ãªã‚‰ãšã€ãƒ—ãƒã‚°ãƒ©ãƒžã«ã¨ã£ã¦ãƒãƒ¼ãƒ‰ãƒ«ãŒé«˜ã„ã‚‚ã®ã§ã™ã€‚ã—ã‹ã—ã€Hadoopã¯ãã†ã„ã£ãŸé¢å€’ãã•ã„å‡¦ç†ã‚’ä¸€æ‰‹ã«å¼•ãå—ã‘ã¦ãã‚Œã€ãƒ—ãƒã‚°ãƒ©ãƒžã¯ã€ã‚„ã‚ŠãŸã„å‡¦ç†ã ã‘ã«é›†ä¸ã§ãã¾ã™ã€‚ ä¾‹ãˆã°ã€Hadoopã‚’ä½¿ã†ã¨ã€1
tsupo 2011/06/22
ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã‚’è¡Œã†ã‚µãƒ³ãƒ—ãƒ«ãƒ—ãƒã‚°ãƒ©ãƒ ã®ä½œæˆã‚’é€šã˜ã¦ã€Hadoopã®ä½¿ã„æ–¹ã‚„ã€ã©ã®ã‚ˆã†ã«æ´»ç”¨ã§ãã‚‹ã®ã‹ã‚’è§£èª¬

Hadoop

MapReduce

HDFS

textMining
ãƒªãƒ³ã‚¯
Hadoopã®æ»è§’ã€COBOLãƒãƒƒãƒå‡¦ç†ã®ä¸¦åˆ—åŒ–
Hadoopã®æ»è§’ã€COBOLãƒãƒƒãƒå‡¦ç†ã®ä¸¦åˆ—åŒ–ï¼šç¾å ´ã«ã‚ãã€Webã‚·ã‚¹ãƒ†ãƒ ã®å•é¡Œè§£æ±ºãƒŽã‚¦ãƒã‚¦ï¼ˆ8ï¼‰ æœ¬é€£è¼‰ã¯ã€æ—¥ç«‹è£½ä½œæ‰€ãŒæä¾›ã™ã‚‹ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‚µãƒ¼ãƒã€ŒCosminexusã€ã®é–‹ç™ºæ‹…å½“è€…ã¸ã®ã‚¤ãƒ³ã‚¿ãƒ“ãƒ¥ãƒ¼ã‚’é€šã˜ã¦ã€Webã‚·ã‚¹ãƒ†ãƒ ã«ãŠã‘ã‚‹ã€ã•ã¾ã–ã¾ãªå•é¡Œï¼ãƒˆãƒ©ãƒ–ãƒ«ã®è§£æ±ºã«åŠ¹ããƒŽã‚¦ãƒã‚¦ã‚„æ³¨æ„ç‚¹ã‚’ç´¹ä»‹ã—ã¦ã„ãã€‚ç¾åœ¨èµ·ãã¦ã„ã‚‹å•é¡Œã®è§£æ±ºã‚„ã€ä»Šå¾Œã®é–‹ç™ºã®ã”å‚è€ƒã«ï¼ˆç·¨é›†éƒ¨ï¼‰ ã‚¯ãƒ©ã‚¦ãƒ‰ã§å¯èƒ½ã«ãªã£ãŸå¤§é‡ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã¨ãƒãƒƒãƒå‡¦ç† ã‚¯ãƒ©ã‚¦ãƒ‰ãƒ»ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ãƒ†ã‚£ãƒ³ã‚°ã‚’å‰æã¨ã—ã¦ã€å¤šæ•°ã®ã‚µãƒ¼ãƒã‚’ä½¿ã„å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã‚’ã™ã‚‹ãŸã‚ã®æ‰‹æ³•ã¨ã—ã¦ã€ã€ŒMapReduceã€ã‚„ã€MapReduceã‚’Javaã§å®Ÿç¾ã™ã‚‹ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã€ŒHadoopã€ã«ä»£è¡¨ã•ã‚Œã‚‹åˆ†æ•£ä¸¦åˆ—å‡¦ç†ã«æ³¨ç›®ãŒé›†ã¾ã£ã¦ã„ã‚‹ã€‚ å¤šæ•°ã®ã‚µãƒ¼ãƒã‚’ä½¿ã„è¨ˆç®—å‡¦ç†ã‚’ä¸¦åˆ—åŒ–ã—ã€ãã‚Œã¾ã§éžç¾å®Ÿçš„ã¨æ€ã‚ã‚Œã¦ã„ãŸå¤§é‡ã®è¨ˆç®—å‡¦ç†ã‚‚å¯èƒ½ã¨ã™ã‚‹æ‰‹æ³•ã§ã€ã¾ã•ã«ã€Œã‚¯ãƒ©ã‚¦ãƒ‰æ™‚ä»£ã®æŠ€è¡“ã€ã¨ã„ãˆã‚‹ã
tsupo 2011/01/27
ã‚°ãƒªãƒƒãƒ‰ãƒãƒƒãƒã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ / æ—¢å˜ã®ãƒãƒƒãƒå‡¦ç†ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’æ›¸ãç›´ã•ãšã«ä¸¦åˆ—å‡¦ç† / å…¥åŠ›ãƒ‡ãƒ¼ã‚¿ã‚’ã†ã¾ãåˆ†å‰²ã—ã€è¤‡æ•°ã®ã‚µãƒ¼ãƒä¸Šã§ä¸¦åˆ—å‡¦ç†ã•ã›ã€ãƒ—ãƒã‚°ãƒ©ãƒ ã®å‡ºåŠ›ã‚’å†çµåˆ

cobol

MapReduce

Hadoop
ãƒªãƒ³ã‚¯
ã‚°ãƒ¼ã‚°ãƒ«ãŒHadoopã«MapReduceç‰¹è¨±ã®åˆ©ç”¨ã‚’è¨±å¯
å¤§è¦æ¨¡åˆ†æ•£å‡¦ç†ã®æŠ€è¡“ã¨ã—ã¦çŸ¥ã‚‰ã‚Œã‚‹MapReduceã¯ã€ã‚°ãƒ¼ã‚°ãƒ«ãŒæ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã®åŸºç›¤æŠ€è¡“ã¨ã—ã¦é–‹ç™ºã—ãŸã‚‚ã®ã€‚ãã—ã¦åŒç¤¾ã¯MapReduceã®ç‰¹è¨±ã‚’1æœˆã«å–å¾—ã—ã¦ã„ã¾ã—ãŸã€‚ ã‚°ãƒ¼ã‚°ãƒ«ãŒMapReduceç‰¹è¨±ã‚’å–å¾—ã€‚Hadoopã¸ã®å½±éŸ¿ã¯ï¼Ÿ ï¼ Publickey ã‚°ãƒ¼ã‚°ãƒ«ãŒç‰¹è¨±ã‚’ä¿æœ‰ã—ã¦ã„ã‚‹ã“ã¨ã§MapReduceã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹å®Ÿè£…ã§ã‚ã‚‹Hadoopã«å¯¾ã™ã‚‹å½±éŸ¿ãŒå¿ƒé…ã•ã‚Œã¦ã„ã¾ã—ãŸãŒã€Apache Foundationã®å¼è·å£«ãŒã‚°ãƒ¼ã‚°ãƒ«ã®å¼è·å›£ã‹ã‚‰ç‰¹è¨±ã®åˆ©ç”¨è¨±å¯ã‚’å¾—ãŸã“ã¨ã‚’æ˜Žã‚‰ã‹ã«ã—ã¾ã—ãŸã€‚ äºˆæƒ³é€šã‚Šã®å±•é–‹ã« 4æœˆ23æ—¥ä»˜ã‘ã§Yahoo!ã®Hadoopãƒãƒ¼ãƒ ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒˆOwen Oâ€™Malleyæ°ãŒãƒ¡ãƒ¼ãƒªãƒ³ã‚°ãƒªã‚¹ãƒˆã«æŠ•ç¨¿ã—ãŸã€ŒRe: License for Google's patentã€ã¨ã„ã†ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã€‚ã“ã®ä¸ã§Apache Foundationã®å¼è·å£«ãŒã€ã‚°ãƒ¼ã‚°ãƒ«ã‹ã‚‰ã®ç‰¹è¨±åˆ©ç”¨è¨±å¯ã‚’ä¼
tsupo 2010/04/27
ã€Œã‚°ãƒ¼ã‚°ãƒ«ãŒMapReduceã®ç‰¹è¨±ã‚’å–å¾—ã—ãŸã“ã¨ãŒã‚ãã‚‰ã‹ã«ãªã£ãŸã¨ãã‹ã‚‰ã€ã“ã‚Œã¯å˜ãªã‚‹é˜²è¡›ç›®çš„ã®ç‰¹è¨±å–å¾—ã§ã‚ã£ã¦ã€Hadoopã®è„…å¨ã¨ã¯ãªã‚‰ãªã„ã¨äºˆæƒ³ã•ã‚Œã¦ã„ã¾ã—ãŸã€‚äºˆæƒ³é€šã‚Šã®å±•é–‹ã¨ãªã£ãŸã‚ã‘ã§ã™ã€

Google

patent

MapReduce

Hadoop

summarySite
ãƒªãƒ³ã‚¯
å„ªè‰¯ä¼æ¥ã¯ãªãœHadoopã«èµ°ã‚‹ã®ã‹
ã¡ãªã¿ã«ã€ã“ã®åˆ†æžã®ãŸã‚ã«å¿…è¦ã¨ã•ã‚Œã‚‹MapReduceã®ã‚³ãƒ¼ãƒ‰ã§ã‚ã‚‹ãŒã€ãã®ã‚µã‚¤ã‚ºã¯ã‚ãšã‹20ã‚¹ãƒ†ãƒƒãƒ—ã ã¨ã„ã†ã€‚Yahoo!ã®ãƒ—ãƒ¬ã‚¼ãƒ³ãƒ†ãƒ¼ã‚¿ãƒ¼ã§ã‚ã‚‹ã€ã‚¨ãƒªãƒƒã‚¯ãƒ»ãƒãƒ«ãƒ‡ã‚·ãƒ¥ãƒã‚¤ãƒ©ãƒ¼æ°ã«ã‚ˆã‚‹ã¨ã€ãŸã¨ãˆçµŒé¨“ã®æµ…ã„ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã§ã‚ã£ã¦ã‚‚ã€MapReduceã«ã‚ˆã‚‹ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ã¯å¯èƒ½ã§ã‚ã‚‹ã¨ã•ã‚Œã‚‹ã€‚ ã¾ãŸã€VISAã®ã‚¸ãƒ§ãƒ¼ãƒ»ã‚«ãƒ‹ãƒ³ã‚¬ãƒ æ°ã‹ã‚‰ã‚‚ã€è²´é‡ãªãƒ‡ãƒ¼ã‚¿ãŒæä¾›ã•ã‚Œã¦ã„ãŸã®ã§ä»¥ä¸‹ã«ç´¹ä»‹ã™ã‚‹ã€‚åŒç¤¾ã§ã¯ã€1æ—¥ã«1å„„ãƒˆãƒ©ãƒ³ã‚¶ã‚¯ã‚·ãƒ§ãƒ³ãŒç™ºç”Ÿã™ã‚‹ãŸã‚ã€2å¹´é–“ã§700å„„å¼·ã®ãƒˆãƒ©ãƒ³ã‚¶ã‚¯ã‚·ãƒ§ãƒ³ãƒã‚°ãŒè“„ç©ã•ã‚Œã€ãã®ãƒ‡ãƒ¼ã‚¿é‡ã¯36ãƒ†ãƒ©ãƒã‚¤ãƒˆã«è‡³ã‚‹ã¨ã„ã†ã€‚ã“ã†ã—ãŸã‚¹ã‚±ãƒ¼ãƒ«ã®ãƒ‡ãƒ¼ã‚¿ã‚’ã€å¾“æ¥ã®RDBã‚’ç”¨ã„ã¦åˆ†æžã™ã‚‹ã«ã¯ã€ç´„1ã‚«æœˆã®æ™‚é–“ãŒå¿…è¦ã¨ã•ã‚Œã¦ããŸãŒã€Hadoopã‚’ç”¨ã„ã‚‹ã“ã¨ã§13åˆ†ã«çŸç¸®ã•ã‚ŒãŸã¨ã„ã†ã€‚ ã“ã‚Œã¾ã§ã¯ã€Yahoo!ã«ã—ã‚VISAã«ã—ã‚ã€è†¨å¤§ãªãƒ‡ãƒ¼ã‚¿ã‚’RDBã«æŠ¼ã—è¾¼ã‚€ã»ã‹ã«æ–¹æ³•ã¯ãªãã€ãã®åˆ†æžã«æ•°åæ—¥ã‚’è¦ã™ã‚‹
tsupo 2009/10/15
å¢—ãˆç¶šã‘ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚’åŠ¹çŽ‡ã‚ˆããƒãƒ³ãƒ‰ãƒªãƒ³ã‚°ã™ã‚‹ãŸã‚ã®ä»•çµ„ã¿ã¨ã—ã¦RDBã«å¤‰ã‚ã‚‹é¸æŠžè‚¢ã‚’MapReduceåž‹ã®Hadoopã«æ±‚ã‚ã‚‹å‹•ã / ã€Œã‚‚ã†ã€ç‰¹å®šã®ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ãƒ™ãƒ³ãƒ€ãƒ¼ã«ã€è†¨å¤§ãªãƒ©ã‚¤ã‚»ãƒ³ã‚¹æ–™ã‚’æ”¯æ‰•ã†æ™‚ä»£ã§ã¯ãªã„ã€

MapReduce

hadoop

database

business

cloudComputing

event

report
ãƒªãƒ³ã‚¯
ãƒžã‚¤ã‚¹ãƒšãƒ¼ã‚¹ã€åˆ†æ•£å‡¦ç†ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã€Œqizmtã€ã‚’ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã«
MySpaceã¯ç±³å›½æ™‚é–“9æœˆ15æ—¥ã€ã€Œqizmtã€ã¨å‘¼ã°ã‚Œã‚‹æ–°ã—ã„ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã‚’ç™ºè¡¨ã—ãŸã€‚qizmtã¯ã€åŒç¤¾ã®ãƒ‡ãƒ¼ã‚¿ãƒžã‚¤ãƒ‹ãƒ³ã‚°ãƒãƒ¼ãƒ ãŒé–‹ç™ºã—ãŸåˆ†æ•£åž‹ã‚³ãƒ³ãƒ”ãƒ¥ãƒ†ãƒ¼ã‚·ãƒ§ãƒ³ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã ã€‚ qizmtã¯ã€Googleã«ãŠã‘ã‚‹æ¤œç´¢ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ä½œæˆã®ä¸æ ¸çš„ãªã‚·ã‚¹ãƒ†ãƒ ã¨ã—ã¦ã‚ˆãçŸ¥ã‚‰ã‚Œã¦ã„ã‚‹ã€ŒMapReduceã€ã‚’ãƒ™ãƒ¼ã‚¹ã«ã—ã¦ã„ã‚‹ã€‚ã—ã‹ã—ã€qizmtã¯ã€ã€ŒMicrosoft Windowsã€ã‚µãƒ¼ãƒã§æ§‹æˆã•ã‚ŒãŸå¤§è¦æ¨¡ã‚¯ãƒ©ã‚¹ã‚¿ä¸Šã§å‹•ä½œã™ã‚‹ã€‚ã“ã‚Œã¯ã‚³ãƒ¢ãƒ‡ã‚£ãƒ†ã‚£ãƒ¬ãƒ™ãƒ«ã®Linuxãƒžã‚·ãƒ³ã‚’åˆ©ç”¨ã™ã‚‹ã‚‚ã®ã¨æ€ã‚ã‚ŒãŒã¡ãªã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ãƒ†ã‚£ãƒ³ã‚°ã‚¹ã‚¿ã‚¤ãƒ«ã¨ã—ã¦ã¯èˆˆå‘³æ·±ã„ç‚¹ã§ã‚ã‚‹ã€‚ MapReduceã¯ã€å·¨å¤§ãªãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆã‚’å‡¦ç†ã€ç”Ÿæˆã™ã‚‹ãŸã‚ã®ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ãƒ¢ãƒ‡ãƒ«ã€‚ã‚ãƒ¼ã¨ãƒãƒªãƒ¥ãƒ¼ã®ãƒšã‚¢ã‚’å‡¦ç†ã—ã¦ä¸é–“çš„ãªã‚ãƒ¼ã¨ãƒãƒªãƒ¥ãƒ¼ã®ãƒšã‚¢ã‚»ãƒƒãƒˆã‚’ç”Ÿæˆã™ã‚‹mapé–¢æ•°ã‚„ã€ãã®å‡¦ç†çµæžœã‚’é›†ç´„ã™ã‚‹reduceé–¢æ•°ã‚’åˆ©ç”¨ã™ã‚‹ã®ãŒç‰¹å¾´ã§ã‚ã‚‹
tsupo 2009/09/16
åˆ†æ•£åž‹ã‚³ãƒ³ãƒ”ãƒ¥ãƒ†ãƒ¼ã‚·ãƒ§ãƒ³ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ / MapReduceã‚’ãƒ™ãƒ¼ã‚¹ã«ã—ã¦ã„ã‚‹ãŒã€Linux ã§ã¯ãªã Windows Server ä¸Šã§å‹•ä½œ / ãƒ©ã‚¤ã‚»ãƒ³ã‚¹ã¯ GPL v3 / http://code.google.com/p/qizmt/

myspace

MapReduce

qizmt

openSource
ãƒªãƒ³ã‚¯
ã‚¢ãƒžã‚¾ãƒ³ã€ã‚¦ã‚£ã‚¶ãƒ¼ãƒ‰ã ã‘ã§ä½¿ãˆã‚‹Hadoopã‚µãƒ¼ãƒ“ã‚¹é–‹å§‹ ï¼ ï¼ IT
2009/04/02 ç±³ã‚¢ãƒžã‚¾ãƒ³ã®åä¼šç¤¾ã€Amazon Web Servicesï¼ˆAWSï¼‰ã¯4æœˆ2æ—¥ã€å¤šæ•°ã®OSã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ã‚’èµ·å‹•ã—ã¦å¤§è¦æ¨¡åˆ†æ•£å‡¦ç†ã‚’è¡Œãˆã‚‹ã€ŒAmazon Elastic MapReduceã€ã®ãƒ™ãƒ¼ã‚¿ã‚µãƒ¼ãƒ“ã‚¹ã‚’é–‹å§‹ã—ãŸã€‚ Amazon Elastic MapReduceã¯ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®åˆ†æ•£å‡¦ç†ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯Apache Hadoop 0.18.3ã‚’åˆ©ç”¨ã—ãŸã‚µãƒ¼ãƒ“ã‚¹ã§ã€Webãƒ–ãƒ©ã‚¦ã‚¶ãƒ™ãƒ¼ã‚¹ã®ç®¡ç†ã‚³ãƒ³ã‚½ãƒ¼ãƒ«ã‚„ã‚³ãƒžãƒ³ãƒ‰ãƒ©ã‚¤ãƒ³ãƒ„ãƒ¼ãƒ«ã€APIã‚’ä½¿ã£ã¦ã‚¸ãƒ§ãƒ–ã‚’æŠ•å…¥ã™ã‚‹ã“ã¨ã§ã€å¤§é‡ãƒ‡ãƒ¼ã‚¿ã®è§£æžã‚„è¨ˆç®—é‡ã®å¤šã„ç§‘å¦è¨ˆç®—ã€çµ±è¨ˆå‡¦ç†ãŒå¯èƒ½ã€‚å¤§é‡ã®ãƒã‚°å‡¦ç†ã‚„æ©Ÿæ¢°å¦ç¿’ã€é‡‘èžè¨ˆç®—ã€ãƒ‡ãƒ¼ã‚¿ãƒžã‚¤ãƒ‹ãƒ³ã‚°ã€Webã‚µã‚¤ãƒˆã®ã‚¤ãƒ³ãƒ‡ã‚¯ã‚·ãƒ³ã‚°å‡¦ç†ãªã©ã«ä½¿ãˆã‚‹ã¨ã„ã†ã€‚ ã‚¸ãƒ§ãƒ–ã‚’å‡¦ç†ã™ã‚‹ãƒŽãƒ¼ãƒ‰ã¯ã€å¾“æ¥ã‹ã‚‰AWSãŒæä¾›ã—ã¦ã„ã‚‹Amazon EC2ã§ç¨¼åƒã—ã€ãƒ‡ãƒ¼ã‚¿ã®å…¥å‡ºåŠ›ã«ã¯Amazon S3ãŒä½¿ãˆã‚‹ã€‚ãƒ‡ãƒ¼ã‚¿ã®å…¥åŠ›ã«ã¯ã‚¤
tsupo 2009/04/03
Amazon Elastic MapReduceã¯ã€Apache Hadoop 0.18.3ã‚’åˆ©ç”¨ã—ãŸã‚µãƒ¼ãƒ“ã‚¹ / Javaã€Rubyã€Perlã€Pythonã€PHPã€Rã€C++ / èµ·å‹•ã§ãã‚‹ãƒŽãƒ¼ãƒ‰æ•°ã«åˆ¶é™ã¯ãªã„ãŒã€20ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ä»¥ä¸Šåˆ©ç”¨ã™ã‚‹å ´åˆã«ã¯ã€äº‹å‰ã«ç”³è«‹ãŒå¿…è¦

amazon

EC2

hadoop

mapreduce
ãƒªãƒ³ã‚¯
ã‚°ãƒ¼ã‚°ãƒ«ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼ã®å†…å´--æ˜Žã‚‰ã‹ã«ã•ã‚ŒãŸç‹¬è‡ªæ€§
ã‚µãƒ³ãƒ•ãƒ©ãƒ³ã‚·ã‚¹ã‚³ç™º--å…ˆæ—¥ã€Googleã®ç§˜å¯†ãŒå°‘ã—ã ã‘æ˜Žã‚‰ã‹ã«ãªã£ãŸã€‚ GoogleãŒãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼æ¥å‹™ã‚’å…¬é–‹ã™ã‚‹ã“ã¨ã¯æ»…å¤šã«ãªã„ãŒã€ç±³å›½æ™‚é–“5æœˆ28æ—¥ã€Googleãƒ•ã‚§ãƒãƒ¼ã§ã‚ã‚‹Jeff Deanæ°ãŒæ¥å‹™ã®ä¸€éƒ¨ã‚’è©±é¡Œã«å–ã‚Šä¸Šã’ãŸã€‚28æ—¥ã«å½“åœ°ã§é–‹å‚¬ã•ã‚ŒãŸã€ŒGoogle I/Oã€ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã®è¶…æº€å“¡ã®è´è¡†ã«å¯¾ã—ã¦è¬›æ¼”ã‚’è¡Œã£ãŸDeanæ°ã¯ã€Googleã®ã‚¤ãƒ³ãƒ•ãƒ©ãŒã„ã‹ã«ç‹¬ç‰¹ã‹ã‚’èª¬æ˜Žã—ãªãŒã‚‰ã€Googleã®ç§˜å¯†ã‚’å°‘ã—ã ã‘æ˜Žã‚‰ã‹ã«ã—ãŸã€‚ Googleã¯ã”ãæ™®é€šã®ã‚µãƒ¼ãƒã‚’ä½¿ç”¨ã—ã¦ã„ã‚‹ã€‚ãƒ—ãƒã‚»ãƒƒã‚µã€ãƒãƒ¼ãƒ‰ãƒ‰ãƒ©ã‚¤ãƒ–ã€ãƒ¡ãƒ¢ãƒªã‚‚åŒæ§˜ã ã€‚ ä¸€æ–¹ã€Deanæ°ã¯ã€1800å°ã®ã‚µãƒ¼ãƒã§æ§‹æˆã•ã‚Œã‚‹ã‚¯ãƒ©ã‚¹ã‚¿ã¯ã€ãŸã„ã—ãŸã‚‚ã®ã§ã¯ãªã„ã¨ã„ã†ã‚ã‘ã§ã¯ãªã„ãŒã€ã”ãã‚ã‚Šãµã‚Œã¦ã„ã‚‹ã¨è€ƒãˆã¦ã„ã‚‹ã‚ˆã†ã ã€‚ã—ã‹ã—ã€GoogleãŒãã®ã‚ˆã†ãªãƒãƒ¼ãƒ‰ã‚¦ã‚§ã‚¢ã‚’ä½¿ã£ã¦ã€700ã€œ1000å°ã®ã‚µãƒ¼ãƒãŒä½¿ã‚ã‚Œã‚‹ä¸€èˆ¬çš„ãªæ¤œç´¢ã‚¯ã‚¨ãƒªã«0.5ç§’ä»¥ä¸‹ã§å¿œ
tsupo 2008/06/09
ä¸å¯èƒ½ãªã“ã¨ã¯é©åº¦ã«ç„¡è¦–ã™ã‚‹ / ãƒ•ã‚©ãƒ¼ãƒ«ãƒˆãƒˆãƒ¬ãƒ©ãƒ³ãƒˆã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã«è³‡é‡‘ã‚’æŠ•å…¥ã™ã‚‹æ–¹ã‚’é¸ã¶ / Googleã«ã¯ä¸¦åˆ—åŒ–å¯èƒ½ãªå•é¡ŒãŒãŸãã•ã‚“ã‚ã‚‹ / ãƒžã‚·ãƒ³æ•…éšœã¯ã™ã¹ã¦GFSã‚·ã‚¹ãƒ†ãƒ ã€å°‘ãªãã¨ã‚‚ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ãƒ¬ãƒ™ãƒ«ã§å‡¦ç†ã•ã‚Œã‚‹

Google

bigtable

mapreduce

gfs

multithread

technology

computer
ãƒªãƒ³ã‚¯
1