[B! MapReduce] kakku22ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

kakku22 id:kakku22

MapReduceã«é–¢ã™ã‚‹kakku22ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (5)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Hadoopã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã¨ã‚µãƒ³ãƒ—ãƒ«ãƒ—ãƒã‚°ãƒ©ãƒ ã®å®Ÿè¡Œ
å‰å›žã¯Googleã®åŸºç›¤æŠ€è¡“ã¨ãã‚Œã«å¯¾å¿œã™ã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã¨ã—ã¦ã€Hadoop & hBaseã‚’ç´¹ä»‹ã—ã¾ã—ãŸï¼ˆå›³1 å‚ç…§ï¼‰ã€‚ä»Šå›žã¯Hadoopã‚’1å°ã«ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã—ã€ã‚µãƒ³ãƒ—ãƒ«ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’å‹•ã‹ã—ã¾ã™ã€‚æ¬¡ã«HDFSã¨MapReduceã®ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ã‚’è§£èª¬ã—ã¾ã™ã€‚æœ€å¾Œã«ã‚µãƒ³ãƒ—ãƒ«ãƒ—ãƒã‚°ãƒ©ãƒ ã®ã‚½ãƒ¼ã‚¹ã‚³ãƒ¼ãƒ‰ã‚’è§£èª¬ã—ã¾ã™ã€‚ 2. Hadoopã®æ¦‚è¦ Hadoopã¯ä¸»ã«Yahoo! Inc.ã®Doug Cuttingæ°ã«ã‚ˆã£ã¦é–‹ç™ºãŒé€²ã‚ã‚‰ã‚Œã¦ã„ã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§ã€GoogleFileSystemã¨MapReduceã¨ã„ã†Googleã®åŸºç›¤æŠ€è¡“ã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹å®Ÿè£…ã§ã™ã€‚Hadoopã¨ã„ã†åå‰ã¯é–‹ç™ºè€…ã®åä¾›ãŒæŒã£ã¦ã„ã‚‹é»„è‰²ã„è±¡ã®ã¬ã„ãã‚‹ã¿ã®åå‰ã«ç”±æ¥ã—ã¦ã„ã¾ã™ã€‚Hadoopã¯HDFSï¼ˆHadoop Distributed File Systemï¼‰ã€Hadoop MapReduce F
kakku22 2013/01/02
Hadoop

MapReduce
ãƒªãƒ³ã‚¯
Data-Intensive Text Processing with MapReduce
Jimmy Lin and Chris Dyer. Morgan & Claypool Publishers, 2010. Our world is being revolutionized by data-driven methods: access to large amounts of data has generated new insights and opened exciting new opportunities in commerce, science, and computing applications. Processing the enormous quantities of data necessary for these advances requires large clusters, making distributed computing paradig
kakku22 2012/12/01
Data-Intensive Text Processing with MapReduce

Hadoop

MapReduce

æœ¬

è³‡æ–™
ãƒªãƒ³ã‚¯
EMCã¯Hadoopã‚’ã©ã®ã‚ˆã†ã«å±•é–‹ã—ã¦ã„ãã®ã‹ ï¼ ï¼ IT
2011/08/12 ç±³EMCãŒ5æœˆã«ç™ºè¡¨ã—ãŸã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚ºå‘ã‘Hadoopã®å›½å†…ã§ã®ä¸€èˆ¬æä¾›ã¯å¹´æœ«ã¨ãªã‚‹ã€‚EMCã‚¸ãƒ£ãƒ‘ãƒ³ã¯8æœˆ9æ—¥ã«è¡Œã£ãŸGreenplumè£½å“ç¾¤ã«é–¢ã™ã‚‹èª¬æ˜Žã®å ´ã§ã€ã“ã‚Œã‚’æ˜Žã‚‰ã‹ã«ã—ãŸã€‚ EMCã®æä¾›ã™ã‚‹MapReduceã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ å®Ÿè£…ã€ŒGreenplum HDã€ã¯ã€æ—¢å ±ã®ã¨ãŠã‚Šç„¡å„Ÿã®ã€ŒCommunity Editionã€ã€æœ‰å„Ÿã§ã‚µãƒãƒ¼ãƒˆã‚’å«ã‚€ã€ŒEnterprise Editionã€ã€ãã—ã¦ãƒãƒ¼ãƒ‰ã‚¦ã‚§ã‚¢ã¨ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚’æ§‹æˆæ¸ˆã¿ã®ã‚¢ãƒ—ãƒ©ã‚¤ã‚¢ãƒ³ã‚¹ã€ŒGreenplum HD Data Computing Applianceã€ã®3ã¤ã®å½¢ã§æä¾›ã•ã‚Œã‚‹ã€‚ Greenplum HDã¯ã€MapR Techno logiesã¨ã„ã†ãƒ™ãƒ³ãƒãƒ£ãƒ¼ä¼æ¥ãŒApache Hadoopã‚’Cè¨€èªžã§æ›¸ãç›´ã—ãŸã‚‚ã®ã‚’ã€EMCãŒOEMæä¾›ã™ã‚‹è£½å“ã€‚3ï½ž5å€ã®ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹å‘ä¸ŠãŒè¦‹è¾¼ã‚ã‚‹ã¨ã„ã†ã€‚ã¾ãŸã€NameN
kakku22 2011/08/16
ã©ã“ã‚‚ä¼¼ãŸã‚ˆã†ã«Hadoopã‚’çµ„ã¿æ›¿ãˆã¦ä»Šå¹´ã®å£²ã‚Šã«ã—ã¦ã‚‹ãªãƒ¼

EMC

Hadoop

MapReduce
ãƒªãƒ³ã‚¯
å®Ÿè·µï¼ ã€ŒMapReduceã§ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã€å¾¹åº•è§£èª¬
ã€Œé’ç©ºæ–‡åº«ã€ã‚’ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ï¼ å‰å›žã®ã€Œã„ã¾ã•ã‚‰èžã‘ãªã„Hadoopã¨ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°å…¥é–€ã€ã§ã¯ã€Hadoopã¨ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã®æ¦‚è¦ã‚„æ§‹æˆã€MapReduceã®ä»•çµ„ã¿ã€Hadoopã®æ´»ç”¨å ´é¢ãªã©ã‚’è§£èª¬ã—ã€Hadoopã®å®Ÿè¡Œç’°å¢ƒã‚’æ§‹ç¯‰ã—ã¾ã—ãŸã€‚ä»Šå›žã‹ã‚‰ã€Hadoopã‚’ä½¿ã„ã€ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã®MapReduceãƒ—ãƒã‚°ãƒ©ãƒ ã‚’ä½œæˆã—ã¦ã„ãã¾ã™ã€‚ ã€Œé’ç©ºæ–‡åº«ã€ã¨ã„ã†ã‚µã‚¤ãƒˆã‚’ã”å˜ã˜ã§ã—ã‚‡ã†ã‹ã€‚é’ç©ºæ–‡åº«ã¯ã€è‘—ä½œæ¨©ãŒåˆ‡ã‚ŒãŸæ—¥æœ¬ã®æ–‡å¦ä½œå“ã‚’æŽ²è¼‰ã—ã¦ã„ã‚‹Webã‚µã‚¤ãƒˆã§ã€é’ç©ºæ–‡åº«ã®å…¨ãƒ‡ãƒ¼ã‚¿ã‚’DVDã‚„ã€BitTorrentã«ã‚ˆã‚‹é…ä¿¡ã§å…¥æ‰‹ã§ãã¾ã™ã€‚ä»Šå›žã¯ã€ã“ã®ãƒ‡ãƒ¼ã‚¿ã‚’ä½¿ã£ã¦ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã‚’è¡Œã„ã¾ã—ã‚‡ã†ã€‚ å‰å›žã€ãƒ†ã‚ã‚¹ãƒˆåˆ†é¡žã§ã€è‘—è€…ã®æ€§åˆ¥ã€å¹´é½¢ã€åœ°åŸŸã€è·æ¥ãªã©ã®å±žæ€§ã‚‚æŽ¨å®šã§ãã‚‹ã¨æ›¸ãã¾ã—ãŸãŒã€é’ç©ºæ–‡åº«ã¯ã€ä»–ã®ãƒ‡ãƒ¼ã‚¿ã«ã¯ãªã„ã€è‘—è€…å±žæ€§ãŒã‚ã‚Šã¾ã™ã€‚é’ç©ºæ–‡åº«ã®ä½œå“ã¯ã€è‘—ä½œæ¨©ãŒåˆ‡ã‚Œã¦ã€ä½œè€…ãŒãªããªã£ã¦ã„ã‚‹å ´
kakku22 2011/07/31
Hadoop

MapReduce

è‡ªç„¶è¨€èªžå‡¦ç†

ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°

Java
ãƒªãƒ³ã‚¯
ã„ã¾ã•ã‚‰èžã‘ãªã„Hadoopã¨ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°å…¥é–€
ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿æ™‚ä»£ã®æ•‘ä¸–ä¸»ã€ŒHadoopã€ã¨ã¯ ã€ŒApache Hadoopã€ã¯ä»Šã€æœ€ã‚‚æ³¨ç›®ã‚’é›†ã‚ã¦ã„ã‚‹æŠ€è¡“ã®1ã¤ã§ã™ã€‚Hadoopã¨ã¯ã€å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’æ‰‹è»½ã«è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã—ã¦å‡¦ç†ã§ãã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã§ã™ã€‚ Hadoopã‚’æ´»ç”¨ã—ã¦ã„ã‚‹ä¼æ¥ã¯å¹´ã€…å¢—ãˆç¶šã‘ã¦ã„ã¦ã€ä¸å¯æ¬ ãªæŠ€è¡“ã«ãªã‚Šã¤ã¤ã‚ã‚‹ã¨ã„ãˆã‚‹ã§ã—ã‚‡ã†ã€‚ æœ¬é€£è¼‰ã§ã¯ã€Hadoopã¨ã¯ä½•ã‹ã€HadoopãŒã©ã†æ´»ç”¨ã§ãã‚‹ã®ã‹ã¨ã„ã†ã“ã¨ã‚’ã€ã€Œãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã€ã«ç„¦ç‚¹ã‚’å½“ã¦ã¦è§£èª¬ã—ã¦ã„ããŸã„ã¨æ€ã„ã¾ã™ã€‚ é‡ã„å‡¦ç†ã‚’è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã•ã›ã‚‹ è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«å‡¦ç†ã‚’åˆ†æ•£ã•ã›ã‚‹ã«ã¯ã€ãƒ—ãƒã‚»ã‚¹åŒå£«ã®é€šä¿¡ã€ç›£è¦–ã€éšœå®³æ™‚ã®å¯¾å¿œãªã©ã‚’è€ƒãˆãªã‘ã‚Œã°ãªã‚‰ãšã€ãƒ—ãƒã‚°ãƒ©ãƒžã«ã¨ã£ã¦ãƒãƒ¼ãƒ‰ãƒ«ãŒé«˜ã„ã‚‚ã®ã§ã™ã€‚ã—ã‹ã—ã€Hadoopã¯ãã†ã„ã£ãŸé¢å€’ãã•ã„å‡¦ç†ã‚’ä¸€æ‰‹ã«å¼•ãå—ã‘ã¦ãã‚Œã€ãƒ—ãƒã‚°ãƒ©ãƒžã¯ã€ã‚„ã‚ŠãŸã„å‡¦ç†ã ã‘ã«é›†ä¸ã§ãã¾ã™ã€‚ ä¾‹ãˆã°ã€Hadoopã‚’ä½¿ã†ã¨ã€1
kakku22 2011/06/21
Hadoop 0.20.S Virtual Machine

Hadoop

MapReduce
ãƒªãƒ³ã‚¯
1