[B! Hadoop] Ikhisaã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

Ikhisa id:Ikhisa

Hadoopã«é–¢ã™ã‚‹Ikhisaã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (6)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

961ä¸‡äººã®é£Ÿå“ã‚’æ”¯ãˆã‚‹ãƒ‡ãƒ¼ã‚¿è§£æž
This document discusses Hadoop and its ecosystem. It covers Hadoop distributions like Cloudera and Amazon's Elastic MapReduce service. It also discusses running SQL-like queries using MapReduce and moving data between MySQL and Hadoop. Key algorithms like map and reduce functions are explained through examples. Different Hadoop deployment options on EC2 like standalone, Cloudera, and EMR are also
Ikhisa 2011/05/15
Hadoop

mysql
ãƒªãƒ³ã‚¯
ã‚°ãƒ¼ã‚°ãƒ«ç™ºã€ŒHadoopã€ã€æ—¥æœ¬ä¼æ¥ã‚‚åˆ©ç”¨ã¸
Hadoopã¯ã€ã‚°ãƒ¼ã‚°ãƒ«ãŒæ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ç”¨ã«é–‹ç™ºã—ãŸãƒãƒƒãƒå‡¦ç†ã‚·ã‚¹ãƒ†ãƒ ã‚’åŸºã«é–‹ç™ºã•ã‚ŒãŸã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã ã€‚ã‚°ãƒ¼ã‚°ãƒ«ãŒé–‹ç™ºã—ãŸåˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã€ŒGoogle File Systemï¼ˆGFSï¼‰ã€ã‚’æ¨¡ã—ãŸã€ŒHadoop Distributed File Systemï¼ˆHD FSï¼‰ã€ã¨ã€ãƒ‡ãƒ¼ã‚¿å‡¦ç†æ©Ÿæ§‹ã€ŒMapReduceã€ã‚’æ¨¡ã—ãŸã€ŒHadoop MapReduceã€ã§æ§‹æˆã™ã‚‹ã€‚ ç±³å›½ã§ã¯ç±³VISAã‚„ç±³JPãƒ¢ãƒ«ã‚¬ãƒ³ãƒ»ãƒã‚§ãƒ¼ã‚¹ã®ã‚ˆã†ãªå¤§æ‰‹é‡‘èžæ©Ÿé–¢ãŒã€ãƒãƒƒãƒå‡¦ç†ã«Hadoopã‚’ä½¿ç”¨ã™ã‚‹ã€‚ ãã®HadoopãŒã„ã‚ˆã„ã‚ˆã€æ—¥æœ¬ä¼æ¥ã§ã‚‚ä½¿ã‚ã‚Œå§‹ã‚ãŸã€‚ä¾‹ãˆã°æ¥½å¤©ã¯ã€ã‚ã‚‹å•†å“ã«å¯¾ã™ã‚‹ãŠè–¦ã‚å•†å“ã‚’ãƒªã‚¹ãƒˆã‚¢ãƒƒãƒ—ã™ã‚‹ã€Œãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‰å‡¦ç†ã€ã«Hadoopã‚’ä½¿ç”¨ã™ã‚‹ã€‚NTTãƒ‡ãƒ¼ã‚¿ã¯ã€å…¨å›½ã®æ¸‹æ»žæƒ…å ±ã‚’ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ã«å¯è¦–åŒ–ã™ã‚‹ã‚·ã‚¹ãƒ†ãƒ ã®æ§‹ç¯‰ã«Hadoopã‚’æŽ¡ç”¨ã—ãŸã€‚ä¸‰è±UFJã‚¤ãƒ³ãƒ•ã‚©ãƒ¡ãƒ¼ã‚·ãƒ§ãƒ³ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚‚Hadoopã‚’ä½¿ã£
Ikhisa 2011/03/24
Hadoop

*ã‚ã¨ã§èªã‚€
ãƒªãƒ³ã‚¯
åŸºå¹¹ç³»ãƒãƒƒãƒå‡¦ç†ã‚’Hadoopã§é«˜é€ŸåŒ– - ãƒ—ãƒã‚°ãƒ©ãƒžã®æ€ç´¢
åŸºå¹¹ç³»ãƒãƒƒãƒå‡¦ç†ã‚’Hadoopã§é«˜é€ŸåŒ–ã™ã‚‹è¨˜äº‹ã‚’è¦‹ã¤ã‘ãŸã®ã§ãƒ¡ãƒ¢ã€‚ ä»¥ä¸‹ãƒ©ãƒ•ãªãƒ¡ãƒ¢æ›¸ãã€‚ é–“é•ã£ã¦ã„ãŸã‚‰å¾Œã§ç›´ã™ã€‚ ã€å…ƒãƒã‚¿ã€‘ ãƒ—ãƒ¬ã‚¹ãƒªãƒªãƒ¼ã‚¹ï½œ2011å¹´2æœˆ9æ—¥ |ã‚¦ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã‚ºã€æ¥ç•Œåˆã€åŸºå¹¹ãƒãƒƒãƒç”¨ã®Hadoopãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã€ŒAsakusaã€ ã‚’é–‹ç™ºã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹åŒ–ã—ã¦æä¾›é–‹å§‹ | ã‚¦ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã‚ºæ ªå¼ä¼šç¤¾ | UL Systems, Inc. ã‚¦ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã‚ºã€åŸºå¹¹ãƒãƒƒãƒç”¨Hadoopãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã‚’OSSåŒ– - ãƒ‹ãƒ¥ãƒ¼ã‚¹ï¼šITpro åŸºå¹¹ãƒãƒƒãƒãŒè¶…é«˜é€ŸåŒ–ã™ã‚‹ï¼Ÿï½œHATã®ãƒ–ãƒã‚° æ¥å‹™ã‚·ã‚¹ãƒ†ãƒ ã¯ã€æ—¥ä¸ã®ãƒ•ãƒãƒ³ãƒˆã‚¨ãƒ³ãƒ‰ã®ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ å‡¦ç†ã¨å¤œé–“ã®å¤§é‡ãƒ‡ãƒ¼ã‚¿ã‚’é›†è¨ˆã™ã‚‹ãƒãƒƒãƒå‡¦ç†ã®2ãƒ‘ã‚¿ãƒ¼ãƒ³ã‚’çµ„ã¿åˆã‚ã›ãŸã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ãŒå¤šã„ã€‚ ãƒ•ãƒãƒ³ãƒˆå´ã¯VisualBasicâ†’CGIâ†’Javaâ†’Railsã‚„HTML5ã¨æ¬¡ã€…ã«æŠ€è¡“é©æ–°ãŒèµ·ãã¦ã„ã‚‹ã®ã«ã€ãƒãƒƒãƒå´ã¯æ˜”ã®Cobolã§ä½œã£ãŸè³‡ç”£ãŒæ®‹ã£ã¦ã„ã¦ã€ãã“ã‹ã‚‰
Ikhisa 2011/02/11
Hadoop
ãƒªãƒ³ã‚¯
ãã‚ãã‚Hadoopã«ã¤ã„ã¦ã²ã¨ã“ã¨è¨€ã£ã¦ãŠãã‹ - nokunoã®æ—¥è¨˜
ã‚‚ã†ã“ã®æ‰‹ã®è©±é¡Œã¯å‡ºå°½ãã—ãŸæ„ŸãŒã‚ã‚Šã¾ã™ãŒã€æœ€è¿‘Hadoopã«ã¤ã„ã¦è€ƒãˆã‚‹ã“ã¨ãŒå¤šã„ã®ã§ã€ã‚¨ãƒ³ãƒˆãƒªã«ã—ã¦ã¿ã¾ã™ã€‚ãªãŠã€ã“ã“ã§ã¯ãƒ™ãƒ¼ã‚·ãƒƒã‚¯ãªMapReduce+HDFSã®ã“ã¨ã‚’Hadoopã¨å‘¼ã¶ã“ã¨ã«ã—ã¾ã™ã€‚ Hadoopã¨ã¯Hadoopã¨ã¯è¨€ã‚ãšã¨çŸ¥ã‚ŒãŸGoogleã®MapReduce/GFSã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ã‚¯ãƒãƒ¼ãƒ³ã§ã™ã€‚MapReduceã§ã¯ãƒ—ãƒã‚°ãƒ©ãƒžã¯Mapã¨Reduceã¨ã„ã†2ã¤ã®é–¢æ•°ã‚’æ›¸ãã ã‘ã§ã€ä¸¦åˆ—åˆ†æ•£å‡¦ç†ã‚’ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ã“ã‚Œã¯(1) ãƒ‡ãƒ¼ã‚¿ã‚’å®Ÿéš›ã«æŒã¤ãƒžã‚·ãƒ³ã«ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’é…å¸ƒã™ã‚‹ (2) Mapã¨Reduceã‚’ã¤ãªãShuffleãƒ•ã‚§ãƒ¼ã‚ºã§ã‚ãƒ¼ã‚’ã‚°ãƒ«ãƒ¼ãƒ—åŒ–ã—ã¦ã‚½ãƒ¼ãƒˆã™ã‚‹ã€(3) éšœå®³æ™‚ã®ãƒ•ã‚§ãƒ¼ãƒ«ã‚ªãƒ¼ãƒãƒ¼ã‚„ãƒ¬ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã€ã¨ã„ã£ãŸå‡¦ç†ã‚’ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯å´ãŒå—ã‘æŒã¤ã“ã¨ã«ã‚ˆã£ã¦ã€ãƒ—ãƒã‚°ãƒ©ãƒžå´ã®è² æ‹…ã‚’æ¸›ã‚‰ã™ã‚‚ã®ã§ã™ã€‚GFSã«å¯¾å¿œã™ã‚‹HDFSã«ã¯ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ã‚¯ãƒ©ã‚¹ã‚¿ã«åˆ†æ•£ã—ã¦ä¿å˜
Ikhisa 2011/01/03
Hadoop
ãƒªãƒ³ã‚¯
ä¼æ¥ã§ä½¿ã‚ã‚Œã‚‹Hadoop
Copyright Â© 2004-2024 Impress Corporation. An Impress Group Company. All rights reserved.
Ikhisa 2010/11/16
Hadoop

ã‚·ã‚¹ãƒ†ãƒ

*ã‚ã¨ã§èªã‚€
ãƒªãƒ³ã‚¯
NTTãƒ‡ãƒ¼ã‚¿ã®Hadoopå ±å‘Šæ›¸ãŒã™ã”ã‹ã£ãŸ - ç§‘å¦ã¨éžç§‘å¦ã®è¿·å®®
æ¥ç•Œãƒˆãƒƒãƒ— ã®ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚º Hadoop ä¼æ¥ Cloudera ã«å…¥ç¤¾ã—ã¾ã—ãŸ http://www.cloudera.co.jp/ ä»Šå¹´ã®6æœˆã«ã€ã€Œå¹³æˆï¼’ï¼‘å¹´åº¦ ç”£å¦é€£æºã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢å·¥å¦å®Ÿè·µäº‹æ¥å ±å‘Šæ›¸ã€ã¨ã„ã†ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆç¾¤ãŒçµŒç”£çœã‹ã‚‰å…¬è¡¨ã•ã‚Œã¾ã—ãŸã€‚ ãã®ã†ã¡ã®ä¸€ã¤ã«ã€NTTãƒ‡ãƒ¼ã‚¿ã«å§”è¨—ã•ã‚ŒãŸHadoopã«é–¢ã™ã‚‹å®Ÿè¨¼å®Ÿé¨“ã®å ±å‘Šæ›¸ãŒã‚ã‚Šã¾ã—ãŸã®ã§ã€ä»Šæ›´ãªãŒã‚‰èªã‚“ã§ã¿ã‚‹ã“ã¨ã«ã—ã¾ã—ãŸã€‚ Hadoopç•Œéšˆã®äººã¯ã‚‚ã†ã¿ã‚“ãªã¨ã£ãã«èªã‚“ã§ã‚‹ã®ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ã‘ã©ã€‚ http://www.meti.go.jp/policy/mono_info_service/joho/downloadfiles/2010software_research/clou_dist_software.pdf ã€Œé«˜ä¿¡é ¼ã‚¯ãƒ©ã‚¦ãƒ‰å®Ÿç¾ç”¨ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢é–‹ç™ºï¼ˆåˆ†æ•£åˆ¶å¾¡å‡¦ç†æŠ€è¡“ç‰ã«ä¿‚ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼é«˜ä¿¡é ¼åŒ–ã«å‘ã‘ãŸå®Ÿè¨¼äº‹æ¥ï¼‰ã€ã¨ã„ã†
Ikhisa 2010/09/28
*ã‚ã¨ã§èªã‚€

ã‚¯ãƒ©ã‚¦ãƒ‰

Hadoop
ãƒªãƒ³ã‚¯
1