[B! Hadoop] rx7ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

rx7 id:rx7

Hadoopã«é–¢ã™ã‚‹rx7ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (52)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

ã€ŒHadoopã®æ™‚ä»£ã¯çµ‚ã‚ã£ãŸã€ã®æ„å‘³ã‚’æ£ã—ãç†è§£ã™ã‚‹ - ç§‘å¦ã¨éžç§‘å¦ã®è¿·å®®
Hadoopã®æ™‚ä»£ã¯çµ‚ã‚ã£ãŸã€ã¨ã„ã†è¨€èª¬ã‚’ãŸã¾ã«è¦‹ã‹ã‘ã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã—ãŸã€‚ ã‚‚ã¡ã‚ã‚“çµ‚ã‚ã£ã¦ãªã©ã„ã¾ã›ã‚“ã€‚ã—ã‹ã—ã€Hadoopã¨ãã®å–ã‚Šå·»ãç’°å¢ƒãŒå¤‰åŒ–ã—ãŸã®ã¯äº‹å®Ÿã§ã™ã€‚ æœ¬è¨˜äº‹ã§ã¯ã€ã“ã®å¤‰åŒ–ãŒä½•ãªã®ã‹ã‚’æ˜Žã‚‰ã‹ã«ã—ã€ãã®ä¸Šã§ã€ãªãœHadoopã®æ™‚ä»£ã¯çµ‚ã‚ã£ãŸã¨ã„ã†ä¸»å¼µãŒå®Ÿæ…‹ã‚’æ£ã—ãè¡¨ã—ã¦ã„ãªã„ã®ã‹ã‚’èª¬æ˜Žã—ã¦ã„ãã¾ã™ã€‚ DISCLAIMER ç§ã¯Hadoopã‚’ä¸å¿ƒã¨ã—ãŸãƒ‡ãƒ¼ã‚¿åŸºç›¤ã‚’å–ã‚Šæ‰±ã†ãƒ™ãƒ³ãƒ€ãƒ¼ã€Clouderaã®ç¤¾å“¡ã§ã™ã€‚ ä¸ç«‹çš„ã«æ›¸ãã‚ˆã†åŠªã‚ã¾ã™ãŒã€æ‰€å±žçµ„ç¹”ã«ã‚ˆã£ã¦ç™ºç”Ÿã™ã‚‹ãƒã‚¤ã‚¢ã‚¹ã®å®Œå…¨ãªæŽ’é™¤ã‚’ä¿è¨¼ã™ã‚‹ã“ã¨ã¯ã§ãã¾ã›ã‚“ã€‚ ä»¥ä¸Šã‚’ã”äº†æ‰¿ã®ä¸Šã€èªã¿é€²ã‚ã¦ãã ã•ã„ã€‚ è¦ç´„ ãƒ‡ãƒ¼ã‚¿åŸºç›¤ã¯ã€Hadoopã®ç™»å ´ã«ã‚ˆã‚Šéžå¸¸ã«å®‰ä¾¡ã¨ãªã‚Šã€ä»Šã¾ã§ã§ã¯ä¸å¯èƒ½ã ã£ãŸå¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’å–ã‚Šæ‰±ãˆã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã—ãŸã€‚ Hadoopã¯ã€NoSQLãƒ–ãƒ¼ãƒ ã®ä¸ã€å‡¦ç†ã‚¨ãƒ³ã‚¸ãƒ³ã§ã‚ã‚‹MapReduceã¨ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã§ã‚ã‚‹HDFSãŒ
rx7 2017/07/12
Hadoop

Spark

ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸
ãƒªãƒ³ã‚¯
ã†ã‚ã£ï½¥ï½¥ï½¥å…ˆæœˆã®ã‚³ã‚¹ãƒˆã€ä½Žã™ãŽï½¥ï½¥ï½¥ï¼ŸHadoopã‚¯ãƒ©ã‚¹ã‚¿ã®ã‚¯ãƒ©ã‚¦ãƒ‰ç§»è¡Œã¨Sparkã‚ªãƒ³ãƒ‡ãƒžãƒ³ãƒ‰ - astamuse Lab
ç¦ç”°ã§ã™ã€‚ ã‚†ã£ãã‚Šã¨ã‚«ãƒ¢ãƒŸãƒ¼ãƒ«ã‚’é£²ã¿ãªãŒã‚‰ãƒ©ãƒƒãƒ—ãƒˆãƒƒãƒ—ã‚’å©ã„ã¦ã„ã¾ã™ã€‚ 3å¹´é–“ãŠä¸–è©±ã«ãªã£ãŸãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼ã®Hadoopã‚¯ãƒ©ã‚¹ã‚¿ã‚’ã‚¯ãƒ©ã‚¦ãƒ‰ç’°å¢ƒã«ç§»è¡Œã—ã¾ã—ãŸã€‚ ã‚¯ãƒ©ã‚¦ãƒ‰ã§ã¯å¾“é‡èª²é‡‘ã‚’æ´»ã‹ã—ã¦ã‚³ã‚¹ãƒˆã®æœ€é©åŒ–ã‚’å›³ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ ä»Šå›žã€Cloudera Managerã¨Jenkinsãã‚Œãžã‚Œã®APIã‚’ä½¿ç”¨ã—ã€ã‚¯ãƒ©ã‚¹ã‚¿ã®èµ·å‹•çŠ¶æ…‹ã‚’ä¿è¨¼ã™ã‚‹ãƒ©ãƒƒãƒ‘ãƒ¼ã¨è‡ªå‹•åœæ¢ã‚µã‚¤ã‚¯ãƒ«ã‚’å®Ÿè£…ã™ã‚‹ã“ã¨ã§ã€é€éŽçš„ãªã‚¯ãƒ©ã‚¹ã‚¿ã®èµ·å‹•ã¨åœæ¢ã‚’å®Ÿç¾ã—ã¾ã—ãŸã€‚ *1 ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ å…¨ã¦ã‚’åŒ…ã‚€Wraps ä½œæ¥ç’°å¢ƒã¨ãªã‚‹ãƒ›ã‚¹ãƒˆã«ã€ãƒ©ãƒƒãƒ‘ãƒ¼ã‚³ãƒžãƒ³ãƒ‰ï¼ˆä»¥ä¸‹Wrapsï¼‰ã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã—ã¾ã™ã€‚ *2 Wrapsã¯ã€çŠ¶æ³ã«å¿œã˜ã¦Jenkinsã€Cloudera Managerã®APIã‚’å‘¼ã³å‡ºã—ã€VMã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ãŠã‚ˆã³CDHã‚¯ãƒ©ã‚¹ã‚¿ã®èµ·å‹•çŠ¶æ…‹ã‚’ä¿è¨¼ã—ã¾ã™ã€‚ ã¾ãŸã€å¾Œè¿°ã™ã‚‹åœæ¢ã‚µã‚¤ã‚¯ãƒ«ã«å¯¾ã—ã¦ä½¿ç”¨ä¸ã§ã‚ã‚‹ã“ã¨ã‚’é€šçŸ¥ã™ã‚‹ãƒãƒƒã‚¯ãƒ•ã‚¡ã‚¤ãƒ«ã®ä½œæˆã¨å‰Š
rx7 2017/06/21
ã‚¯ãƒ©ã‚¦ãƒ‰ã«ç§»è¡Œã—ãŸã®ã§ã€ã“ã‚“ãªæ„Ÿã˜ã§ã‚³ã‚¹ãƒˆæœ€é©åŒ–ã«å‘ã‘ã¦å–ã‚Šçµ„ã‚“ã§ãŠã‚Šã¾ã™ã€‚

Hadoop
ãƒªãƒ³ã‚¯
Yahoo! Japanã®Hadoopã‚¯ãƒ©ã‚¹ã‚¿ã¯6000ãƒŽãƒ¼ãƒ‰ã§120PBã€‚æŒ‡æ•°é–¢æ•°çš„ã«å¢—å¤§ã™ã‚‹ãƒ‡ãƒ¼ã‚¿éœ€è¦ã‚’æŠ€è¡“ã§è§£æ±ºã—ã¦ã„ãã€‚Hadoop Spark Conference Japan 2016
Yahoo! Japanã®Hadoopã‚¯ãƒ©ã‚¹ã‚¿ã¯6000ãƒŽãƒ¼ãƒ‰ã§120PBã€‚æŒ‡æ•°é–¢æ•°çš„ã«å¢—å¤§ã™ã‚‹ãƒ‡ãƒ¼ã‚¿éœ€è¦ã‚’æŠ€è¡“ã§è§£æ±ºã—ã¦ã„ãã€‚Hadoop Spark Conference Japan 2016 æ—¥æœ¬ã‚’ä»£è¡¨ã™ã‚‹è¦æ¨¡ã®ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿å‡¦ç†åŸºç›¤ã‚’æŒã¤ä¼æ¥ã®1ã¤ãŒYahoo! Japanï¼ˆä»¥ä¸‹Yahoo!ï¼‰ã§ã™ã€‚ åŒç¤¾ã¯2æœˆ8æ—¥ã«é–‹å‚¬ã•ã‚ŒãŸã€ŒHadooop Spark Conference Japan 2016ã€ã«ãŠã„ã¦ã€ç¾åœ¨é‹ç”¨ä¸ã®ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿å‡¦ç†åŸºç›¤ã®è¦æ¨¡ã€ãã—ã¦åŒç¤¾ãŒæŠ±ãˆã¦ã„ã‚‹èª²é¡Œã¨ã€ãã‚Œã‚’ã©ã†è§£æ±ºã—ã¦ã„ãã®ã‹ã‚’åŸºèª¿è¬›æ¼”ã®ä¸ã§ç¤ºã—ã¾ã—ãŸã€‚ åŒç¤¾ãŒç¤ºã—ãŸè§£æ±ºæ–¹æ³•ã¯ã€Hadoopãªã©ã®ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿å‡¦ç†åŸºç›¤ã‚’ä½¿ã„å€’ã™å´ã‹ã‚‰ã€ä½œã‚‹å´ã¸å‘ã‹ã†ã¨ã„ã†å¤§èƒ†ãªã‚‚ã®ã§ã™ã€‚åŒç¤¾ã®è²¢çŒ®ã¯ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã¨ãªã‚Šã€ä»Šå¾Œã•ã‚‰ã«å¤šãã®èª²é¡Œè§£æ±ºã«å½¹ç«‹ã¤ã“ã¨ã«ãªã‚Šãã†ã§ã™ã€‚ åŒç¤¾ãƒ‡ãƒ¼ã‚¿ã‚¤ãƒ³ãƒ•ãƒ©æœ¬éƒ¨ é è—¤ç¦Žå£«ï¼ˆãˆã‚“ã©ã†ãŸã ã—ï¼‰æ°
rx7 2016/02/09
Yahoo!

Hadoop

äº‹ä¾‹

è³‡æ–™
ãƒªãƒ³ã‚¯
ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ãƒ„ãƒ¼ãƒ«ãƒã‚§ã‚¤ãƒ³ã®ã‚»ã‚ãƒ¥ãƒªãƒ†ã‚£ã¯ãƒ“ãƒƒã‚°ãƒªã‚¹ã‚¯ã€ã‚ã‚‹ã„ã¯ã€èª°ã‚‚Hadoopã‚’ã‚¹ã‚¯ãƒ©ãƒƒãƒã‹ã‚‰ãƒ“ãƒ«ãƒ‰ã™ã‚‹æ–¹æ³•ã‚’çŸ¥ã‚‰ãªã„ä»¶ã«ã¤ã„ã¦
ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ãƒ„ãƒ¼ãƒ«ãƒã‚§ã‚¤ãƒ³ã®ã‚»ã‚ãƒ¥ãƒªãƒ†ã‚£ã¯ãƒ“ãƒƒã‚°ãƒªã‚¹ã‚¯ã€ã‚ã‚‹ã„ã¯ã€èª°ã‚‚Hadoopã‚’ã‚¹ã‚¯ãƒ©ãƒƒãƒã‹ã‚‰ãƒ“ãƒ«ãƒ‰ã™ã‚‹æ–¹æ³•ã‚’çŸ¥ã‚‰ãªã„ä»¶ã«ã¤ã„ã¦ The sad state of sysadmin in the age of containers ã‚³ãƒ³ãƒ†ãƒŠãƒ¼æ™‚ä»£ã®ã‚·ã‚¹ãƒ†ãƒ ç®¡ç†è€…ã®æƒ¨çŠ¶ ã‚·ã‚¹ãƒ†ãƒ ç®¡ç†ã¯æƒ¨åŠ‡ã«è¦‹èˆžã‚ã‚Œã¦ã„ã‚‹ã€‚ç¾çŠ¶ã¯æ‚²æƒ¨ã ã€‚ ç†è€…ã¯æ˜”æ°—è³ªã®ã‚·ã‚¹ãƒ†ãƒ ç®¡ç†è€…ã«ä¸æº€ã¯ãªã„ã€‚ã‚·ã‚¹ãƒ†ãƒ ã®ç¨¼åƒã‚’ç¶æŒã—ã€ã‚¢ãƒƒãƒ—ãƒ‡ãƒ¼ãƒˆã—ã€ã‚¢ãƒƒãƒ—ã‚°ãƒ¬ãƒ¼ãƒ‰ã™ã‚‹æ–¹æ³•ã‚’çŸ¥ã£ã¦ã„ã‚‹è€…é”ã ã€‚ ã“ã®æ†¤ã‚Šã¯ã€ã‚³ãƒ³ãƒ†ãƒŠãƒ¼ã¨æ§‹ç¯‰æ¸ˆã¿VMã¨ã€ãã‚Œã‚‰ãŒã‚‚ãŸã‚‰ã™ã€ã€Œä¿¡é ¼ã€ã‚„ã€Œã‚¢ãƒƒãƒ—ã‚°ãƒ¬ãƒ¼ãƒ‰ã€ã®æ¬ å¦‚ã«ã‚ˆã‚‹æ‚²æƒ¨ãªæƒ¨åŠ‡ã«å¯¾ã™ã‚‹ã‚‚ã®ã ã€‚ ä¾‹ãˆã°ã€Hadoopã‚’è¦‹ã¦ã¿ã‚ã€‚èª°ã‚‚Hadoopã‚’ã‚¹ã‚¯ãƒ©ãƒƒãƒã‹ã‚‰ãƒ“ãƒ«ãƒ‰ã™ã‚‹æ–¹æ³•ã‚’çŸ¥ã£ã¦ã„ã‚‹ã‚ˆã†ã«ã¯è¦‹ãˆãªã„ãžã€‚ä¾å˜æ€§ã¨ãƒãƒ¼ã‚¸ãƒ§ãƒ³ã¨ãƒ“ãƒ«ãƒ‰ãƒ„ãƒ¼ãƒ«ãŒæ‚²æƒ¨ãªã»ã©ã«çµ¡ã¾ã‚Šã‚ã£ã¦ã„ã‚‹ã€‚ ã“ã®æ‰‹ã®ã‚¤ã‚±ã¦ã‚‹ãƒ„ãƒ¼ãƒ«ã®ä¸ã§ã€å¤å…¸çš„ãªmake
rx7 2015/04/29
Hadoop

ã‚»ã‚ãƒ¥ãƒªãƒ†ã‚£

è©±ã®ãƒã‚¿
ãƒªãƒ³ã‚¯
Cloudera Standard ã®ã”æ¡ˆå†… ~ ç„¡å„Ÿç‰ˆ å¤§å¹…æ©Ÿèƒ½å¼·åŒ–ã®ãŠçŸ¥ã‚‰ã› | Cloudera Japan
Cloudera ã¯ã€æœ€å¤§è¦æ¨¡ã®ä¼æ¥ãŒã‚ã‚‰ã‚†ã‚‹å ´æ‰€ã«å˜åœ¨ã™ã‚‹ã™ã¹ã¦ã®ãƒ‡ãƒ¼ã‚¿ã‚’ä¿¡é ¼æ€§ã®é«˜ã„æœ‰æ„ç¾©ãªæ´žå¯Ÿã«å¤‰æ›ã§ãã‚‹ã‚ˆã†æ”¯æ´ã—ã¾ã™ã€‚ Trusted Data Today for Tomorrowâ€™s AI (ä»Šæ—¥ã®ä¿¡é ¼ã§ãã‚‹ãƒ‡ãƒ¼ã‚¿ã‚’ã€æ˜Žæ—¥ã® AI ã«è¨—ã™) ãƒ‡ãƒ¼ã‚¿ã¨ AI ãŒãƒ†ãƒ¼ãƒžã®ãƒ—ãƒ¬ãƒŸã‚¢ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã§ã€æ¥ç•Œæœ€å‰ç·šã®æ˜Žç¢ºãªãƒ“ã‚¸ãƒ§ãƒ³ã‚’æŒã£ãŸæ–¹ã€…ã‚„ã‚½ãƒ¼ãƒˆãƒªãƒ¼ãƒ€ãƒ¼ã‹ã‚‰è²´é‡ãªæ´žå¯Ÿã‚’å¾—ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚
rx7 2014/05/30
Hadoop

ãƒãƒ¼ãƒ‰ã‚¦ã‚§ã‚¢

ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸
ãƒªãƒ³ã‚¯
Apache Hadoop ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³å‘ã‘ã®ãƒªãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£æ—¥æœ¬èªžç‰ˆ -Dell ã‚³ãƒŸãƒ¥ãƒ‹ãƒ†ã‚£
TechCenterã‹ã‚‰ç§»è¡Œã•ã‚ŒãŸãƒ†ã‚¯ãƒ‹ã‚«ãƒ« ãƒªã‚½ãƒ¼ã‚¹ 2018å¹´8æœˆæ™‚ç‚¹ã§ã€ã‚¢ã‚¯ãƒ†ã‚£ãƒ–ãªTechCenterã®ã‚³ãƒ³ãƒ†ãƒ³ãƒ„ãŒç§»è¡Œã•ã‚Œã€Dell.com ã®Dellã‚µãƒãƒ¼ãƒˆã®ä¸€éƒ¨ã«ãªã‚Šã€ãƒ•ã‚©ãƒ¼ãƒ©ãƒ ãŒDellã‚³ãƒŸãƒ¥ãƒ‹ãƒ†ã‚£ã«ç§»è¡Œã•ã‚Œã¾ã—ãŸã€‚ æ¦‚è¦: 2018å¹´8æœˆæ™‚ç‚¹ã§ã€ã‚¢ã‚¯ãƒ†ã‚£ãƒ–ãªTechCenterã®ã‚³ãƒ³ãƒ†ãƒ³ãƒ„ãŒç§»è¡Œã•ã‚Œã€Dell.com ã®Dellã‚µãƒãƒ¼ãƒˆã®ä¸€éƒ¨ã«ãªã‚Šã€ãƒ•ã‚©ãƒ¼ãƒ©ãƒ ãŒDellã‚³ãƒŸãƒ¥ãƒ‹ãƒ†ã‚£ã«ç§»è¡Œã•ã‚Œã¾ã—ãŸã€‚
rx7 2013/04/12
Hadoop
ãƒªãƒ³ã‚¯
ç±³Facebookã€Apache Hadoopå‘ã‘ã‚¹ã‚±ã‚¸ãƒ¥ãƒ¼ãƒªãƒ³ã‚°ãƒ„ãƒ¼ãƒ«ã€ŒCoronaã€ã‚’ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã« | OSDN Magazine
ç±³Facebookã¯11æœˆ9æ—¥ã€Apache Hadoopã®ã‚¸ãƒ§ãƒ–ã‚¹ã‚±ã‚¸ãƒ¥ãƒ¼ãƒªãƒ³ã‚°ãƒ„ãƒ¼ãƒ«ã€ŒCoronaã€ã‚’å…¬é–‹ã—ãŸã€‚Hadoopã®MapReduceã§ã®ã‚¯ãƒ©ã‚¹ã‚¿ã®åŠ¹çŽ‡æ€§ã‚„æ‹¡å¼µæ€§ãªã©ã«ãŠã‘ã‚‹åˆ¶é™ã‚’å…‹æœã™ã‚‹ã¨ã—ã€ã€ŒMapReduceã®æ¬¡æœŸç‰ˆã€ã¨ç§°ã—ã¦ã„ã‚‹ã€‚ Facebookã§ã¯ä¸€æ—¥ã«ç´„500ãƒ†ãƒ©ãƒã‚¤ãƒˆã®æƒ…å ±ãŒç”Ÿæˆã•ã‚Œã€1000äººãŒã‹ã‚Šã§ã“ã‚Œã‚’åˆ†æžã—ã¦ã„ã‚‹ã¨ã„ã†ã€‚ã“ã‚Œã¾ã§Hadoopã§ã®åˆ†æžã‚¸ãƒ§ãƒ–ã«ã¯MapReduceãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã‚’åˆ©ç”¨ã—ã¦ããŸãŒã€MapReduceã®ã‚¸ãƒ§ãƒ–ã‚¹ã‚±ã‚¸ãƒ¥ãƒ¼ãƒ«ã®å•é¡Œã¨ã—ã¦ã€ã‚¯ãƒ©ã‚¹ã‚¿ã®åŠ¹çŽ‡æ€§ãŒä½Žãã€æ‹¡å¼µæ€§ãŒåˆ¶é™çš„ã§ã‚ã‚‹ç‚¹ãŒã‚ã£ãŸã€‚ã¾ãŸã€å°è¦æ¨¡ãªã‚¸ãƒ§ãƒ–ã®é…å»¶ã€ã‚·ã‚¹ãƒ†ãƒ ç¨¼åƒä¸ã«ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¢ãƒƒãƒ—ã‚°ãƒ¬ãƒ¼ãƒ‰ãŒã§ããªã„ãªã©ã®å•é¡Œã‚‚æ„Ÿã˜ã¦ã„ãŸã¨ã„ã†ã€‚Coronaã¯ã€MapReduceã®åˆ¶é™ã‚’è§£é™¤ã™ã‚‹ãŸã‚ã«FacebookãŒç¤¾å†…é–‹ç™ºã—ãŸHadoopç”¨ã‚¸ãƒ§ãƒ–ã‚¹ã‚±ã‚¸ãƒ¥ãƒ¼ãƒ«ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã¨
rx7 2012/11/25
Facebook

Hadoop
ãƒªãƒ³ã‚¯
æ—¥ã€…é€²åŒ–ã™ã‚‹Hadoopã€‚ã“ã‚Œã¾ã§ã®ãŠã•ã‚‰ã„ã¨æœ€è¿‘ã®å‹•å‘ï¼ˆå¾Œç·¨ï¼‰
Hadoopã¨ã¯ã©ã†ã„ã†ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§ã‚ã‚Šã€ã„ã¾ã©ã®ã‚ˆã†ãªçŠ¶æ³ã«ãªã£ã¦ã„ã‚‹ã®ã‹ã€‚NTTãƒ‡ãƒ¼ã‚¿ã®æ¿±é‡Žè³¢ä¸€æœ—æ°ãŒã€å…ˆæ—¥è¡Œã‚ã‚ŒãŸç¬¬2å›ž NHNãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã§è¡Œã‚ã‚ŒãŸã‚»ãƒƒã‚·ãƒ§ãƒ³ã€Œæ—¥ã€…é€²åŒ–ã™ã‚‹Hadoopã®ã€Žã„ã¾ã€ã€ã§åˆ†ã‹ã‚Šã‚„ã™ãè§£èª¬ã—ã¦ã„ã¾ã™ã€‚ ï¼ˆæœ¬è¨˜äº‹ã¯ã€Œæ—¥ã€…é€²åŒ–ã™ã‚‹Hadoopã€‚ã“ã‚Œã¾ã§ã®ãŠã•ã‚‰ã„ã¨æœ€è¿‘ã®å‹•å‘ï¼ˆå‰ç·¨ï¼‰ã€ã®ç¶šãã§ã™ï¼‰ Hadoopã®1.0ç³»ã¨2.0ç³» Hadoopã®é–‹ç™ºã¯ã‹ãªã‚Šæ´»ç™ºã«é€²ã‚“ã§ã„ã¾ã™ã€‚ Hadoopã§ã„ã¡ã°ã‚“åˆ†ã‹ã‚‰ãªã„ã¨ã„ã‚ã‚Œã‚‹ã®ãŒãƒãƒ¼ã‚¸ãƒ§ãƒ³ã§ã€ã“ã‚Œã¯ä»¥å‰ã‹ã‚‰Hadoopã«æŽ¥ã—ã¦ã„ã‚‹ç§ãŸã¡ã§ã‚‚ã‚ˆãåˆ†ã‹ã‚‰ãªã„ãã‚‰ã„ã§ã™ã€‚ Hadoopã®ãƒãƒ¼ã‚¸ãƒ§ãƒ³ã«ã¯å¤§ããäºŒç³»çµ±ã‚ã£ã¦ã€å°‘ã—å‰ã¾ã§0.20ç³»ã¨å‘¼ã°ã‚Œã¦ã„ãŸã‚‚ã®ã§ã€ã“ã‚ŒãŒç¾è¡Œã¯1.0ç³»ã¨å‘¼ã°ã‚Œã¦ã„ã¾ã™ã€‚ã‚‚ã†ã²ã¨ã¤ãŒ0.21ã€0.22ã€0.23ç³»ã¨å‘¼ã°ã‚Œã¦ã„ãŸã‚‚ã®ã€ã“ã‚ŒãŒã„ã¾2.0ç³»ã¨å‘¼ã°ã‚Œã¦ã„ã¾ã™ã€‚ å¯¾å¤–çš„ã«ã¯
rx7 2012/08/31
Hadoop
ãƒªãƒ³ã‚¯
æ—¥ã€…é€²åŒ–ã™ã‚‹Hadoopã€‚ã“ã‚Œã¾ã§ã®ãŠã•ã‚‰ã„ã¨æœ€è¿‘ã®å‹•å‘ï¼ˆå‰ç·¨ï¼‰
å¤§è¦æ¨¡ãªåˆ†æ•£å‡¦ç†ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã¨ã—ã¦HadoopãŒç™»å ´ã—ãŸã“ã¨ã«ã‚ˆã‚Šã€ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã®ãƒ–ãƒ¼ãƒ ã‚„ã€å¤§è¦æ¨¡ãªã‚½ãƒ¼ã‚·ãƒ£ãƒ«ã‚²ãƒ¼ãƒ ã§ã®ãƒã‚°è§£æžã«ã‚ˆã‚‹æ”¹å–„ã€ã‚³ãƒžãƒ¼ã‚¹ã‚µã‚¤ãƒˆã§ã®æ©Ÿæ¢°å¦ç¿’ã«ã‚ˆã‚‹ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ãªã©ã€å¤šãã®å¤‰åŒ–ãŒå¼•ãèµ·ã“ã•ã‚Œã¦ãã¾ã—ãŸã€‚ ãã—ã¦ãã®Hadoopè‡ªä½“ã‚‚ã€æ—¥ã€…é€²åŒ–ã—ç¶šã‘ã¦ã„ã¾ã™ã€‚ Hadoopã¨ã¯ã©ã†ã„ã†ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§ã‚ã‚Šã€ã„ã¾ã©ã®ã‚ˆã†ãªçŠ¶æ³ã«ãªã£ã¦ã„ã‚‹ã®ã‹ã€‚NTTãƒ‡ãƒ¼ã‚¿ã®æ¿±é‡Žè³¢ä¸€æœ—æ°ãŒã€å…ˆæ—¥è¡Œã‚ã‚ŒãŸç¬¬2å›ž NHNãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã§è¡Œã£ãŸã‚»ãƒƒã‚·ãƒ§ãƒ³ã€Œæ—¥ã€…é€²åŒ–ã™ã‚‹Hadoopã®ã€Žã„ã¾ã€ã€ã§åˆ†ã‹ã‚Šã‚„ã™ãè§£èª¬ã—ã¦ã„ã¾ã™ã€‚ ã“ã®è¨˜äº‹ã§ã¯ãã®ã‚»ãƒƒã‚·ãƒ§ãƒ³ã®å†…å®¹ã‚’ãƒ€ã‚¤ã‚¸ã‚§ã‚¹ãƒˆã§ç´¹ä»‹ã—ã¾ã—ã‚‡ã†ã€‚ æ—¥ã€…é€²åŒ–ã™ã‚‹Hadoopã®ã€Œã„ã¾ã€ NTTãƒ‡ãƒ¼ã‚¿ åŸºç›¤ã‚·ã‚¹ãƒ†ãƒ äº‹æ¥éƒ¨ æ¿±é‡Žè³¢ä¸€æœ—æ°ã€‚ NTTãƒ‡ãƒ¼ã‚¿ã¨ã„ã†ã¨ã“ã‚ã§ä»•äº‹ã‚’ã—ã¦ã„ã¾ã™ã€‚NTTãƒ‡ãƒ¼ã‚¿è‡ªä½“ã¯ã‚‚ã†5å¹´ãã‚‰ã„Hadoopã‚’ã‚„ã£ã¦ã¾ã—ã¦ã€ã
rx7 2012/08/31
Hadoop
ãƒªãƒ³ã‚¯
ä¸¦åˆ—åˆ†æ•£å‡¦ç†ã®å¸¸è˜ã‚’Hadoopãƒ•ã‚¡ãƒŸãƒªã‹ã‚‰å¦ã¶
Hadoopãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã¯3ã¤ã®ã€Œã‚µãƒ–ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã€ã§æ§‹æˆã•ã‚Œã¦ã„ã¾ã™ã€‚ Commonï¼šHadoopã®åŸºæœ¬æ©Ÿèƒ½FileSystemã€RPCã€Serializationã®ãƒ©ã‚¤ãƒ–ãƒ©ãƒª HDFSï¼šåˆ†æ•£ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚’ä»®æƒ³çš„ã«1ã¤ã«æ‰±ã†ãŸã‚ã®ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ MapReduceï¼šè†¨å¤§ãªãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆã‚’ã‚¯ãƒ©ã‚¹ã‚¿ä¸Šã§åˆ†æ•£å‡¦ç†ã™ã‚‹ãŸã‚ã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ ã“ã‚Œã‚‰ãŒã€ã€ŒHadoopãƒ•ã‚¡ãƒŸãƒªã€ã®æ ¸ã§ã‚ã‚Šã€ä¸¦åˆ—åˆ†æ•£å‡¦ç†æ©Ÿæ§‹ã‚’æ”¯ãˆã¦ã„ã¾ã™ã€‚ãã‚Œä»¥å¤–ã®ã€Œé–¢é€£ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã€ã¯2011å¹´12æœˆæ™‚ç‚¹ã§ã¯ä¸‹è¨˜ã®ã‚ˆã†ã«ãªã£ã¦ã„ã¾ã™ã€‚ Avroï¼šCommonã®æŒã¤æ©Ÿèƒ½ã‚’æ‹¡å¼µã—ãŸãƒ‡ãƒ¼ã‚¿ã‚·ãƒªã‚¢ãƒ©ã‚¤ã‚ºã‚·ã‚¹ãƒ†ãƒ Cassandraï¼šå˜ä¸€éšœå®³ç‚¹ã®ãªã„ã‚¹ã‚±ãƒ¼ãƒ©ãƒ–ãƒ«ãªãƒžãƒ«ãƒãƒžã‚¹ã‚¿ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ Chukwaï¼šå¤§è¦æ¨¡ãªåˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ ã§ã®ãƒ‡ãƒ¼ã‚¿åŽé›†ã‚·ã‚¹ãƒ†ãƒ HBaseï¼šå¤§è¦æ¨¡ãªæ§‹é€ åŒ–ãƒ‡ãƒ¼ã‚¿ã‚’ã‚µãƒãƒ¼ãƒˆã™ã‚‹ã€ã‚¹ã‚±ãƒ¼ãƒ©ãƒ–ãƒ«ãªåˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ Hive
rx7 2012/02/09
æ£®å…ˆç”Ÿã€æœ€è¿‘ã¯Hadoopã‚„ã£ã¦ã‚‹ã‚“ã™ã‹ã€‚

Hadoop
ãƒªãƒ³ã‚¯
Factual | Gratuitous Hadoop: Stress Testing on the Cheap with Hadoop Streaming and EC2
Return to Blog Gratuitous Hadoop: Stress Testing on the Cheap with Hadoop Streaming and EC2 Things have a funny way of working out this way. A couple features were pushed back from a previous release and some last minute improvements were thrown in, and suddenly we found ourselves dragging out a lot more fresh code in our release than usual. All this the night before one of our heavy API users was
rx7 2012/01/31
Hadoop
ãƒªãƒ³ã‚¯
ã‚½ãƒ•ãƒˆãƒãƒ³ã‚¯é€šä¿¡3ç¤¾å‘ã‘Hadoopç ”ä¿®è³‡æ–™
2010å¹´9æœˆ7æ—¥ã«å®Ÿæ–½ã„ãŸã—ã¾ã—ãŸã€ã‚½ãƒ•ãƒˆãƒãƒ³ã‚¯ãƒ¢ãƒã‚¤ãƒ«æ ªå¼ä¼šç¤¾ã€ã‚½ãƒ•ãƒˆãƒãƒ³ã‚¯ãƒ†ãƒ¬ã‚³ãƒ æ ªå¼ä¼šç¤¾ã€ã‚½ãƒ•ãƒˆãƒãƒ³ã‚¯BBæ ªå¼ä¼šç¤¾ã‚€ã‘Hadoopç ”ä¿®ã®è³‡æ–™ã‚’å…¬é–‹ã„ãŸã—ã¾ã™ã€‚ Read less
rx7 2011/07/26
Hadoop

è³‡æ–™
ãƒªãƒ³ã‚¯
Hadoopã‚’ç”¨ã„ãŸå¤§è¦æ¨¡ãƒã‚°è§£æž
this document is for #tokyowebmining held at 2011/04/10Read less
rx7 2011/04/10
Hadoop

è³‡æ–™
ãƒªãƒ³ã‚¯
ãã‚ãã‚Hadoopã«ã¤ã„ã¦ã²ã¨ã“ã¨è¨€ã£ã¦ãŠãã‹ - nokunoã®æ—¥è¨˜
ã‚‚ã†ã“ã®æ‰‹ã®è©±é¡Œã¯å‡ºå°½ãã—ãŸæ„ŸãŒã‚ã‚Šã¾ã™ãŒã€æœ€è¿‘Hadoopã«ã¤ã„ã¦è€ƒãˆã‚‹ã“ã¨ãŒå¤šã„ã®ã§ã€ã‚¨ãƒ³ãƒˆãƒªã«ã—ã¦ã¿ã¾ã™ã€‚ãªãŠã€ã“ã“ã§ã¯ãƒ™ãƒ¼ã‚·ãƒƒã‚¯ãªMapReduce+HDFSã®ã“ã¨ã‚’Hadoopã¨å‘¼ã¶ã“ã¨ã«ã—ã¾ã™ã€‚ Hadoopã¨ã¯Hadoopã¨ã¯è¨€ã‚ãšã¨çŸ¥ã‚ŒãŸGoogleã®MapReduce/GFSã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ã‚¯ãƒãƒ¼ãƒ³ã§ã™ã€‚MapReduceã§ã¯ãƒ—ãƒã‚°ãƒ©ãƒžã¯Mapã¨Reduceã¨ã„ã†2ã¤ã®é–¢æ•°ã‚’æ›¸ãã ã‘ã§ã€ä¸¦åˆ—åˆ†æ•£å‡¦ç†ã‚’ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ã“ã‚Œã¯(1) ãƒ‡ãƒ¼ã‚¿ã‚’å®Ÿéš›ã«æŒã¤ãƒžã‚·ãƒ³ã«ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’é…å¸ƒã™ã‚‹ (2) Mapã¨Reduceã‚’ã¤ãªãShuffleãƒ•ã‚§ãƒ¼ã‚ºã§ã‚ãƒ¼ã‚’ã‚°ãƒ«ãƒ¼ãƒ—åŒ–ã—ã¦ã‚½ãƒ¼ãƒˆã™ã‚‹ã€(3) éšœå®³æ™‚ã®ãƒ•ã‚§ãƒ¼ãƒ«ã‚ªãƒ¼ãƒãƒ¼ã‚„ãƒ¬ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã€ã¨ã„ã£ãŸå‡¦ç†ã‚’ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯å´ãŒå—ã‘æŒã¤ã“ã¨ã«ã‚ˆã£ã¦ã€ãƒ—ãƒã‚°ãƒ©ãƒžå´ã®è² æ‹…ã‚’æ¸›ã‚‰ã™ã‚‚ã®ã§ã™ã€‚GFSã«å¯¾å¿œã™ã‚‹HDFSã«ã¯ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ã‚¯ãƒ©ã‚¹ã‚¿ã«åˆ†æ•£ã—ã¦ä¿å˜
rx7 2011/01/05
Hadoop
ãƒªãƒ³ã‚¯
Hadoopã‚«ã‚¦ãƒ³ãƒˆãƒ€ã‚¦ãƒ³ï¼ˆYet Another Advent Calendar HAHAHA)
ã€ŒHadoop Advent Calendar ã¯ãªã„ã®ã‹ã€ @shiumachi ãŒä½•æ°—ãªãã¤ã¶ã‚„ã„ãŸä¸€è¨€ã« @okachimachiorz1 ã•ã‚“ãŒåå¿œã€‚ ã©ã“ãŒ Advent Calendar ãªã‚“ã ã‚ˆã¨ã„ã†ãƒ„ãƒƒã‚³ãƒŸã‚‚ã‚ã‚‹ä¸ã€ãƒŽãƒªã ã‘ã§å§‹ã¾ã£ãŸã“ã®ä¼ç”»ã«æžœãŸã—ã¦å‚åŠ è€…ã¯é›†ã¾ã‚‹ã®ã‹ï¼ï¼Ÿ ãƒ«ãƒ¼ãƒ« ãƒ»tweet ã« hadoop ã«é–¢ã™ã‚‹ tips ã‚’æ›¸ã ç¶šãã‚’èªã‚€
rx7 2011/01/02
Hadoop
ãƒªãƒ³ã‚¯
NTTãƒ‡ãƒ¼ã‚¿ã®Hadoopå ±å‘Šæ›¸ãŒã™ã”ã‹ã£ãŸ - ç§‘å¦ã¨éžç§‘å¦ã®è¿·å®®
æ¥ç•Œãƒˆãƒƒãƒ— ã®ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚º Hadoop ä¼æ¥ Cloudera ã«å…¥ç¤¾ã—ã¾ã—ãŸ http://www.cloudera.co.jp/ ä»Šå¹´ã®6æœˆã«ã€ã€Œå¹³æˆï¼’ï¼‘å¹´åº¦ ç”£å¦é€£æºã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢å·¥å¦å®Ÿè·µäº‹æ¥å ±å‘Šæ›¸ã€ã¨ã„ã†ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆç¾¤ãŒçµŒç”£çœã‹ã‚‰å…¬è¡¨ã•ã‚Œã¾ã—ãŸã€‚ ãã®ã†ã¡ã®ä¸€ã¤ã«ã€NTTãƒ‡ãƒ¼ã‚¿ã«å§”è¨—ã•ã‚ŒãŸHadoopã«é–¢ã™ã‚‹å®Ÿè¨¼å®Ÿé¨“ã®å ±å‘Šæ›¸ãŒã‚ã‚Šã¾ã—ãŸã®ã§ã€ä»Šæ›´ãªãŒã‚‰èªã‚“ã§ã¿ã‚‹ã“ã¨ã«ã—ã¾ã—ãŸã€‚ Hadoopç•Œéšˆã®äººã¯ã‚‚ã†ã¿ã‚“ãªã¨ã£ãã«èªã‚“ã§ã‚‹ã®ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ã‘ã©ã€‚ http://www.meti.go.jp/policy/mono_info_service/joho/downloadfiles/2010software_research/clou_dist_software.pdf ã€Œé«˜ä¿¡é ¼ã‚¯ãƒ©ã‚¦ãƒ‰å®Ÿç¾ç”¨ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢é–‹ç™ºï¼ˆåˆ†æ•£åˆ¶å¾¡å‡¦ç†æŠ€è¡“ç‰ã«ä¿‚ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼é«˜ä¿¡é ¼åŒ–ã«å‘ã‘ãŸå®Ÿè¨¼äº‹æ¥ï¼‰ã€ã¨ã„ã†
rx7 2010/09/29
Hadoop

è³‡æ–™
ãƒªãƒ³ã‚¯
LinkedInã®ãƒ‡ãƒ¼ã‚¿åŸºç›¤
Spring Bootã«ã‚ˆã‚‹APIãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰æ§‹ç¯‰å®Ÿè·µã‚¬ã‚¤ãƒ‰ ç¬¬2ç‰ˆ ä½•åƒäººã‚‚ã®é–‹ç™ºè€…ãŒã€InfoQã®ãƒŸãƒ‹ãƒ–ãƒƒã‚¯ã€ŒPractical Guide to Building an API Back End with Spring Bootã€ã‹ã‚‰ã€Spring Bootã‚’ä½¿ã£ãŸREST APIæ§‹ç¯‰ã®åŸºç¤Žã‚’å¦ã‚“ã ã€‚ã“ã®æœ¬ã§ã¯ã€å‡ºç‰ˆæ™‚ã«æ–°ã—ããƒªãƒªãƒ¼ã‚¹ã•ã‚ŒãŸãƒãƒ¼ã‚¸ãƒ§ãƒ³ã§ã‚ã‚‹ Spring Boot 2 ã‚’ä½¿ç”¨ã—ã¦ã„ã‚‹ã€‚ã—ã‹ã—ã€Spring Boot3ãŒæœ€è¿‘ãƒªãƒªãƒ¼ã‚¹ã•ã‚Œã€é‡è¦ãªå¤‰...
rx7 2010/08/25
Hadoop
ãƒªãƒ³ã‚¯
ä¼æ¥ã§ä½¿ã‚ã‚Œã‚‹Hadoop
Copyright Â© 2004-2024 Impress Corporation. An Impress Group Company. All rights reserved.
rx7 2010/06/21
Hadoop

ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°
ãƒªãƒ³ã‚¯
Hadoop Streaming ã§å¤–éƒ¨ãƒ•ã‚¡ã‚¤ãƒ«ã‚’æ‰±ã†æ–¹æ³•ã®ã¾ã¨ã‚ - (ï¾Ÿâˆ€ï¾Ÿ)oå½¡ sasata299's blog
2010å¹´05æœˆ06æ—¥09:21 Hadoop Hadoop Streaming ã§å¤–éƒ¨ãƒ•ã‚¡ã‚¤ãƒ«ã‚’æ‰±ã†æ–¹æ³•ã®ã¾ã¨ã‚ Hadoop Streaming ã§ã®å¤–éƒ¨ãƒ•ã‚¡ã‚¤ãƒ«ã®æ‰±ã„ã‚‚ã ã„ã¶å›ºã¾ã£ã¦ãã¾ã—ãŸã€‚ç™ºè¡¨è³‡æ–™ã®ã‚¹ãƒ©ã‚¤ãƒ‰ã§ã¯ã“ã®è¾ºã®è©±ã‚’æ›¸ã„ãŸã“ã¨ãŒã‚ã‚‹ã‚“ã§ã™ãŒã€ãƒ–ãƒã‚°ã«ã¯æ›¸ã„ã¦ãªã‹ã£ãŸã®ã§ä¸€åº¦ãã£ã¡ã‚Šã¾ã¨ã‚ã¦ãŠã“ã†ã‹ãªãƒ¼ã£ã¨ã€‚ã¨ã„ã†ã‚ã‘ã§ä»Šå›žã¯ Hadoop Streaming ã§ã®å¤–éƒ¨ãƒ•ã‚¡ã‚¤ãƒ«ã®èªã¿è¾¼ã¿ã«ã¤ã„ã¦ã¾ã¨ã‚ã¾ã™ã‚ˆï¼(*ï¾ŸÐ”ï¾Ÿ)=3 ï¾‘ï¾Šï½° ãã‚‚ãã‚‚å¤–éƒ¨ãƒ•ã‚¡ã‚¤ãƒ«ã®èªã¿è¾¼ã¿ã¨è¨€ã£ã¦ã‚‚ã€ã“ã®äºŒã¤ã®ãƒ‘ã‚¿ãƒ¼ãƒ³ãŒã‚ã‚Šã¾ã™ã€‚ 1) å¤–éƒ¨ãƒ•ã‚¡ã‚¤ãƒ«ãŒ master ä¸Šã«ã‚ã‚‹ï¼ˆã¤ã¾ã‚Šãƒãƒ¼ã‚«ãƒ«ãƒ‡ã‚£ã‚¹ã‚¯ã«ã‚ã‚‹ï¼‰å ´åˆ 2) å¤–éƒ¨ãƒ•ã‚¡ã‚¤ãƒ«ãŒåˆ¥ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ï¼ˆS3 ã ã£ãŸã‚Š HDFS ã ã£ãŸã‚Šï¼‰ã«ã‚ã‚‹å ´åˆ å¤–éƒ¨ãƒ•ã‚¡ã‚¤ãƒ«ãŒ master ä¸Šã«ã‚ã‚‹å ´åˆ ã¾ãšã€ã“ã®å ´åˆã¯ã¨ã¦ã‚‚ç°¡å˜ã§ã™ã€‚ä¾‹ãˆã° hoge.txt ã¨
rx7 2010/05/06
Hadoop
ãƒªãƒ³ã‚¯
ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰ã®ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã€ãŸã£ãŸ5ä¸‡å††ï¼šæ—¥çµŒãƒ“ã‚¸ãƒã‚¹ã‚ªãƒ³ãƒ©ã‚¤ãƒ³
æ°—ã«ãªã‚‹è¨˜äº‹ã‚’ã‚¹ã‚¯ãƒ©ãƒƒãƒ—ã§ãã¾ã™ã€‚ä¿å˜ã—ãŸè¨˜äº‹ã¯ã€ãƒžã‚¤ãƒšãƒ¼ã‚¸ã§ã‚¹ãƒžãƒ›ã€ã‚¿ãƒ–ãƒ¬ãƒƒãƒˆã‹ã‚‰ã§ã‚‚ã”ç¢ºèªé ‚ã‘ã¾ã™ã€‚â€»ä¼šå“¡é™å®š ç„¡æ–™ä¼šå“¡ç™»éŒ² è©³ç´° ï½œ ãƒã‚°ã‚¤ãƒ³ æœˆé–“ãƒ¦ãƒ‹ãƒ¼ã‚¯ãƒ¦ãƒ¼ã‚¶ãƒ¼æ•°ã€884ä¸‡äººã€æœˆé–“ãƒšãƒ¼ã‚¸ãƒ“ãƒ¥ãƒ¼æ•°ã€4å„„6000ä¸‡ï¼ˆ2010å¹´3æœˆï¼‰ã‚’èª‡ã‚‹å›½å†…ãƒŠãƒ³ãƒãƒ¼ãƒ¯ãƒ³ã®æ–™ç†ãƒ¬ã‚·ãƒ”ã®æŠ•ç¨¿ãƒ»æ¤œç´¢ã‚µã‚¤ãƒˆã€Œã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰ã€ã€‚ æ—¥å¸¸çš„ã«æ–™ç†ã‚’ã™ã‚‹äººã¯ã‚‚ã¡ã‚ã‚“ã®ã“ã¨ã€ãŸã¾ã«ã—ã‹åŒ…ä¸ã‚’æ¡ã‚‰ãªã„äººã§ã‚‚ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰ã®ã‚¦ã‚§ãƒ–ã‚µã‚¤ãƒˆã‚’ä¸€åº¦ã¯è¨ªã‚ŒãŸã“ã¨ãŒã‚ã‚‹ã®ã§ã¯ãªã„ã‹ã€‚ 2ã¡ã‚ƒã‚“ãã‚‹ã‚„Twitterã‚’å‡Œé§•ã™ã‚‹ ãã‚Œãã‚‰ã„ã€ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰ã¯ãƒ¬ã‚·ãƒ”ã®æŠ•ç¨¿ãƒ»æ¤œç´¢ã‚µã‚¤ãƒˆã¨ã—ã¦ä¸å‹•ã®åœ°ä½ã‚’ç¯‰ã„ã¦ã„ã‚‹ã‚ˆã†ã«æ€ãˆã‚‹ã€‚ãªã«ã—ã‚ã€æ¯ã®æ—¥ã¨ã‚«ãƒŸã‚µãƒ³ã®èª•ç”Ÿæ—¥ãã‚‰ã„ã—ã‹ã€æ–™ç†ã‚’ã—ãªã„ç†è€…ã§ã•ãˆã‚‚ã€ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰ã¯ä½•åº¦ã‹ã®ãžãã€ãŠä¸–è©±ã«ãªã£ãŸã“ã¨ãŒã‚ã‚‹ãã‚‰ã„ã ã€‚ ãƒšãƒ¼ã‚¸ãƒ“ãƒ¥ãƒ¼æ•°ã®æ¯”è¼ƒã§ã„ãˆã°ã€ã“ã®4å„„6000ä¸‡ã¨ã„ã†æ•°å—ã¯ã€2ã¡ã‚ƒã‚“ãã‚‹ã‚„ä»Šæµè¡Œã‚Šã®T
rx7 2010/04/21
CloudComputing

Hadoop

AmazonEC2

Ruby
ãƒªãƒ³ã‚¯
1 2 3 æ¬¡ã®ãƒšãƒ¼ã‚¸