[B! hadoop] yamakazã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

yamakaz id:yamakaz

hadoopã«é–¢ã™ã‚‹yamakazã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (4)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

ãƒžã‚¤ã‚¯ãƒã‚½ãƒ•ãƒˆãŒHadoopãƒ™ãƒ¼ã‚¹ã®ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã‚’å…¬é–‹
ãƒžã‚¤ã‚¯ãƒã‚½ãƒ•ãƒˆãŒHadoopãƒ™ãƒ¼ã‚¹ã®ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã‚’å…¬é–‹ï¼šä½¿ã„æ…£ã‚ŒãŸã‚¤ãƒ³ã‚¿ãƒ¼ãƒ•ã‚§ã‚¤ã‚¹ã§ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã«ã‚¢ã‚¯ã‚»ã‚¹ ç±³ãƒžã‚¤ã‚¯ãƒã‚½ãƒ•ãƒˆã¯ã€Apache Hadoopãƒ™ãƒ¼ã‚¹ã®ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã®æ–°ã—ã„ãƒ—ãƒ¬ãƒ“ãƒ¥ãƒ¼ã‚’å…¬é–‹ã—ãŸã€‚åŒç¤¾ã®Webã‚µã‚¤ãƒˆã‚’é€šã˜ã€Windows Azureå‘ã‘ã®ã€ŒWindows Azure HDInsight Serviceã€ã¨ã€Windows Serverå‘ã‘ã®ã€ŒMicrosoft HDInsight Server for Windowsã€ï¼ˆCTPç‰ˆï¼‰ã‚’2012å¹´10æœˆ24æ—¥ã‹ã‚‰æä¾›é–‹å§‹ã—ã¦ã„ã‚‹ï¼ˆé–¢é€£ãƒªãƒ³ã‚¯ï¼‰ã€‚ãƒãƒ¥ãƒ¼ãƒˆãƒªã‚¢ãƒ«ã‚‚åŒç¤¾Webã‚µã‚¤ãƒˆä¸Šã§å…¬é–‹ã•ã‚Œã¦ãŠã‚Šã€.NETã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‹ã‚‰ã®æŽ¥ç¶šç”¨SDKã‚‚ç”¨æ„ã•ã‚Œã¦ã„ã‚‹ã€‚ æ–°ã—ã„ãƒ—ãƒ¬ãƒ“ãƒ¥ãƒ¼ã¯ã€ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚ºãƒ¬ãƒ™ãƒ«ã®Apache Hadoopåˆ©ç”¨ä¿ƒé€²ã¨ã€Hadoopãƒ™ãƒ¼ã‚¹ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã®å°Žå…¥ã‚·ãƒ³ãƒ—ãƒ«åŒ–ã‚’ç›®æŒ‡ã—ã¦
yamakaz 2012/11/05
Hadoop
ãƒªãƒ³ã‚¯
Apache Hadoop - Wikipedia
Apache Hadoopã¯å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã®åˆ†æ•£å‡¦ç†ã‚’æ”¯ãˆã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã§ã‚ã‚Šã€Javaã§æ›¸ã‹ã‚Œã¦ã„ã‚‹ã€‚Hadoopã¯ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ãŒæ•°åƒãƒŽãƒ¼ãƒ‰ãŠã‚ˆã³ãƒšã‚¿ãƒã‚¤ãƒˆç´šã®ãƒ‡ãƒ¼ã‚¿ã‚’å‡¦ç†ã™ã‚‹ã“ã¨ã‚’å¯èƒ½ã¨ã—ã¦ã„ã‚‹ã€‚Hadoopã¯Googleã®MapReduceãŠã‚ˆã³Google File System(GFS)è«–æ–‡ã«è§¦ç™ºã•ã‚ŒãŸã‚‚ã®ã§ã‚ã‚‹ã€‚ Hadoopã¯Apacheã®ãƒˆãƒƒãƒ—ãƒ¬ãƒ™ãƒ«ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã®1ã¤ã§ã‚ã‚Šã€ä¸–ç•Œè¦æ¨¡ã®é–‹ç™ºè²¢çŒ®è€…ã‚³ãƒŸãƒ¥ãƒ‹ãƒ†ã‚£ã«ã‚ˆã£ã¦é–‹ç™ºã•ã‚Œã€ä½¿ç”¨ã•ã‚Œã¦ã„ã‚‹ã€‚[2] Hadoopã¯ã€ä»¥ä¸‹ã®4ã¤ã®ãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«ã«ã‚ˆã£ã¦æ§‹æˆã•ã‚Œã¦ã„ã‚‹ã€‚ Hadoop Common: ä»–ã®ãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«ã‹ã‚‰å…±é€šã—ã¦åˆ©ç”¨ã•ã‚Œã‚‹ãƒ©ã‚¤ãƒ–ãƒ©ãƒªç¾¤ã€‚ Hadoop Distributed File System (HDFS): Hadoopç‹¬è‡ªã®åˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã€‚ Hadoop YARN: Hado
yamakaz 2012/01/14
Hadoop
ãƒªãƒ³ã‚¯
NTTãƒ‡ãƒ¼ã‚¿ã®Hadoopå ±å‘Šæ›¸ãŒã™ã”ã‹ã£ãŸ - ç§‘å¦ã¨éžç§‘å¦ã®è¿·å®®
æ¥ç•Œãƒˆãƒƒãƒ— ã®ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚º Hadoop ä¼æ¥ Cloudera ã«å…¥ç¤¾ã—ã¾ã—ãŸ http://www.cloudera.co.jp/ ä»Šå¹´ã®6æœˆã«ã€ã€Œå¹³æˆï¼’ï¼‘å¹´åº¦ ç”£å¦é€£æºã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢å·¥å¦å®Ÿè·µäº‹æ¥å ±å‘Šæ›¸ã€ã¨ã„ã†ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆç¾¤ãŒçµŒç”£çœã‹ã‚‰å…¬è¡¨ã•ã‚Œã¾ã—ãŸã€‚ ãã®ã†ã¡ã®ä¸€ã¤ã«ã€NTTãƒ‡ãƒ¼ã‚¿ã«å§”è¨—ã•ã‚ŒãŸHadoopã«é–¢ã™ã‚‹å®Ÿè¨¼å®Ÿé¨“ã®å ±å‘Šæ›¸ãŒã‚ã‚Šã¾ã—ãŸã®ã§ã€ä»Šæ›´ãªãŒã‚‰èªã‚“ã§ã¿ã‚‹ã“ã¨ã«ã—ã¾ã—ãŸã€‚ Hadoopç•Œéšˆã®äººã¯ã‚‚ã†ã¿ã‚“ãªã¨ã£ãã«èªã‚“ã§ã‚‹ã®ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ã‘ã©ã€‚ http://www.meti.go.jp/policy/mono_info_service/joho/downloadfiles/2010software_research/clou_dist_software.pdf ã€Œé«˜ä¿¡é ¼ã‚¯ãƒ©ã‚¦ãƒ‰å®Ÿç¾ç”¨ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢é–‹ç™ºï¼ˆåˆ†æ•£åˆ¶å¾¡å‡¦ç†æŠ€è¡“ç‰ã«ä¿‚ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼é«˜ä¿¡é ¼åŒ–ã«å‘ã‘ãŸå®Ÿè¨¼äº‹æ¥ï¼‰ã€ã¨ã„ã†
yamakaz 2010/09/29
hadoop

ã‚¯ãƒ©ã‚¦ãƒ‰
ãƒªãƒ³ã‚¯
ãã®åˆ†æžã€Hadoopãªã‚‰é€Ÿãå®‰ãã§ãã¾ã™
ãƒ“ã‚¸ãƒã‚¹ãƒ‡ãƒ¼ã‚¿ã‚’åˆ†æžã™ã‚‹ãƒ“ã‚¸ãƒã‚¹ã‚¤ãƒ³ãƒ†ãƒªã‚¸ã‚§ãƒ³ã‚¹ï¼ˆBIï¼‰åˆ†é‡Žã®æ–°ãŸãªãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã¨ã—ã¦æ³¨ç›®ã•ã‚Œã¦ã„ã‚‹Hadoopã€‚Hadoopã§ã¯ã€ã©ã®ã‚ˆã†ãªãƒ‡ãƒ¼ã‚¿åˆ†æžãŒå¯èƒ½ãªã®ã§ã—ã‚‡ã†ã‹ï¼Ÿ ç¾åœ¨ã€Hadoopãƒ“ã‚¸ãƒã‚¹ã®ç‰½å¼•å½¹ã§ã‚ã‚‹Clouderaã®Jeff Hammerbracheræ°ãŒã€Hadoopã§ãƒ‡ãƒ¼ã‚¿åˆ†æžãŒå¯èƒ½ãªãƒ“ã‚¸ãƒã‚¹ä¸Šã®èª²é¡Œã‚’ç¤ºã—ãŸã€Œ10 Common Hadoop-able probl emsã€ï¼ˆHadoopåŒ–å¯èƒ½ãª10ã®ä¸€èˆ¬çš„èª²é¡Œï¼‰ã¨é¡Œã—ãŸãƒ—ãƒ¬ã‚¼ãƒ³ãƒ†ãƒ¼ã‚·ãƒ§ãƒ³ã‚’å…¬é–‹ã—ã¦ã„ã¾ã™ã€‚ Hadoopã«ã¨ã£ã¦å¾—æ„ãªå‡¦ç†ã¨ã¯ã€è¤‡é›‘ã§è¤‡æ•°ã®ãƒ‡ãƒ¼ã‚¿ã‚½ãƒ¼ã‚¹ã‹ã‚‰ãªã‚‹å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã®åˆ†æžã§ã‚ã‚Šã€ãã‚Œã‚’ãƒãƒƒãƒå‡¦ç†ã®ä¸¦åˆ—å®Ÿè¡Œã«ã‚ˆã£ã¦å®Ÿç¾ã™ã‚‹ã“ã¨ã§ã™ã€‚ å¾“æ¥ã¯ã€ãƒ‡ãƒ¼ã‚¿ãŒã‚ã¾ã‚Šã«è¤‡é›‘ã ã£ãŸã‚Šè†¨å¤§ã ã£ãŸã‚ã«ã€è¨ˆç®—æ™‚é–“ã‚„ã‚³ã‚¹ãƒˆãªã©ã®ç†ç”±ã§å®Ÿç¾ãŒé›£ã—ã‹ã£ãŸå‡¦ç†ã§ã‚‚ã€Hadoopã«ã‚ˆã‚‹ä½Žã‚³ã‚¹ãƒˆåŒ–ã€è¨ˆç®—æ™‚é–“ã®çŸç¸®ã€é«˜ã„æŸ”è»Ÿæ€§ãªã©
yamakaz 2010/08/27
hadoop
ãƒªãƒ³ã‚¯
1