[B! mapreduce] daisukebeã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

daisukebe id:daisukebe

mapreduceã«é–¢ã™ã‚‹daisukebeã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (6)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Name node is in safe modeã¨å‡ºã¦ããŸã‚‰â€¦ - photogenic blue note
Hadoopã§ã€HDFSã«ã‚ã‚‹ãƒ•ã‚¡ã‚¤ãƒ«ã‚„ãƒ‡ã‚£ãƒ¬ã‚¯ãƒˆãƒªã‚’å‰Šé™¤ã—ã‚ˆã†ã¨ã™ã‚‹ã¨ã€ Name node is in safe mode. ã¨ã„ã†ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ãŒå‡ºã¦ã€å‰Šé™¤ã§ãã¾ã›ã‚“ã§ã—ãŸã€‚ã¨ã‚Šã‚ãˆãšã€ bin/hadoop dfsadmin -safemode leave ã¨ã‚³ãƒžãƒ³ãƒ‰ãƒ©ã‚¤ãƒ³ã§å…¥åŠ›ã™ã‚‹ã¨ã€ã‚»ãƒ¼ãƒ•ãƒ¢ãƒ¼ãƒ‰ã‚’é›¢ã‚Œã‚‹ã®ã§ã€å‰Šé™¤ã§ãã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã™ã€‚ãŸã ã€å¤§äº‹ãªãƒ•ã‚¡ã‚¤ãƒ«ã‚„ãƒ‡ã‚£ãƒ¬ã‚¯ãƒˆãƒªã‚’å‰Šé™¤ã—ãªã„ã‚ˆã†æ°—ã‚’ã¤ã‘ã¦ãã ã•ã„ã€‚ ãƒã‚¿å…ƒ : http://gcgmh.java eye.com/blog/322354
daisukebe 2012/09/15
"hadoop dfsadmin -safemode leave"

hadoop

MapReduce
ãƒªãƒ³ã‚¯
Amazon Elastic MapReduce å…¥é–€ã‚¬ã‚¤ãƒ‰ API Version 2009-03-31
Amazon Elastic MapReduce å…¥é–€ã‚¬ã‚¤ãƒ‰ API Version 2009-03-31 Amazon Elastic MapReduce: å…¥é–€ã‚¬ã‚¤ãƒ‰ Copyright Â© 2011 Amazon Web Services LLC or its affiliates.All rights reserved. Amazon Elastic MapReduce å…¥é–€ã‚¬ã‚¤ãƒ‰ Table of Contents Amazon Elastic MapReduce å…¥é–€ ....................................................................................................................... 1 Elastic MapReduceã¸ã®ã‚µã‚¤ãƒ³ã‚¢ãƒƒãƒ— .........
daisukebe 2012/01/14
amazon

mapreduce

hadoop
ãƒªãƒ³ã‚¯
Mapreduce2.0 - æ€¥ãŒã°å›žã‚Œã€é¸ã¶ãªã‚‰è¿‘é“
æ¬¡ä¸–ä»£Hadoopã®é–‹ç™ºãŒé€²ã‚“ã§ã„ã‚‹ã€‚ç¾çŠ¶ã®æŽ¨ç§»ã§ã¯ã€å°‘ãªãã¨ã‚‚åˆ†æ•£ã‚¯ãƒ©ã‚¦ãƒ‰ã§ã®ã€ŒOSSã‚¤ãƒ³ãƒ•ãƒ©ã€ã¨ã—ã¦ã¯HadoopãŒæœ€æœ‰åŠ›å€™è£œã§ã‚ã‚‹ã“ã¨ã¯é–“é•ã„ãªã„ã€‚ã‚¯ãƒ©ã‚¦ãƒ‰ä¸Šã§ã®åˆ†æ•£å‡¦ç†åŸºç›¤ã§ã®æŠ€è¡“ç«¶äº‰ã§ã¯Googleã‚„AmazonãŒç›¸å½“æŠœãã‚“ã§ã„ã‚‹ç¾åœ¨ã€ãã‚Œã«å¯¾æŠ—ã—ã†ã‚‹å¯èƒ½æ€§ãŒã‚ã‚‹OSSã¯Hadoopã®æ½®æµã®å»¶é•·ç·šä¸Šã«ã—ã‹è€ƒãˆã‚‰ã‚Œãªã„ã€‚ãã®å½¢ã¨ã—ã¦Hadoop-MapReduce2.0ãŒã‚ã‚‹ã‚ˆã†ã«è¦‹ãˆã‚‹ã€‚ç¾åœ¨ã®çŠ¶æ…‹ã§è‡ªåˆ†ãªã‚Šã®æ¬¡ä¸–ä»£Hadoopã®ç†è§£ã‚’ã¾ã¨ã‚ã¦ãŠãã€‚åŸºæœ¬çš„ã«å…¨éƒ¨ã¯è¦‹åˆ‡ã‚Œã¦ã„ãªã„ã®ã§ã€ãã®ã‚ãŸã‚Šã¯ã‚ã—ã‹ã‚‰ãšã€‚åŸºæœ¬çš„ã«æ¬¡ä¸–ä»£Hadoopã®ä»•çµ„ã¿ã¯å¤§ããäºŒã¤ã®è¦ç´ ã‹ã‚‰ãªã‚‹ ç¾åœ¨ã®ã¨ã“ã‚ã®æŸ±ã¯HDFSã¨Mapreduce2.0ã®äºŒã¤ã ã€‚ ã¾ãšMapReduceã€‚ã“ã‚Œã¯å¾“æ¥ã®ã€ŒMapReduceã€ã¨ã„ã†ã‚‚ã®ã‹ã‚‰ã¯ã»ã©é ã„ã€‚ã‚€ã—ã‚ã€Œä»»æ„ã€ã®åˆ†æ•£å‡¦ç†å®Ÿè¡Œãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã«ãŸã„ã—ã¦ã€é©åˆ‡ãªãƒªã‚½ãƒ¼ã‚¹ã‚’
daisukebe 2011/10/23
è©³ã—ã„

hadoop

mapreduce
ãƒªãƒ³ã‚¯
Hadoop Conference Japan 2011 Fallã«è¡Œã£ã¦ããŸ - seikoudoku2000ã®ãƒ–ãƒã‚°
Hadoop Conference Japan 2011 Fallã«è¡Œã£ã¦ããŸã€‚ eventbrite http://hadoop-conference-japan-2011-fall.eventbrite.com/ ãƒªã‚¯ãƒ«ãƒ¼ãƒˆã®MITä½œæˆã®QAã‚„ã‚‰è¬›æ¼”è³‡æ–™ã®ã‚µã‚¤ãƒˆ (ç¾çŠ¶ã€ä¸€éƒ¨ã®è³‡æ–™ãŒã‚¢ãƒƒãƒ—ã•ã‚Œã¦ã„ã‚‹ã®ã¿ã€‚) http://mit.recruit.co.jp/hadoop/conference2011fall/info/archive.html åˆå‰ä¸ã®ã‚»ãƒƒã‚·ãƒ§ãƒ³ã«é–¢ã—ã¦ã¯ã€ITProã®ãƒ‹ãƒ¥ãƒ¼ã‚¹ã«ãªã£ã¦ãŸã‚Šã€ä»–ã®ãƒ–ãƒã‚°ã§ã‚‚æ›¸ã‹ã‚Œã¦ã„ãŸã‚Šã€æŠ€è¡“çš„ã«ã¯ã“ã‚Œã¨ã„ã£ãŸè©±ãŒç„¡ã‹ã£ãŸã‚Šã ã£ãŸã®ã§ç•¥ã€‚ åˆå¾Œã¯ãšã£ã¨Commyunity Trackã®ã‚»ãƒƒã‚·ãƒ§ãƒ³ã‚’èžã„ã¦ã„ãŸã®ã§ã€ãã®ã¾ã¨ã‚ã€‚ Elastic MapReduce: Amazon Web ServiceãŒæä¾›ã™ã‚‹hadoopã‚µãƒ¼ãƒ“ã‚¹ã€€ã€€@sh
daisukebe 2011/10/02
hadoop

amazon

mapreduce
ãƒªãƒ³ã‚¯
Hadoop MapReduce ãƒ‡ã‚¶ã‚¤ãƒ³ãƒ‘ã‚¿ãƒ¼ãƒ³ - æ€¥ãŒã°å›žã‚Œã€é¸ã¶ãªã‚‰è¿‘é“
Amazon CAPTCHA Hadoop MapReduce ãƒ‡ã‚¶ã‚¤ãƒ³ãƒ‘ã‚¿ãƒ¼ãƒ³ ã®ç›£ä¿®ã¨ã„ã†äº‹ã‚’ã•ã›ãŸã‚‚ã‚‰ã£ãŸã®ã§ ãã®å†…å®¹ã¨ã‹ã«ã¤ã„ã¦ã§ã™ãã€‚ ã¾ãšã€å…ƒã®æœ¬ã¯ã“ã‚Œã§ã™ã€‚ http://www.amazon.co.jp/Data-Intensive-Processing-MapReduce-Synthesis-Techno logies/dp/1608453421/ref=sr_1_1?s=english-books&ie=UTF8&qid=1316817977&sr=1-1 è‘—è€…ã®Jimmy Linã¯ ç¾åœ¨Clouderaã«æ‰€å±žã¨èžã„ã¦ã„ã¾ã™ã€‚ ï¼ˆãŒã€å‰²ã¨æ‰€å±žä¸æ˜Žãªæ„Ÿã˜ã¿ãŸã„ã§ã™ã€‚ï¼‰ ç¾å®Ÿã«Clouderaã®ãƒˆãƒ¬ãƒ¼ãƒ‹ãƒ³ã‚°ã®å†…å®¹ã¯ ç‰¹ã«ã‚¢ãƒ—ãƒªã‚µã‚¤ãƒ‰ã®ã€ã‹ãªã‚Šã®éƒ¨åˆ†ã‚’ ã“ã®æœ¬ã®å†…å®¹ã«æº–æ‹ ã—ã¦ã„ã¾ã—ãŸã€‚ ãªã®ã§ã€Hadoopã‚’åˆ©ç”¨ã™ã‚‹éš›ã«ã¯ ã»ã¼å¿…é ˆã®æ›¸ç±ã¨è¦‹ã¦ã„ã„ã¨æ€ã„ã¾ã™ã€‚ ã“ã®æœ¬ã®ç‰¹é•·ã¨
daisukebe 2011/09/24
ã€Œã¨ã‚Šã‚ãˆãšãƒ¯ãƒ¼ãƒ‰ã‚«ã‚¦ãƒ³ãƒˆã‚’ã‚„ã£ã¦ã¿ã¾ã—ãŸã¨ã„ã†ãƒ¬ãƒ™ãƒ«ã®äººã«ã¯ãŠå‹§ã‚ã§ã™ã€‚ã•ã¦æ¬¡ã¯ã©ã†ã™ã‚‹ã‹ã„ãï¼Ÿã¨ã„ã†ã¨ã“ã‚ã‹ã¨ã€‚ã€

hadoop

mapreduce
ãƒªãƒ³ã‚¯
Pig, Hiveãªã©8ç¨®é¡žã®MapReduceè¨€èªžã«ã¤ã„ã¦ã®æ¯”è¼ƒ - nokunoã®æ—¥è¨˜
ä»¥ä¸‹ã®è¨˜äº‹ã§ã¯Pig, Hiveãªã©8ç¨®é¡žã®è¨€èªžã§MapReduceã®ä¸€ç•ªå˜ç´”ãªä¾‹ã€WordCountã‚’è¨˜è¿°ã—ãŸå ´åˆã®ã‚¹ã‚¯ãƒªãƒ—ãƒˆã®æ¯”è¼ƒã‚’è¡Œã£ã¦ã„ã¾ã™ã€‚ã¨ã¦ã‚‚èˆˆå‘³æ·±ã‹ã£ãŸã®ã§ç´¹ä»‹ã—ãŸã„ã¨æ€ã„ã¾ã™ã€‚Pigs, Bees, and Elephants: A Comparison of Eight MapReduce Languages Â« Dataspora ãªãŠã€ä»Šå›žã¯RSSè³¼èªã—ã¦ã„ã‚‹DataSporaã®ãƒ–ãƒã‚°ã‹ã‚‰ç™ºè¦‹ã—ã¾ã—ãŸãŒã€ã‚¨ãƒ³ãƒˆãƒªã‚’å¯„ç¨¿ã—ãŸã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®å€‹äººãƒ–ãƒã‚°ã‚‚å¤§å¤‰èˆˆå‘³æ·±ã„ã®ã§ã‚ªã‚¹ã‚¹ãƒ¡ã§ã™ã€‚ ã¯ã˜ã‚ã«MapReduceã‚’ç¾Žã—ãåŠ¹çŽ‡çš„ã«æ›¸ããŸã‚ã«ã€ç§ã¯æ§˜ã€…ãªè¨€èªžã‚’æ¯”è¼ƒã—ã¾ã—ãŸã€‚æžœãŸã—ã¦ãã®å‹è€…ã¯ï¼ï¼Ÿç§ã®å€‹äººãƒ–ãƒã‚°ã§ã¯çµ±è¨ˆã‚„ã‚°ãƒ©ãƒ•ã®ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã‚’MapReduceã§è¨˜è¿°ã™ã‚‹æ–¹æ³•ã‚’ç´¹ä»‹ã—ã€æ“¬ä¼¼ã‚³ãƒ¼ãƒ‰ã«ã‚ˆã‚‹å®Ÿè£…ã‚’ç¤ºã—ã¾ã—ãŸã€‚æ“¬ä¼¼ã‚³ãƒ¼ãƒ‰ã«ã¯2ã¤ã®å•é¡Œç‚¹ãŒã‚ã‚Šã¾ã™ï¼šèª°ã‚‚ãŒãã®å‘½ä»¤ã‚’ç†è§£ã§ãã‚‹ã¨
daisukebe 2011/08/20
mapreduce

hadoop
ãƒªãƒ³ã‚¯
1