[B! hadoop] motowotaã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

motowota id:motowota

hadoopã«é–¢ã™ã‚‹motowotaã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (12)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Hadoopã®ç•°ç«¯ã•ãŒé¢ç™½ã„ - wyukawa's diary
Hadoopã¯ã»ã‚“ã¨ãƒ–ãƒ¼ãƒ ã§ã™ã€‚ãƒãƒ–ãƒ«ã ã¨è¨€ã£ã¦ã„ã„æ°—ãŒã—ã¾ã™ã€‚å„ç¨®ã‚»ãƒŸãƒŠãƒ¼ã¯ã™ãã«åŸ‹ã¾ã‚Šã¾ã™ã—ã€å®Ÿéš›ã«èžãã«è¡Œãã¨ä¼šå ´ã¯æº€å“¡ã§ã™ã€‚ ã“ã®åˆ†é‡Žã¯æ—¥æœ¬ã ã¨NTTãƒ‡ãƒ¼ã‚¿ãŒå…ˆé ã‚’ãã£ãŸã‚ˆã†ã«è¦‹ãˆã¾ã™ã€‚ NTTãƒ‡ãƒ¼ã‚¿ã€Hadoopã®å•†ç”¨ãƒ‡ã‚£ã‚¹ãƒˆãƒªãƒ“ãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã€ŒCDH3ã€ã‚’è²©å£²é–‹å§‹ | æ—¥çµŒ xTECHï¼ˆã‚¯ãƒã‚¹ãƒ†ãƒƒã‚¯ï¼‰ ã¾ãŸHadoopå°‚æ¥ä¼šç¤¾ã€ŒãƒŽãƒ¼ãƒãƒ©ã‚¹ãƒ»ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã€ã¨ã„ã†ã®ã‚‚ã§ãã¾ã—ãŸã€‚ ã‚¦ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã‚ºã¨ã‚¤ãƒ¼ã‚·ãƒ¼ãƒ»ãƒ¯ãƒ³ãŒçµŒå–¶çµ±åˆã€Hadoopå°‚æ¥ä¼šç¤¾ã‚’ç«‹ã¡ä¸Šã’ | æ—¥çµŒ xTECHï¼ˆã‚¯ãƒã‚¹ãƒ†ãƒƒã‚¯ï¼‰ ã—ã‹ã—æœ€è¿‘ã§ã¯å¯Œå£«é€šã‚„IBMã‚‚Hadoopã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã‚’å±•é–‹ã—ã¦ãŠã‚Šãƒ¬ãƒƒãƒ‰ã‚ªãƒ¼ã‚·ãƒ£ãƒ³ãªæ„Ÿã˜ã§ã™ã€‚ å¯Œå£«é€šãŒãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿åˆ†æžãƒ»æ´»ç”¨å‘ã‘ã®PaaSã‚µãƒ¼ãƒ“ã‚¹ | æ—¥çµŒ xTECHï¼ˆã‚¯ãƒã‚¹ãƒ†ãƒƒã‚¯ï¼‰ æ—¥æœ¬IBMã€è¡¨è¨ˆç®—ã®ã‚ˆã†ã«åˆ†æžã§ãã‚‹Hadoopã‚½ãƒ•ãƒˆæ–°ç‰ˆã€ŒBigInsightsã€ | æ—¥çµŒ xTECHï¼ˆ
motowota 2011/09/04
hadoop

ã‚ã¨ã§èªã‚€
ãƒªãƒ³ã‚¯
ã„ã¾ã•ã‚‰èžã‘ãªã„Hadoopã¨ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°å…¥é–€
ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿æ™‚ä»£ã®æ•‘ä¸–ä¸»ã€ŒHadoopã€ã¨ã¯ ã€ŒApache Hadoopã€ã¯ä»Šã€æœ€ã‚‚æ³¨ç›®ã‚’é›†ã‚ã¦ã„ã‚‹æŠ€è¡“ã®1ã¤ã§ã™ã€‚Hadoopã¨ã¯ã€å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’æ‰‹è»½ã«è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã—ã¦å‡¦ç†ã§ãã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã§ã™ã€‚ Hadoopã‚’æ´»ç”¨ã—ã¦ã„ã‚‹ä¼æ¥ã¯å¹´ã€…å¢—ãˆç¶šã‘ã¦ã„ã¦ã€ä¸å¯æ¬ ãªæŠ€è¡“ã«ãªã‚Šã¤ã¤ã‚ã‚‹ã¨ã„ãˆã‚‹ã§ã—ã‚‡ã†ã€‚ æœ¬é€£è¼‰ã§ã¯ã€Hadoopã¨ã¯ä½•ã‹ã€HadoopãŒã©ã†æ´»ç”¨ã§ãã‚‹ã®ã‹ã¨ã„ã†ã“ã¨ã‚’ã€ã€Œãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã€ã«ç„¦ç‚¹ã‚’å½“ã¦ã¦è§£èª¬ã—ã¦ã„ããŸã„ã¨æ€ã„ã¾ã™ã€‚ é‡ã„å‡¦ç†ã‚’è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã•ã›ã‚‹ è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«å‡¦ç†ã‚’åˆ†æ•£ã•ã›ã‚‹ã«ã¯ã€ãƒ—ãƒã‚»ã‚¹åŒå£«ã®é€šä¿¡ã€ç›£è¦–ã€éšœå®³æ™‚ã®å¯¾å¿œãªã©ã‚’è€ƒãˆãªã‘ã‚Œã°ãªã‚‰ãšã€ãƒ—ãƒã‚°ãƒ©ãƒžã«ã¨ã£ã¦ãƒãƒ¼ãƒ‰ãƒ«ãŒé«˜ã„ã‚‚ã®ã§ã™ã€‚ã—ã‹ã—ã€Hadoopã¯ãã†ã„ã£ãŸé¢å€’ãã•ã„å‡¦ç†ã‚’ä¸€æ‰‹ã«å¼•ãå—ã‘ã¦ãã‚Œã€ãƒ—ãƒã‚°ãƒ©ãƒžã¯ã€ã‚„ã‚ŠãŸã„å‡¦ç†ã ã‘ã«é›†ä¸ã§ãã¾ã™ã€‚ ä¾‹ãˆã°ã€Hadoopã‚’ä½¿ã†ã¨ã€1
motowota 2011/06/22
ã“ã‚Œã¯ã‚ˆã„ï¼ï¼

hadoop

è‡ªç„¶è¨€èªžå‡¦ç†
ãƒªãƒ³ã‚¯
åˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã€ŒHBaseã€ã®å®‰å®šé‹ç”¨ã‚’ç›®æŒ‡ã—ã¦ - Preferred Networks Research & Development
1å¹´çµŒã£ã¦iPhone4ã®é›»æ± ãŒãƒ˜ã‚¿ã£ã¦ããŸã€å¤ªç”°ã§ã™ã€‚ æŒ‡æ•°é–¢æ•°çš„ã«ã‚¨ãƒ³ãƒˆãƒªæ•°ãŒå°‘ãªããªã£ã¦ããŸæœ¬ãƒ–ãƒã‚°ã§ã™ãŒwã€æ™¯æ°—ä»˜ã‘ã®ãŸã‚ã«ã‚¨ãƒ³ãƒˆãƒªã‚’æŠ•ç¨¿ã—ãŸã„ã¨æ€ã„ã¾ã™ï¼æœ¬æ—¥ã¯HBaseã«ã¤ã„ã¦ã§ã™ã€‚ Linux ã¨ Hadoop ã¨ HBase ã¨ ZooKeeper ã«è©³ã—ã„ã‚ãªãŸï¼ã‚ãªãŸãŒã‚¿ãƒ¼ã‚²ãƒƒãƒˆã§ã™ã€‚ HBaseã¨ã¯? HBaseã¨ã¯ã€HDFS (Hadoop Distributed File System)ä¸Šã«æ§‹ç¯‰ã•ã‚ŒãŸåˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã§ã™ã€‚å¤§é‡ã®éžå¸¸ã«ç´°ã‹ã„ãƒ‡ãƒ¼ã‚¿ã‚’ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ã«èªã¿æ›¸ãå‡ºæ¥ã‚‹ã®ãŒç‰¹å¾´ã§ã™ã€‚æœ€è¿‘ã§ã¯Facebook Messageã®åŸºç›¤æŠ€è¡“ã¨ã—ã¦ä½¿ç”¨ã•ã‚ŒãŸäº‹ã§æ³¨ç›®ã‚’é›†ã‚ã¦ã„ã¾ã™ã€‚ HBaseå…¬å¼ã‚µã‚¤ãƒˆ Apache HBase ãƒ–ãƒƒã‚¯ ä¿å˜ã•ã‚ŒãŸãƒ‡ãƒ¼ã‚¿ã¯HDFSä¸Šã«ä¿å˜ã•ã‚Œã€HDFSã®ä»•çµ„ã¿ã«ã‚ˆã£ã¦ãƒ¬ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã•ã‚Œã‚‹ãŸã‚å®‰å…¨ã«ãƒ‡ãƒ¼ã‚¿ã‚’ä¿æŒã™ã‚‹ã“ã¨ãŒå‡ºæ¥ã¾ã™ã€‚ ã¾
motowota 2011/05/09
ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹

hadoop
ãƒªãƒ³ã‚¯
ç¬¬1å›žã€€åˆ†æ•£å‡¦ç†ã‚’éš è”½ã—ã€å¤§è¦æ¨¡é–‹ç™ºã‚’å¯èƒ½ã«
ç†è€…ã‚‰ã¯ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚¨ã‚¢ã®åˆ†æ•£å‡¦ç†ãƒŸãƒ‰ãƒ«ã‚¦ã‚¨ã‚¢ã€ŒHadoopã€ã‚’ã€åŸºå¹¹ç³»ã®ãƒãƒƒãƒå‡¦ç†ã‚·ã‚¹ãƒ†ãƒ ã«é©ç”¨ã™ã‚‹ãŸã‚ã®ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã€ŒAsakusaã€ã‚’é–‹ç™ºã—ãŸã€‚Asakusaã¯Hadoopã¨åŒæ§˜ã«ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚¨ã‚¢ã¨ã—ã¦å…¬é–‹ã™ã‚‹ã€‚å…¬é–‹æ—¥ã¯ã€æœ¬é€£è¼‰ã®4å›žç›®ã‚’ãŠå±Šã‘ã™ã‚‹2011å¹´3æœˆ31æ—¥ã®äºˆå®šã§ã‚ã‚‹ã€‚ Asakusaã‚’ä½¿ã†ã“ã¨ã§Hadoopã«ã‚ˆã‚‹åˆ†æ•£å‡¦ç†ã®ãƒ¡ãƒªãƒƒãƒˆã‚’äº«å—ã™ã‚‹ã“ã¨ãŒå¯èƒ½ã¨ãªã‚Šã€ã“ã‚Œã¾ã§RDBMSã‚’åˆ©ç”¨ã—ã¦ã„ãŸå ´åˆã¨æ¯”ã¹ã¦ã€å¤šãã®ã‚±ãƒ¼ã‚¹ã§ãƒãƒƒãƒå‡¦ç†ã‚·ã‚¹ãƒ†ãƒ ã®æ€§èƒ½ã‚’å¤§å¹…ã«å‘ä¸Šã™ã‚‹ã“ã¨ãŒã§ãã‚‹ã€‚ç†è€…ã‚‰ãŒå®Ÿéš›ã«æ§‹ç¯‰ã‚’æ”¯æ´ã—ãŸã‚·ã‚¹ãƒ†ãƒ ã§ã¯ã€ãã‚Œã¾ã§4æ™‚é–“ã‹ã‹ã£ã¦ã„ãŸå‡¦ç†ãŒæ•°åˆ†ã§çµ‚ã‚ã‚‹ã‚ˆã†ãªã‚±ãƒ¼ã‚¹ã‚‚å‡ºã¦ãã¦ã„ã‚‹ã€‚ ç››ã‚“ã«å ±é“ã•ã‚Œã¦ã„ã‚‹ã‚ˆã†ã«ã€Hadoopã¯ã™ã§ã«å¤šãã®å°Žå…¥å®Ÿç¸¾ãŒã‚ã‚‹ã€‚ãŸã ã—ãã®ç”¨é€”ã¯ã€ãƒã‚°åˆ†æžã‚·ã‚¹ãƒ†ãƒ ã‚„ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ã‚¨ãƒ³ã‚¸ãƒ³ãªã©ã®ãƒ“ã‚¸ãƒã‚¹ã‚¤ãƒ³ãƒ†ãƒªã‚¸ã‚§ãƒ³ã‚¹ï¼ˆ
motowota 2011/03/28
åˆ†æ•£å‡¦ç†

hadoop
ãƒªãƒ³ã‚¯
IBM Developer
IBM Developer is your one-stop location for getting hands-on training and learning in-demand skills on relevant techno logies such as generative AI, data science, AI, and open source.
motowota 2011/01/27
hadoop

linux
ãƒªãƒ³ã‚¯
ãã‚ãã‚Hadoopã«ã¤ã„ã¦ã²ã¨ã“ã¨è¨€ã£ã¦ãŠãã‹ - nokunoã®æ—¥è¨˜
ã‚‚ã†ã“ã®æ‰‹ã®è©±é¡Œã¯å‡ºå°½ãã—ãŸæ„ŸãŒã‚ã‚Šã¾ã™ãŒã€æœ€è¿‘Hadoopã«ã¤ã„ã¦è€ƒãˆã‚‹ã“ã¨ãŒå¤šã„ã®ã§ã€ã‚¨ãƒ³ãƒˆãƒªã«ã—ã¦ã¿ã¾ã™ã€‚ãªãŠã€ã“ã“ã§ã¯ãƒ™ãƒ¼ã‚·ãƒƒã‚¯ãªMapReduce+HDFSã®ã“ã¨ã‚’Hadoopã¨å‘¼ã¶ã“ã¨ã«ã—ã¾ã™ã€‚ Hadoopã¨ã¯Hadoopã¨ã¯è¨€ã‚ãšã¨çŸ¥ã‚ŒãŸGoogleã®MapReduce/GFSã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ã‚¯ãƒãƒ¼ãƒ³ã§ã™ã€‚MapReduceã§ã¯ãƒ—ãƒã‚°ãƒ©ãƒžã¯Mapã¨Reduceã¨ã„ã†2ã¤ã®é–¢æ•°ã‚’æ›¸ãã ã‘ã§ã€ä¸¦åˆ—åˆ†æ•£å‡¦ç†ã‚’ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ã“ã‚Œã¯(1) ãƒ‡ãƒ¼ã‚¿ã‚’å®Ÿéš›ã«æŒã¤ãƒžã‚·ãƒ³ã«ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’é…å¸ƒã™ã‚‹ (2) Mapã¨Reduceã‚’ã¤ãªãShuffleãƒ•ã‚§ãƒ¼ã‚ºã§ã‚ãƒ¼ã‚’ã‚°ãƒ«ãƒ¼ãƒ—åŒ–ã—ã¦ã‚½ãƒ¼ãƒˆã™ã‚‹ã€(3) éšœå®³æ™‚ã®ãƒ•ã‚§ãƒ¼ãƒ«ã‚ªãƒ¼ãƒãƒ¼ã‚„ãƒ¬ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã€ã¨ã„ã£ãŸå‡¦ç†ã‚’ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯å´ãŒå—ã‘æŒã¤ã“ã¨ã«ã‚ˆã£ã¦ã€ãƒ—ãƒã‚°ãƒ©ãƒžå´ã®è² æ‹…ã‚’æ¸›ã‚‰ã™ã‚‚ã®ã§ã™ã€‚GFSã«å¯¾å¿œã™ã‚‹HDFSã«ã¯ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ã‚¯ãƒ©ã‚¹ã‚¿ã«åˆ†æ•£ã—ã¦ä¿å˜
motowota 2011/01/03
hadoop

ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°
ãƒªãƒ³ã‚¯
NTTãƒ‡ãƒ¼ã‚¿ã®Hadoopå ±å‘Šæ›¸ãŒã™ã”ã‹ã£ãŸ - ç§‘å¦ã¨éžç§‘å¦ã®è¿·å®®
æ¥ç•Œãƒˆãƒƒãƒ— ã®ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚º Hadoop ä¼æ¥ Cloudera ã«å…¥ç¤¾ã—ã¾ã—ãŸ http://www.cloudera.co.jp/ ä»Šå¹´ã®6æœˆã«ã€ã€Œå¹³æˆï¼’ï¼‘å¹´åº¦ ç”£å¦é€£æºã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢å·¥å¦å®Ÿè·µäº‹æ¥å ±å‘Šæ›¸ã€ã¨ã„ã†ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆç¾¤ãŒçµŒç”£çœã‹ã‚‰å…¬è¡¨ã•ã‚Œã¾ã—ãŸã€‚ ãã®ã†ã¡ã®ä¸€ã¤ã«ã€NTTãƒ‡ãƒ¼ã‚¿ã«å§”è¨—ã•ã‚ŒãŸHadoopã«é–¢ã™ã‚‹å®Ÿè¨¼å®Ÿé¨“ã®å ±å‘Šæ›¸ãŒã‚ã‚Šã¾ã—ãŸã®ã§ã€ä»Šæ›´ãªãŒã‚‰èªã‚“ã§ã¿ã‚‹ã“ã¨ã«ã—ã¾ã—ãŸã€‚ Hadoopç•Œéšˆã®äººã¯ã‚‚ã†ã¿ã‚“ãªã¨ã£ãã«èªã‚“ã§ã‚‹ã®ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ã‘ã©ã€‚ http://www.meti.go.jp/policy/mono_info_service/joho/downloadfiles/2010software_research/clou_dist_software.pdf ã€Œé«˜ä¿¡é ¼ã‚¯ãƒ©ã‚¦ãƒ‰å®Ÿç¾ç”¨ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢é–‹ç™ºï¼ˆåˆ†æ•£åˆ¶å¾¡å‡¦ç†æŠ€è¡“ç‰ã«ä¿‚ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼é«˜ä¿¡é ¼åŒ–ã«å‘ã‘ãŸå®Ÿè¨¼äº‹æ¥ï¼‰ã€ã¨ã„ã†
motowota 2010/09/29
ã“ã‚Œã¯ã™ã”ã„ã€‚ã‚ã¨ã§èªã‚€ã€‚

hadoop

ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢

ã‚¯ãƒ©ã‚¦ãƒ‰
ãƒªãƒ³ã‚¯
Map/Reduce Tutorial
ã“ã®ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã§ã¯ã€ãƒãƒ¥ãƒ¼ãƒˆãƒªã‚¢ãƒ«ã¨ã—ã¦å½¹ç«‹ã¤ã“ã¨ã‚’ç›®çš„ã«ã€ãƒ¦ãƒ¼ã‚¶ãƒ¼ãŒè§¦ã‚Œã‚‹ Hadoop Map/Reduce ã®ã™ã¹ã¦ã®å´é¢ã«ã¤ã„ã¦ã¾ã¨ã‚ã¦èª¬æ˜Žã—ã¾ã™ã€‚ Hadoop ã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã¨è¨å®šãŒæ¸ˆã¿ã€ã™ã§ã«å®Ÿè¡Œã•ã‚Œã¦ã„ã‚‹ã“ã¨ã‚’ç¢ºèªã—ã¦ãã ã•ã„ã€‚è©³ç´°ã«ã¤ã„ã¦ã¯ã€ä»¥ä¸‹ã‚’å‚ç…§ã—ã¦ãã ã•ã„ã€‚ Hadoop ã‚’åˆã‚ã¦ä½¿ã†ãƒ¦ãƒ¼ã‚¶ãƒ¼ã¯ã€Hadoop ã‚¯ã‚¤ãƒƒã‚¯ã‚¹ã‚¿ãƒ¼ãƒˆã‚’å‚ç…§ã—ã¦ãã ã•ã„ã€‚ å¤§è¦æ¨¡ãªåˆ†æ•£ã‚¯ãƒ©ã‚¹ã‚¿ã‚’ä½¿ã†ãƒ¦ãƒ¼ã‚¶ãƒ¼ã¯ã€Hadoop ã‚¯ãƒ©ã‚¹ã‚¿ã‚»ãƒƒãƒˆã‚¢ãƒƒãƒ—ã‚’å‚ç…§ã—ã¦ãã ã•ã„ã€‚ Hadoop Map/Reduce ã¯ã€ã©ã“ã«ã§ã‚‚ã‚ã‚‹ã”ãæ™®é€šã®ãƒãƒ¼ãƒ‰ã‚¦ã‚§ã‚¢ã§æ§‹æˆã—ãŸ (æ•°åƒãƒŽãƒ¼ãƒ‰ã®) å¤§è¦æ¨¡ãªã‚¯ãƒ©ã‚¹ã‚¿ä¸Šã§ã€è†¨å¤§ãªãƒ‡ãƒ¼ã‚¿ (æ•°ãƒ†ãƒ©ãƒã‚¤ãƒˆã®ãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆ) ã‚’ä¸¦åˆ—å‡¦ç†ã™ã‚‹ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‚’ç°¡å˜ã«è¨˜è¿°ã§ãã‚‹ã‚ˆã†ã«ã™ã‚‹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã§ã™ã€‚ é€šå¸¸ã€Map/Reduce ã®ã‚¸ãƒ§ãƒ–ã¯ã€å…¥åŠ›ãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆã‚’ç‹¬ç«‹
motowota 2010/09/19
hadoop

MapReduce
ãƒªãƒ³ã‚¯
ã‚°ãƒ¼ã‚°ãƒ«ã«ã‚ˆã‚‹MapReduceã‚µãƒ¼ãƒ“ã‚¹ã€ŒBigQueryã€ãŒç™»å ´ã€‚SQLãƒ©ã‚¤ã‚¯ãªå‘½ä»¤ã§å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿æ“ä½œ
ã€Œæ•°å…†ä»¶ã®ãƒ‡ãƒ¼ã‚¿ã‚‚å¯¾è©±çš„ã«ã€é«˜é€Ÿã«åˆ†æžã§ãã‚‹ã€ã€‚ã‚°ãƒ¼ã‚°ãƒ«ã¯5æœˆ19æ—¥ã«ã“ã®ã‚ˆã†ãªè¡¨ç¾ã§æ–°ã—ã„ã‚µãƒ¼ãƒ“ã‚¹ã€ŒBigQueryã€ã®ç™»å ´ã‚’ç´¹ä»‹ã™ã‚‹ã‚¨ãƒ³ãƒˆãƒªã‚’ã€ãƒ–ãƒã‚°ã«ãƒã‚¹ãƒˆã—ã¦ã„ã¾ã™ã€‚ ã‚°ãƒ¼ã‚°ãƒ«ãŒå…¬é–‹ã—ãŸBigQueryã¯ã€Hadoopã‚„ãƒ‡ãƒ¼ã‚¿ã‚¦ã‚§ã‚¢ãƒã‚¦ã‚¹ãªã©ã‚’ç”¨ã„ã¦å¤šãã®ä¼æ¥ãŒè¡ŒãŠã†ã¨ã—ã¦ã„ã‚‹å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ï¼ˆã„ã‚ã‚†ã‚‹ã€ŒBig Dataã€ï¼‰ã®åˆ†æžã‚’ã€ã‚°ãƒ¼ã‚°ãƒ«ã®ã‚¯ãƒ©ã‚¦ãƒ‰ã§å¯èƒ½ã«ã—ã¾ã™ã€‚åˆ©ç”¨è€…ã¯Google StorageçµŒç”±ã§å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’è»¢é€ã—ã€SQLãƒ©ã‚¤ã‚¯ãªå‘½ä»¤ã«ã‚ˆã£ã¦æŠ½å‡ºã‚„åˆ†æžã‚’è¡Œã„ã¾ã™ã€‚ ã¾ã‚‹ã§ã‚°ãƒ¼ã‚°ãƒ«ãŒå¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã®MapReduceã‚’ãƒ›ã‚¹ãƒ†ã‚£ãƒ³ã‚°ã—ã€ãã®æ©Ÿèƒ½ã‚’ã‚µãƒ¼ãƒ“ã‚¹ã¨ã—ã¦æä¾›ã™ã‚‹ã‚ˆã†ãªã‚‚ã®ãŒBigQueryã¨ã„ãˆã¾ã™ï¼ˆãŸã ã—å…¬é–‹ã•ã‚ŒãŸã€ŒBigQueryã€ã®èª¬æ˜Žã«ã¯ã€å†…éƒ¨ã§MapReduceã‚’åˆ©ç”¨ã—ã¦ã„ã‚‹ã®ã‹ã©ã†ã‹ã®è¨˜è¿°ã¯ãªã„ã®ãŸã‚ã€MapReduceã€Œçš„ã€ãªã‚µãƒ¼ãƒ“ã‚¹ã¨è¡¨ç¾ã™ã¹ãã‹ã‚‚ã—ã‚Œ
motowota 2010/05/27
Hadoop

mapreduce

Google
ãƒªãƒ³ã‚¯
Hadoop ã§ Wikipedia ã®ãƒ†ã‚ã‚¹ãƒˆå‡¦ç†ã‚’900å€é«˜é€ŸåŒ– - æ¦è”µé‡Žæ—¥è¨˜
ä»Šæœˆä¸ã«å®Ÿé¨“ã®å®Ÿè£…ãŒçµ‚ã‚ã‚‹ãã‚‰ã„ã§ãªã„ã¨æ¥æœˆã®æŠ•ç¨¿ã€†åˆ‡ã«é–“ã«åˆã‚ãªã„ã®ã§ã€ä»Šé€±ã‹ã‚‰ç ”ç©¶å®¤ã®ã‚µãƒ¼ãƒã« Hadoop ã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã—ã¦ã„ã‚‹ã€‚ ç ”ç©¶å®¤ã«ã¯ã‚µãƒ¼ãƒãŒ20å°å¼±ã‚ã‚‹ã®ã ãŒã€ãã®ã†ã¡10å°å¼·ã‚’ä½¿ã†ã“ã¨ã«ã—ã¦è¨å®šã€‚ã“ã‚Œãã‚‰ã„ã®è¦æ¨¡ã ã¨ã€Œå¤§è¦æ¨¡ã€ã¨è¨€ã†ã®ã¯æ†šã‚‰ã‚Œã‚‹ã‹ã‚‚ã—ã‚Œãªã„ãŒ(Yahoo! ã‚„ Google ã¨æ¯”ã¹ã¦ã€ã¨ã„ã†æ„å‘³ã§ã€‚)ã€ä¸è¦æ¨¡ã€ãã‚‰ã„ã«ã¯è¨€ã£ã¦ã‚‚ã„ã„ã ã‚ã†ã—ã€ãŸã¶ã‚“ã€å¤šãã®å¤§å¦ã‚„ä¼æ¥ã§ä½¿ãˆã‚‹å°æ•°ã‚‚ã“ã‚Œãã‚‰ã„ã ã¨æ€ã†ã—ã€å¤§ä¼æ¥ã«ã„ãªã„ã¨ã§ããªã„ç ”ç©¶ã‚’ã™ã‚‹ã®ã‚‚å¤§å¤‰ä¾¡å€¤ãŒã‚ã‚‹ãŒã€ä»–ã®äººãŸã¡ãŒã‚„ã‚‹æ°—ã«ãªã‚Œã°çœŸä¼¼ã§ãã‚‹ç ”ç©¶ã‚’ã™ã‚‹ã®ã‚‚(ãƒ‡ãƒ¼ã‚¿ã‚„ã‚¤ãƒ³ãƒ•ãƒ©å‹è² ã§ã¯ãªãã‚¢ã‚¤ãƒ‡ã‚¢å‹è² ã«ãªã‚‹ã®ã§è‹¦ã—ãã¯ã‚ã‚‹ã®ã ãŒ)é‡è¦ã ã¨è€ƒãˆã¦ã„ã‚‹ã€‚ ãŸã¨ãˆã°ã€æ•°å°ã§ã‚‚åˆ†æ•£ç’°å¢ƒã®æ©æµãŒå—ã‘ã‚‰ã‚Œã‚‹ã€ã¨ã„ã†ã®ã¯PFI ãŒå‡ºã—ãŸ Hadoop ã®è§£æžè³‡æ–™ã§çŸ¥ã£ã¦ã„ãŸã®ã§ã€åˆã‚ã¦å°Žå…¥ã—ãŸã¨ãã¯å‚è€ƒã«ãªã£ãŸã—ã€ã“ã†ã„ã†
motowota 2010/05/23
è‡ªç„¶è¨€èªžå‡¦ç†

Hadoop

*ã‚ã¨ã§èªã‚€
ãƒªãƒ³ã‚¯
ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰ã¨Hadoop - ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰é–‹ç™ºè€…ãƒ–ãƒã‚°
ã¯ã˜ã‚ã¾ã—ã¦ã€‚ä»Šå¹´ã®5æœˆã«å…¥ç¤¾ã—ãŸå‹é–“@ã•ãŒã™ãƒãƒ¼ãƒ ã§ã™ã€‚ å…¥ç¤¾ã—ã¦ã‹ã‚‰ã¯ã€ãªã‹ãªã‹å¤§å¤‰ãªã“ã¨ã‚‚å¤šã„ã§ã™ãŒã€æœ€è¿‘ã¯ãŠé…’å¥½ããŒé›†ã¾ã£ã¦æœˆæ›œã‹ã‚‰é£²ã¿åˆã† ã€Œå‹é–“ä¼šã€ãªã‚‹ã‚‚ã®ã‚‚ç™ºè¶³ã—ã¦ã€ä»•äº‹é¢ã§ã‚‚ä»•äº‹ä»¥å¤–ã®é¢ã§ã‚‚å¯†åº¦ã®é«˜ã„æ¯Žæ—¥ã‚’éŽã”ã—ã¦ã„ã¾ã™ï¼ ã•ã¦ã€åƒ•ã¯ã€Œã•ãŒã™ã€ãƒãƒ¼ãƒ æ‰€å±žã¨ã„ã†ã“ã¨ã§ã€æ™®æ®µã¯ãƒ¬ã‚·ãƒ”ã‚’ã€Œã•ãŒã™ã€ãƒ¦ãƒ¼ã‚¶ã®æº€è¶³åº¦ã‚’ä¸Šã’ã‚‹ãŸã‚ã«ã€ ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰ã®æ¤œç´¢ã¾ã‚ã‚Šã«ã¤ã„ã¦ã€ã„ã‚ã„ã‚ãªé–‹ç™ºã‚’è¡Œã£ã¦ã„ã¾ã™ã€‚ ä¸€æ–¹ã§ã€ãƒ¦ãƒ¼ã‚¶ã®ã€Œã•ãŒã™æ¬²æ±‚ã€ã«ã¤ã„ã¦æ·±ãçŸ¥ã‚‹ãŸã‚ã«ã€å¤§è¦æ¨¡ãªãƒ‡ãƒ¼ã‚¿è§£æžã‚’è¡Œã„ã€æ¬²æ±‚ã®åˆ†æžã‚’è¡Œã†æ©Ÿä¼šã‚‚å¢—ãˆã¦ãã¾ã—ãŸã€‚ ã¨ã“ã‚ãŒã€ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰ã®ãƒã‚°ã¯è†¨å¤§ãªæ•°ãŒã‚ã‚‹ã®ã§ã€ä¸€å£ã®ãƒ‡ãƒ¼ã‚¿è§£æžã¨è¨€ã£ã¦ã‚‚é€šå¸¸ã®ãƒãƒƒãƒå‡¦ç†ã ã¨é–“ã«åˆã‚ãªã„ãŸã‚ã€ åˆ†æ•£å‡¦ç†ç’°å¢ƒã®å¿…è¦æ€§ãŒé«˜ã¾ã£ã¦ãã¾ã—ãŸã€‚ ãã“ã§ã€ã¾ãšã¯æ‰‹è»½ã«è©¦ã›ã‚‹åˆ†æ•£å‡¦ç†ã®çŽ‹é“ã¨ã„ã†ã“ã¨ã§ã€æœ€è¿‘ã§ã¯Hadoopã‚’ä½¿ã£ãŸãƒ‡ãƒ¼ã‚¿è§£æžç’°å¢ƒã‚’æ•´å‚™ã—ã¦ã„ã¾ã™ã€‚
motowota 2010/04/22
hadoop

ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°

cookpad
ãƒªãƒ³ã‚¯
Apache Hadoop - Wikipedia
Hadoop consists of the Hadoop Common package, which provides file system and operating system level abstractions, a MapReduce engine (either MapReduce/MR1 or YARN/MR2)[32] and the Hadoop Distributed File System (HDFS). The Hadoop Common package contains the Java Archive (JAR) files and scripts needed to start Hadoop. For effective scheduling of work, every Hadoop-compatible file system should prov
motowota 2010/04/20
IT

wikipedia

hadoop
ãƒªãƒ³ã‚¯
1