[B! mapreduce] tokadaã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

tokada id:tokada

mapreduceã«é–¢ã™ã‚‹tokadaã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (13)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

blog.katsuma.tv
å‰å›žã€JavaScriptã§Map Reduceã®ã‚³ãƒ¼ãƒ‰ãŒæ›¸ã‘ã‚‹Hadoop Streamingã«ã¤ã„ã¦ç´¹ä»‹ã—ã¾ã—ãŸã€‚ æ¨™æº–å…¥å‡ºåŠ›ã•ãˆã‚µãƒãƒ¼ãƒˆã•ã‚Œã¦ã‚ã‚Œã°ã€ä»»æ„ã®ã‚³ãƒ¼ãƒ‰ã§Map Reduuceã®å‡¦ç†ãŒæ›¸ã‘ã‚‹ã€ã¨ã„ã†ã‚‚ã®ã§ã—ãŸãŒã€ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã¯ãã‚‚ãã‚‚é¢å€’ãã•ãŒã‚Šã€‚ã‚³ãƒ¼ãƒ‰ã‚‚æ›¸ãã®ã‚‚é¢å€’ã§ã™ã€‚ ã¨ã€ã„ã†ã‚ã‘ã§ã€ä»Šå›žã¯ã‚‚ã†ã‚³ãƒ¼ãƒ‰ã™ã‚‰æ›¸ã‹ãšã«SQLãƒ©ã‚¤ã‚¯ã§Map Reduceã§ãã‚‹Hiveã¨ã„ã†ãƒ—ãƒãƒ€ã‚¯ãƒˆã«ã¤ã„ã¦ã€ã¾ã¨ã‚ãŸã„ã¨æ€ã„ã¾ã™ã€‚ Hive Hiveã¨ã¯ã€ç°¡å˜ã«è¨€ã†ã¨Hadoopä¸Šã§å‹•ä½œã™ã‚‹RDBã®ã‚ˆã†ãªã‚‚ã®ã§ã™ã€‚ HDFSãªã©ã®åˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ä¸Šã«å˜åœ¨ã™ã‚‹ãƒ‡ãƒ¼ã‚¿ã«å¯¾ã—ã¦ã€HiveQLã¨ã„ã†SQLãƒ©ã‚¤ã‚¯ãªè¨€èªžã§æ“ä½œã§ãã¾ã™ã€‚ ã§ã€é¢ç™½ã„ã®ãŒHiveQLã®æ“ä½œã¯åŸºæœ¬çš„ã«Map Reduceã®ãƒ©ãƒƒãƒ‘ãƒ¼ã«ãªã£ã¦ã„ã‚‹ã“ã¨ã€‚ è¦ã™ã‚‹ã«ã€SELECTæ–‡å®Ÿè¡Œã™ã‚‹ã¨è£ã§Map&Reduceã®ã‚¿ã‚¹ã‚¯ãŒèµ°ã‚Šå‡º
tokada 2009/09/09
mapreduce
ãƒªãƒ³ã‚¯
A Comparison of Approaches to Large-Scale Data Analysis - MapReduce vs. DBMS Benchmarks
A Comparison of Approaches to Large-Scale Data Analysis: MapReduce vs. DBMS Benchmarks Overview 04/14/2009 - SIGMOD 2009 Paper The following information is meant to provide documentation on how others can recreate the benchmark trials used in our SIGMOD 2009 paper. Our experiments were conducted on a 100-node cluster at the University of Wisconsin-Madison; each node had a single 2.40 GHz Intel Cor
tokada 2009/04/18
mapreduce

performance
ãƒªãƒ³ã‚¯
MapReduce on Tyrant - mixi engineer blog
å…ˆæ—¥ã€éš…ç”°å·ã®å±‹å½¢èˆ¹ã§èŠ±è¦‹ã¨æ´’è½è¾¼ã‚“ã ã®ã§ã™ãŒã€ãã®æ—¥ã¯ã¾ã ä¸€åˆ†å’²ãã‚‚è¡Œã£ã¦ãªãã¦æ‚²ã—ã„æ€ã„ã‚’ã—ãŸmikioã§ã™ã€‚ä»Šå›žã¯Tokyo Tyrantï¼ˆTTï¼‰ã«æ ¼ç´ã—ãŸãƒ‡ãƒ¼ã‚¿ã‚’å¯¾è±¡ã¨ã—ã¦MapReduceã®ãƒ¢ãƒ‡ãƒ«ã«åŸºã¥ãè¨ˆç®—ã‚’ã™ã‚‹æ–¹æ³•ã«ã¤ã„ã¦è¿°ã¹ã¾ã™ã€‚ MapReduceã¨ã¯ GoogleãŒä½¿ã£ã¦ã„ã‚‹ã¨ã„ã†åˆ†æ•£å‡¦ç†ã®è¨ˆç®—ãƒ¢ãƒ‡ãƒ«ãŠã‚ˆã³ãã®å®Ÿè£…ã®ã“ã¨ã ãã†ã§ã™ãŒã€è©³ã—ã„ã“ã¨ã¯ã‚°ã‚°ã£ã¦ãã ã•ã„ã€‚Googleã«ã‚ˆã‚‹å‡ºè‡ªã®è«–æ–‡ã‚„Apacheãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã«ã‚ˆã‚‹Hadoopãªã©ã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹å®Ÿè£…ã«ã‚ãŸã‚‹ã®ã‚‚ã‚ˆã„ã§ã—ã‚‡ã†ï¼ˆç§ã¯ä¸¡è€…ã¨ã‚‚è©³ã—ãè¦‹ã¦ã„ã¾ã›ã‚“ãŒï¼‰ã€‚ ä»Šå›žã®è¶£æ—¨ã¯ã€CouchDBãŒMapReduceã¨ç§°ã—ã¦JavaScriptã§å®Ÿç¾ã—ã¦ã„ã‚‹ãƒ‡ãƒ¼ã‚¿é›†è¨ˆæ–¹æ³•ã‚’TTã¨TCã¨Luaã§ã‚„ã£ã¦ã¿ã‚ˆã†ã˜ã‚ƒãªã„ã‹ã¨ã„ã†ã“ã¨ã§ã™ã€‚ç°¡å˜ã«è¨€ãˆã°ã€ä»¥ä¸‹ã®å‡¦ç†ã‚’å®Ÿè£…ã—ã¾ã™ã€‚ ãƒ¦ãƒ¼ã‚¶ã‹ã‚‰è¨ˆç®—é–‹å§‹ãŒæŒ‡ç¤ºã•ã‚Œã‚‹ã¨ã€TTã¯ã€DBå†…ã®
tokada 2009/04/07
mapreduce
ãƒªãƒ³ã‚¯
Amazon Elastic MapReduceã‚’ä½¿ã£ã¦ã¿ãŸ - moratorium
Amazon Elastic MapReduceã‚’ä½¿ã£ã¦ã¿ãŸ 2009-04-03 (Fri) 3:06 Amazon EC2 é€£æ—¥ã®EC2ãƒã‚¿ã§ã™ã€‚æœ¬æ—¥ã€Amazonã‹ã‚‰Elastic MapReduceã¨ã„ã†ã‚µãƒ¼ãƒ“ã‚¹ãŒãƒªãƒªãƒ¼ã‚¹ã•ã‚Œã¾ã—ãŸã€‚å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿å‡¦ç†æŠ€è¡“ãŒä¸€æ°—ã«æ°‘é–“ã®æ‰‹ã«ä¸‹ã‚Šã¦ãã‚‹ã€ã¾ã•ã«é©å‘½çš„ãªã‚µãƒ¼ãƒ“ã‚¹ã ã¨æ€ã„ã¾ã™ã€‚ Amazon Elastic MapReduce Amazon ElasticMapReduce ç´¹ä»‹ãƒ“ãƒ‡ã‚ª With Hadoop, Amazon Adds A Web-Scale Data Processing Engine To Its Cloud Computer by techcrunch.com Elastic MapReduceã¯ã€Googleã®åŸºç›¤æŠ€è¡“ã®ä¸€ã¤ã§ã‚ã‚‹MapReduceã‚’æ™‚é–“å˜ä½èª²é‡‘ã§å®Ÿè¡Œã§ãã‚‹ã‚µãƒ¼ãƒ“ã‚¹ã§ã™ã€‚MapReduceã«ã¤ã„ã¦ã¯ä»¥
tokada 2009/04/04
amazon

cloud

hadoop

mapreduce
ãƒªãƒ³ã‚¯
Big Data Platform - Amazon EMR - AWS
Your profile helps improve your interactions with select AWS experiences.
tokada 2009/04/02
amazon

cloud

hadoop

mapreduce
ãƒªãƒ³ã‚¯
Groovin' High:map reduceã§æ„Ÿã˜ã‚‹æœªæ¥ - livedoor Blogï¼ˆãƒ–ãƒã‚°ï¼‰
ã€Œã—ã‚‰ãªãƒ¼ã„ã€ã£ã¦äººã«ã€ä½•äººã‹ä¼šã£ãŸã®ã§ã€ã¡ã‚‡ã£ã¨è§£èª¬ã—ãªãŒã‚‰è©±ã‚’ã™ã™ã‚ã¾ã™ã€‚ ã„ã¤ã‚‚å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’å‡¦ç†ã—ã¦ã„ã‚‹GoogleãŒã€ã€Œãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰ã§ã“ã‚“ãªã“ã¨ã‚„ã£ã¦åŠ¹æžœã‚’ä¸Šã’ã¦ã¾ã™ã€‚ã€ã¨ã„ã†è«–æ–‡ã‚’2004å¹´ã«ç™ºè¡¨ã—ãŸã€‚ ãã“ã«æ›¸ã‹ã‚Œã¦ã„ã‚‹ã®ã¯ã€åˆ†æ•£å‡¦ç†ã®ãŸã‚ã®ãƒ‡ã‚¶ã‚¤ãƒ³ãƒ‘ã‚¿ãƒ¼ãƒ³ã€ŒMapReduceã€ã€‚ å¤§é‡ãƒ‡ãƒ¼ã‚¿ã‚’ã„ãã¤ã‹ã®å˜ä½ã«åˆ†å‰²ã—ã¦ã€ã‚ãƒ¼ã¨å€¤ã«åˆ†å‰²ã™ã‚‹å‡¦ç†ï¼ˆMapï¼‰ã¨ã€ãã‚Œã‚’é›†è¨ˆã™ã‚‹å‡¦ç†ï¼ˆReduceï¼‰ã«åˆ†ã‘ã‚‹äº‹ã§ã€å‡¦ç†å˜ä½åŒå£«ã®é–¢é€£æ€§ã‚’å¸Œè–„åŒ–ã—ã€ãã®çµæžœåˆ†æ•£ä¸¦åˆ—å‡¦ç†ã‚’å¯èƒ½ã«ã™ã‚‹ã€‚ã¨ã„ã†ã‚‚ã®ã€‚ ã“ã®ãƒ‡ã‚¶ã‚¤ãƒ³ãƒ‘ã‚¿ãƒ¼ãƒ³ã‚’å®Ÿè£…ã—ãŸã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹è£½å“ãŒã€ä¸–ç•Œä¸ã«ã†ã˜ã‚ƒã†ã˜ã‚ƒã‚ã‚‹ã‚“ã ã‘ã©ã€ä¸€ç•ªæœ‰åãªã®ãŒã€Javaã§å®Ÿè£…ã•ã‚ŒãŸã€ŒHadoopã€ã€‚ Javaã§å®Ÿè£…ã•ã‚Œã¦ã‚‹ã‹ã‚‰ã€Javaã§åˆ©ç”¨ã™ã‚Œã°ã„ã„ã‚“ã ã‘ã©ã€ã“ã„ã¤ã«ã¯streamingã¨ã„ã†æ©Ÿèƒ½ã‚‚æè¼‰ã•ã‚Œã¦ã„ã¦ã€ä»–ã®è¨€èªžã§ã‚‚MapReduceã‚’å®Ÿè£…ã§ã
tokada 2009/03/11
hadoop

mapreduce

ruby
ãƒªãƒ³ã‚¯
Googleã®MapReduceã¯åƒ•ãŸã¡ã«å¿…è¦ã‹ï¼Ÿ - ãã—ã ã®ã¯ã¦ãª
ã¨ã„ã†ã“ã¨ã§ã€Google MapReduceã®å®Ÿè£…ã§ã‚ã‚‹Hadoopã‚’ä½¿ã£ãŸMapReduceã¨ã€JMSã‚’ä½¿ã£ãŸMapReduceã‚’ã‚„ã£ã¦ã¿ã¾ã—ãŸã€‚ ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚ãƒ¥ãƒ¼ã‚’ä½¿ã£ã¦åˆ†æ•£MapReduceã‚’å®Ÿè£…ã™ã‚‹ Hadoopã§ã®MapReduceã‚’æ°—è»½ã«è©¦ã™ã‚µãƒ³ãƒ—ãƒ« ã“ã‚Œä½•ã®ãŸã‚ã«ã‚„ã£ãŸã‹ã¨ã„ã†ã¨ã€ãã“ã‚‰ã«ã‚ã‚‹ã‚ˆã†ãªæ•°åå°è¦æ¨¡ã®ã‚µãƒ¼ãƒãƒ¼ã‚’å‰æã¨ã—ãŸã¨ãã«ã€Hadoopã®æœ‰åŠ¹æ€§ã€ã²ã„ã¦ã¯ãã®å…ƒã«ãªã£ã¦ã‚‹Google MapReduceã®æœ‰åŠ¹æ€§ã«ã¤ã„ã¦ç–‘å•ã«æ€ã£ãŸã‹ã‚‰ã§ã™ã€‚ãã“ã§ã€ã¡ã‚‡ã£ã¨è©¦ã—ã¦ã¿ãŸã€ã¨ã€‚ ã“ã“ã§ã€ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚ãƒ¥ãƒ¼ã‚’ä½¿ã£ãŸå ´åˆã«1ç§’ã§ã§ãã¦ãŸå‡¦ç†ãŒã€Hadoopã‚’ä½¿ã†ã¨ã‚¹ã‚¿ãƒ³ãƒ‰ã‚¢ãƒãƒ³ãƒ¢ãƒ¼ãƒ‰ã§ã‚‚40ç§’è¿‘ãã‹ã‹ã‚Šã¾ã—ãŸã€‚æ“¬ä¼¼åˆ†æ•£ãƒ¢ãƒ¼ãƒ‰ã ã¨4åˆ†è¿‘ãã§ã™ã€‚ ã„ãã‚‰Hadoopã®å®Ÿè£…ãŒã²ã©ã„ã¨ã—ã¦ã‚‚ã€ã“ã‚Œã¯ã‚ã‚“ã¾ã‚Šã§ã™ã€‚ Googleã§ã®å®Ÿè£…ã¯ã‚‚ã£ã¨åŠ¹çŽ‡çš„ãªã‚‚ã®ã«ãªã£ã¦ã„ã‚‹ã¨æ€ã„ã¾ã™ãŒã€ã
tokada 2009/02/22
google

mapreduce
ãƒªãƒ³ã‚¯
ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚ãƒ¥ãƒ¼ã‚’ä½¿ã£ã¦åˆ†æ•£MapReduceã‚’å®Ÿè£…ã™ã‚‹ 2009-02-16 - ãã—ã ã®ã¯ã¦ãª
ã•ã¦ã€JMSã§ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚ãƒ¥ãƒ¼ã‚‚ä½¿ãˆã‚‹ã‚ˆã†ã«ãªã£ã¦ã€Hadoopã§MapReduceã‚‚è©¦ã—ã¦ã¿ãŸã€‚ãã†ã™ã‚‹ã¨ã‚„ã‚ŠãŸããªã‚‹ã®ãŒãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚ãƒ¥ãƒ¼ã‚’ä½¿ã£ãŸåˆ†æ•£MapReduceã®å®Ÿè£…ã§ã™ãã€‚ã¨ã„ã†ã“ã¨ã§ã€JMSã‚’ä½¿ã£ã¦ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚ãƒ¥ãƒ¼ã«ã‚ˆã‚‹åˆ†æ•£MapReduceã‚’ã‚„ã£ã¦ã¿ã¾ã—ãŸã€‚å®Ÿéš›ã«ã¯ãƒãƒ¼ã‚«ãƒ«ã§ã—ã‹å‹•ã‹ãªã„ã®ã§ã™ãŒã€ã‚³ãƒ³ã‚»ãƒ—ãƒˆãƒ¢ãƒ‡ãƒ«ã¨ã„ã†ã“ã¨ã§ã€‚ ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚ãƒ¥ãƒ¼ã§éŠã³ãŸã„ã®ã§JMSã‚’è©¦ã™ Hadoopã§ã®MapReduceã‚’æ°—è»½ã«è©¦ã™ã‚µãƒ³ãƒ—ãƒ« Hadoopã‚µãƒ³ãƒ—ãƒ«ã§ä½œã£ãŸã®ã¨åŒã˜ã‚ˆã†ã«ã€ã‚¯ãƒ©ã‚¹ãŒJavaãƒ•ã‚¡ã‚¤ãƒ«ä¸ã§importã•ã‚Œã¦ã„ã‚‹å›žæ•°ã‚’æ•°ãˆã¦ã¿ã¾ã™ã€‚ è€ƒãˆæ–¹ã¨ã—ã¦ã€ã¡ã‚‡ã£ã¨å¼·å¼•ã§ã™ãŒã€Googleã‚„Hadoopã®MapReduceã¯åˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ä»˜ããƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚ãƒ¥ãƒ¼ã¨ã„ãˆã¾ã™ã€‚ã‘ã©å°è¦æ¨¡ã«ã¤ã¤ã¾ã—ãã‚„ã‚‹åˆ†ã«ã¯åˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã¯å¿…è¦ãªã„ã®ã§ã€Mapã¨Reduceã‚’åˆ†æ•£ã™ã‚‹ã“ã¨ã
tokada 2009/02/17
mapreduce
ãƒªãƒ³ã‚¯
æœ¬ã‚’èªã‚€ æ¥½å¤©ã§ROMAã¨fairyã®è©±ã‚’èžã„ã¦ããŸ
ç«æ›œæ—¥ã®Hadoopã®è©±ã«ç¶šãã€åœŸæ›œæ—¥ã«ã¯ã€Œæ¥½å¤©ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã€ã§ROMAã¨fairyã®è©±ã‚’èžã„ã¦ãã¾ã—ãŸã€‚fairyã¯ã‚ˆã†ã™ã‚‹ã«æ¥½å¤©ç‰ˆMapReduceã€ROMAã¯æ¥½å¤©ç‰ˆmemcachedï¼ˆã‚ˆã‚Šã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸å¯„ã‚Šï¼‰ã¨ã„ã†æ„Ÿã˜ã®ã‚½ãƒ•ãƒˆã§ã™ã€‚ ä»¥ä¸‹ã€ãƒ¡ãƒ¢ã€‚ ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‰ï¼†ãƒ‘ãƒ¼ã‚½ãƒŠãƒ©ã‚¤ã‚¼ãƒ¼ã‚·ãƒ§ãƒ³ï¼ˆæ¥½å¤©æŠ€ç ” è¥¿å²¡æ°ï¼‰ ï¼ˆemasakaæ³¨ï¼šã“ã‚Œã¯ROMAã¨fairyã®ã‚»ãƒƒã‚·ãƒ§ãƒ³ã®ç›´å‰ã®ã‚»ãƒƒã‚·ãƒ§ãƒ³ã ã‘ã©ã€é–¢é€£æ€§ãŒå¼·ã„ã®ã§ã€é–¢é€£ã™ã‚‹éƒ¨åˆ†ã®ã¿åˆ‡ã‚Šå‡ºã—ï¼‰ æ¥½å¤©ã§ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ã‚’ã‚„ã‚‹å ´åˆã€è¦æ¨¡ãŒè†¨å¤§ã¨ã„ã†ç‰¹å¾´ãŒã‚ã‚‹ã€‚ä½•åƒä¸‡ã‚‚ã®ä¼šå“¡ã¨2,500ä¸‡ã®å•†å“ã®çµ„ã¿åˆã‚ã›ã€‚ãã®å¯¾ç–ã¨ã—ã¦ã€Locality Sensitive Hashingãªã©ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã‚’æ”¹è‰¯ã™ã‚‹ã¨åŒæ™‚ã«ã€å¤šæ•°ã®ãƒžã‚·ãƒ³ã‚’çµ„ã¿ã‚ã‚ã›ã¦ã„ã‚‹ã€‚ãã®ãŸã‚ã«ã€ç¾æ™‚ç‚¹ã§ã¯Hadoopã‚’ä½¿ã£ã¦MapReduceå‡¦ç†ã‚’ã—ã€k-meansã®ã‚¯ãƒ©ã‚¹ã‚¿ãƒªãƒ³ã‚°ã‚„
tokada 2008/12/02
ruby

roma

fairy

mapreduce
ãƒªãƒ³ã‚¯
ã‚¤ãƒã‚¤ãƒãªåˆ†æ•£å‡¦ç†æŠ€è¡“ã¨ã‚¤ãƒžãƒ‰ã‚ã®Webã‚µãƒ¼ãƒ“ã‚¹
æœ€è¿‘æ³¨ç›®ã‚’æµ´ã³ã¦ã„ã‚‹åˆ†æ•£å‡¦ç†æŠ€è¡“ã€ŒMapReduceã€ã®åˆ©ç‚¹ã‚’ã‚µãƒ³ãƒ—ãƒ«ã‹ã‚‰ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ãƒ¬ãƒ™ãƒ«ã§ç†è§£ã—ã€æ˜”ã‹ã‚‰ã‚ã‚‹Javaé–¢é€£ã®åˆ†æ•£å‡¦ç†æŠ€è¡“ã‚’è¦‹ç›´ã™ç‰¹é›†ä¼ç”»ï¼ˆç·¨é›†éƒ¨ï¼‰ Javaã¯ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ã‚’åˆ©ç”¨ã—ãŸåˆ†æ•£å‡¦ç†ã«ã‚‚å¼·ã„ Javaã¯ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°å‘ã‘ã®java.netãƒ‘ãƒƒã‚±ãƒ¼ã‚¸ãŒæ¨™æº–ã§å‚™ã‚ã£ã¦ã„ã‚‹ã“ã¨ã‹ã‚‰ã‚‚åˆ†ã‹ã‚‹ã‚ˆã†ã«ã€ã‚‚ã¨ã‚‚ã¨ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ã‚’å¼·ãæ„è˜ã—ãŸè¨€èªžä»•æ§˜ã¨ãªã£ã¦ã„ã¾ã™ã€‚ãã®ãŸã‚ç†è€…ã¯ã€ã€ŒJavaã¯ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ã‚’åˆ©ç”¨ã—ãŸåˆ†æ•£å‡¦ç†ã«ã‚‚å¼·ã„ã€ã¨ã„ã†ã‚¤ãƒ¡ãƒ¼ã‚¸ã‚’æŒã£ã¦ã„ã¾ã™ã€‚å‰å›žã®ã€ŒGoogleã®MapReduceã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã‚’Javaã§ç†è§£ã™ã‚‹ã€ã§èª¬æ˜Žã—ãŸã€åˆ†æ•£å‡¦ç†æŠ€è¡“ã§æœ€è¿‘æ³¨ç›®ã‚’æµ´ã³ã¦ã„ã‚‹MapReduceã‚‚Javaã«ã‚ˆã‚‹å®Ÿè£…ãŒã‚ã‚Šã¾ã™ã€‚ ãã‚Œã¯ã€Apache Hadoopãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã§é–‹ç™ºã•ã‚Œã¦ã„ã‚‹ã‚‚ã®ã§ã™ã€‚ã“ã®ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã¯ã€ã‚‚ã¨ã‚‚ã¨ã¯ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®æ¤œç´¢ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§ã‚ã‚‹Ap
tokada 2008/11/19
hadoop

mapreduce
ãƒªãƒ³ã‚¯
Hadoopã®è§£æžè³‡æ–™
ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹åˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ ã€ŒHadoopã€ã«é–¢ã™ã‚‹è§£æžè³‡æ–™ã‚’å…¬é–‹ã•ã›ã¦é ‚ã„ã¦ãŠã‚Šã¾ã™ã€‚ã“ã®èª¿æŸ»ã¯NTTãƒ¬ã‚¾ãƒŠãƒ³ãƒˆæ ªå¼ä¼šç¤¾æ§˜ã¨å…±åŒã§è¡Œã„ã¾ã—ãŸ(ãƒ—ãƒ¬ã‚¹ãƒªãƒªãƒ¼ã‚¹)ã€‚ Hadoopè§£æžè³‡æ–™(PDF), æœ€çµ‚æ›´æ–°: 2008/08/25, å…¬é–‹: 2008/08/25 Hadoopã®å®Ÿéš›ã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«æ–¹æ³•ãªã©ã«ã¤ãã¾ã—ã¦ã¯ã€å¼Šç¤¾å¤ªç”°ã«ã‚ˆã‚‹ä»¥ä¸‹ã®è¨˜äº‹ã‚‚ã”å‚è€ƒä¸‹ã•ã„ã€‚ Hadoopã€hBaseã§æ§‹ç¯‰ã™ã‚‹å¤§è¦æ¨¡åˆ†æ•£ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã‚·ã‚¹ãƒ†ãƒ Hadoopã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã¨ã‚µãƒ³ãƒ—ãƒ«ãƒ—ãƒã‚°ãƒ©ãƒ ã®å®Ÿè¡Œ è¤‡æ•°ãƒžã‚·ãƒ³ã¸Hadoopã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã™ã‚‹
tokada 2008/08/26
hadoop

mapreduce
ãƒªãƒ³ã‚¯
space
A Ruby MapReduce Framework Skynet RubyForge Home Documentation See Skynet at RailsConf 08 Sat Mar 31, 2008 4:25pm â€“ 5:15pm PDT @ Portland Ballroom 255 More Info What is Skynet Skynet is an open source Ruby implementation of Googleâ€™s MapReduce framework, created at Geni. With Skynet, one can easily convert a time-consuming serial task, such as a computationally expensive Rails migration, into a di
tokada 2008/06/21
ruby

mapreduce
ãƒªãƒ³ã‚¯
MapReduce - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼
"MapReduce" ã¯ Google ã®ãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰ã§åˆ©ç”¨ã•ã‚Œã¦ã„ã‚‹ä¸¦åˆ—è¨ˆç®—ã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã®ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ä½œæˆã‚’ã¯ã˜ã‚ã¨ã™ã‚‹ã€å¤§è¦æ¨¡ãªå…¥åŠ›ãƒ‡ãƒ¼ã‚¿ã«å¯¾ã™ã‚‹ãƒãƒƒãƒå‡¦ç†ã‚’æƒ³å®šã—ã¦ä½œã‚‰ã‚ŒãŸã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚ MapReduce ã®é¢ç™½ã„ã¨ã“ã‚ã¯ã€map() ã¨ reduce() ã¨ã„ã†äºŒã¤ã®é–¢æ•°ã®çµ„ã¿åˆã‚ã›ã‚’å®šç¾©ã™ã‚‹ã ã‘ã§ã€å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã«å¯¾ã™ã‚‹æ§˜ã€…ãªè¨ˆç®—å•é¡Œã‚’è§£æ±ºã™ã‚‹ã“ã¨ãŒã§ãã‚‹ç‚¹ã§ã™ã€‚ MapReduce ã®è¨ˆç®—ãƒ¢ãƒ‡ãƒ« map() ã«ã¯ãã®è¨ˆç®—å•é¡Œã®ãƒ‡ãƒ¼ã‚¿ã¨ã—ã¦ã® key-value ãƒšã‚¢ãŒæ¬¡ã€…ã«æ¸¡ã£ã¦ãã¾ã™ã€‚map() ã§ã¯ key-value å€¤ã®ãƒšã‚¢ã‚’ç•°ãªã‚‹è¤‡æ•°ã® key-value ãƒšã‚¢ã«å¤‰æ›ã—ã¾ã™ã€‚reduce() ã«ã¯ã€map() ã§ä½œã£ãŸ key-value ãƒšã‚¢ã‚’åŒä¸€ã® key ã§æŸããŸã‚‚ã®ãŒé †ç•ªã«æ¸¡ã£ã¦ãã¾ã™ã€‚ãã® key-values ãƒšã‚¢ã‚’ä»»æ„ã®å½¢å¼ã«å¤‰æ›ã™ã‚‹ã“ã¨
tokada 2008/05/12
mapreduce
ãƒªãƒ³ã‚¯
1