[B! mapreduce] hirose31ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

hirose31 id:hirose31

mapreduceã«é–¢ã™ã‚‹hirose31ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (11)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Googleã®MapReduceã¯åƒ•ãŸã¡ã«å¿…è¦ã‹ï¼Ÿ - ãã—ã ã®ã¯ã¦ãª
ã¨ã„ã†ã“ã¨ã§ã€Google MapReduceã®å®Ÿè£…ã§ã‚ã‚‹Hadoopã‚’ä½¿ã£ãŸMapReduceã¨ã€JMSã‚’ä½¿ã£ãŸMapReduceã‚’ã‚„ã£ã¦ã¿ã¾ã—ãŸã€‚ ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚ãƒ¥ãƒ¼ã‚’ä½¿ã£ã¦åˆ†æ•£MapReduceã‚’å®Ÿè£…ã™ã‚‹ Hadoopã§ã®MapReduceã‚’æ°—è»½ã«è©¦ã™ã‚µãƒ³ãƒ—ãƒ« ã“ã‚Œä½•ã®ãŸã‚ã«ã‚„ã£ãŸã‹ã¨ã„ã†ã¨ã€ãã“ã‚‰ã«ã‚ã‚‹ã‚ˆã†ãªæ•°åå°è¦æ¨¡ã®ã‚µãƒ¼ãƒãƒ¼ã‚’å‰æã¨ã—ãŸã¨ãã«ã€Hadoopã®æœ‰åŠ¹æ€§ã€ã²ã„ã¦ã¯ãã®å…ƒã«ãªã£ã¦ã‚‹Google MapReduceã®æœ‰åŠ¹æ€§ã«ã¤ã„ã¦ç–‘å•ã«æ€ã£ãŸã‹ã‚‰ã§ã™ã€‚ãã“ã§ã€ã¡ã‚‡ã£ã¨è©¦ã—ã¦ã¿ãŸã€ã¨ã€‚ ã“ã“ã§ã€ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚ãƒ¥ãƒ¼ã‚’ä½¿ã£ãŸå ´åˆã«1ç§’ã§ã§ãã¦ãŸå‡¦ç†ãŒã€Hadoopã‚’ä½¿ã†ã¨ã‚¹ã‚¿ãƒ³ãƒ‰ã‚¢ãƒãƒ³ãƒ¢ãƒ¼ãƒ‰ã§ã‚‚40ç§’è¿‘ãã‹ã‹ã‚Šã¾ã—ãŸã€‚æ“¬ä¼¼åˆ†æ•£ãƒ¢ãƒ¼ãƒ‰ã ã¨4åˆ†è¿‘ãã§ã™ã€‚ ã„ãã‚‰Hadoopã®å®Ÿè£…ãŒã²ã©ã„ã¨ã—ã¦ã‚‚ã€ã“ã‚Œã¯ã‚ã‚“ã¾ã‚Šã§ã™ã€‚ Googleã§ã®å®Ÿè£…ã¯ã‚‚ã£ã¨åŠ¹çŽ‡çš„ãªã‚‚ã®ã«ãªã£ã¦ã„ã‚‹ã¨æ€ã„ã¾ã™ãŒã€ã
hirose31 2009/02/18
mapreduce
ãƒªãƒ³ã‚¯
MapReduce frameworkÂ Disco - High Scalability -
Disco is an open-source implementation of the MapReduce framework for distributed computing. Â It was started at Nokia Research Center as a lightweight framework for rapid scripting of distributed data processing tasks. Â The Disco core is written in Erlang. The MapReduce jobs in Disco are natively described as Python programs, which makes it possible to express complex algorithmic and data process
hirose31 2008/09/08
mapreduce

erlang
ãƒªãƒ³ã‚¯
Sign in - Google Accounts
Not your computer? Use a private browsing window to sign in. Learn more about using Guest mode
hirose31 2008/05/13
ã‚¹ãƒ†ãƒƒãƒ—è¿½ã£ã¦ã‚‹è³‡æ–™ãŒã‚ˆã•ã’ http://mr.iap.2008.googlepages.com/home

mapreduce
ãƒªãƒ³ã‚¯
Hadoopã€hBaseã§æ§‹ç¯‰ã™ã‚‹å¤§è¦æ¨¡åˆ†æ•£ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã‚·ã‚¹ãƒ†ãƒ ï¼šCodeZine
ã¯ã˜ã‚ã«ã€€ã“ã®é€£è¼‰ã§ã¯ã€å¤§è¦æ¨¡åˆ†æ•£è¨ˆç®—ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã€ŒHadoopã€ã¨ã€ãã®ä¸Šã«ã¤ãã‚‰ã‚ŒãŸå¤§è¦æ¨¡åˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã€ŒhBaseã€ã®ä»•çµ„ã¿ã¨ç°¡å˜ãªã‚µãƒ³ãƒ—ãƒ«ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‚’ç´¹ä»‹ã—ã¾ã™ã€‚Hadoopã¨hBaseã¯ã€Googleã®åŸºç›¤ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚¯ãƒãƒ¼ãƒ³ã§ã™ã€‚æ©Ÿèƒ½ã‚„ã‚³ãƒ³ã‚»ãƒ—ãƒˆã«ã¤ã„ã¦ã¯ã€GoogleãŒç™ºè¡¨ã—ã¦ã„ã‚‹å¦è¡“è«–æ–‡ã«ä¾ã£ã¦ã„ã¾ã™ã€‚ã€€ã“ã‚Œã‚‰ã®å¦è¡“è«–æ–‡ã«ã‚ˆã‚‹ã¨ã€Googleã§ã¯å¤§è¦æ¨¡åˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã€ŒGoogle File Systemã€ã€å¤§è¦æ¨¡åˆ†æ•£è¨ˆç®—ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã€ŒMapReduceã€ã€å¤§è¦æ¨¡åˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã€ŒBigTableã€ã€åˆ†æ•£ãƒãƒƒã‚¯ã‚µãƒ¼ãƒ“ã‚¹ã€ŒChubbyã€ã¨ã„ã†4ã¤ã®ã‚¤ãƒ³ãƒ•ãƒ©ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ãŒä½¿ã‚ã‚Œã¦ã„ã¾ã™ã€‚ å›³1ã«Googleã®åŸºç›¤æŠ€è¡“é–“ã®ä¾å˜é–¢ä¿‚ã€ãã—ã¦ãã‚Œã«å¯¾å¿œã™ã‚‹OSSã®å¯¾å¿œé–¢ä¿‚ã‚’ç¤ºã—ã¾ã—ãŸã€‚ã¾ãšã¯å¯¾å¿œã™ã‚‹Googleã®åŸºç›¤æŠ€è¡“ãã‚Œãžã‚Œã®æ©Ÿèƒ½ã‚„ç‰¹å¾´ã‚’ã–ã£ãã‚Šã¨
hirose31 2008/05/01
hadoop

hBase

bigtable

mapreduce
ãƒªãƒ³ã‚¯
Database People Hating onÂ MapReduce - High Scalability -
Update: Typical Programmer tackles the technical issues in Relational Database Experts Jump The MapReduce Shark. The culture clash is still what fascinates me. David DeWitt writes in the Database Column that MapReduce is a major step backwards: A giant step backward in the programming paradigm for large-scale data intensive applications A sub-optimal implementation, in that it uses brute force ins
hirose31 2008/01/19
mapreduce
ãƒªãƒ³ã‚¯
http://www.databasecolumn.com/2008/01/mapreduce-a-major-step-back.html
hirose31 2008/01/19
mapreduce
ãƒªãƒ³ã‚¯
Hadoop
13. $ env | grep JAVA JAVA_HOME=/System/Library/Frameworks/JavaVM.framework/Versions/CurrentJDK/Home $ java -version java -versionjava version quot;1.5.0_07quot;Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_07-154)Java HotSpot(TM) Client VM (build 1.5.0_07-87, mixed mode, sharing) $ curl -O http://www.apache.org/dist/lucene/hadoop/stable/hadoop-0.13.0.tar.gz $ tar zxvf hadoop-0.13.
hirose31 2008/01/18
>ã‹ã‚ã„ããªã„ãƒ»ãƒ»ãƒ»

hadoop

mapreduce
ãƒªãƒ³ã‚¯
GoogleÂ Architecture - High Scalability -
Update 2: Sorting 1 PB with MapReduce. PB is not peanut-butter-and-jelly misspelled. It's 1 petabyte or 1000 terabytes or 1,000,000 gigabytes. It took six hours and two minutes to sort 1PB (10 trillion 100-byte records) on 4,000 computers and the results were replicated thrice on 48,000 disks. Update: Greg Linden points to a new Google article MapReduce: simplified data processing on large cluster
hirose31 2008/01/13
google

architecture

mapreduce

bigtable

googlefs
ãƒªãƒ³ã‚¯
c-sq.com
This domain is registered at Dynadot.com. Website coming soon.
hirose31 2008/01/06
ã€Žã‚µãƒ–ã‚»ãƒŸãƒŠãƒ¼ç¬¬2å›žãƒãƒ³ã‚ºã‚¢ã‚¦ãƒˆã€ppt

mapreduce

sawzall

hadoop
ãƒªãƒ³ã‚¯
Wakhok ãƒžãƒ«ãƒ¬ã‚¯ãƒ»ã‚µãƒ–ã‚»ãƒŸãƒŠãƒ¼ ç¬¬äºŒå›žã€ŒMapReduceã¨Sawzallã€ - monjudohâ€™s diary
ã¯ã˜ã‚ã«ã€ã‚µãƒ–ã‚¿ã‚¤ãƒˆãƒ«å¾ŒåŠã®Sawzallã¯MapReduceç”¨ã®DSLã§ã“ã‚ŒãŒçµæ§‹å‡„ã„ä¸Šã«ã€ GFSã‚„MapReduceã®ã‚ˆã†ã«ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ä»£æ›¿ç‰©ãŒãªã„ã®ã ãã†ã§ã™ãŒã€ æ™‚é–“ãŒãªã„ã®ã§è©³ã—ã„è©±ã¯èžã‘ã¾ã›ã‚“ã§ã—ãŸã€‚ å¾Œæ—¥å…¬é–‹ã•ã‚Œã‚‹è¬›æ¼”è³‡æ–™ã«è¼‰ã£ã¦ã‚‹ã¿ãŸã„ã§ã™ã€‚ 2007/12/31è¿½è¨˜ 2007/12/20ã«è³‡æ–™ãŒå…¬é–‹ã•ã‚Œã¾ã—ãŸã€‚ ä¸¸å±±å…ˆç”Ÿãƒ¬ã‚¯ãƒãƒ£ãƒ¼ã‚·ãƒªãƒ¼ã‚º2007-2008ç¬¬1å›žã€ŒGoogleã®åˆ†æ•£å‡¦ç†æŠ€è¡“ã€ ã“ã¡ã‚‰ã®ä¸‹ã«ã‚ã‚‹ã€Œã‚µãƒ–ã‚»ãƒŸãƒŠãƒ¼ç¬¬2å›žãƒãƒ³ã‚ºã‚¢ã‚¦ãƒˆã€ã¨ã„ã†PDFã§ã™ã€‚ MapReduceã®ä½ç½®ä»˜ã‘ é–¢æ•°åž‹ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ãƒ¢ãƒ‡ãƒ«ã«åŸºã¥ã„ã¦ã€å¤§è¦æ¨¡ãªãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆã®å‡¦ç†ãƒ»ç”Ÿæˆã‚’è¡Œã†ã‚‚ã® MapReduceã¨ã„ã†ã®ã¯ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã®åå‰ã§ã‚ã‚Šã€ Googleã§å®Ÿéš›ã«ç¨¼å‹•ã—ã¦ã„ã‚‹ãã®å®Ÿè£…ã®åå‰ã§ã‚‚ã‚ã‚‹ã€‚ MapReduceï¼šæ•°ä¸‡å°è¦æ¨¡ã®åˆ†æ•£å‡¦ç†ãŒå®Ÿéš›ã«ã¡ã‚ƒã‚“ã¨å‹•ã„ã¦ã„ã‚‹ (ä¸€æ–¹ã€grid
hirose31 2007/12/14
mapreduce
ãƒªãƒ³ã‚¯
OBB vs AABB - Radium Software Development
This domain may be for sale!
hirose31 2006/09/15
algorithm

mapreduce

google
ãƒªãƒ³ã‚¯
1