[B! hadoop] j5ik2oã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

j5ik2o id:j5ik2o

hadoopã«é–¢ã™ã‚‹j5ik2oã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (14)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Hadoopï¼†Asakusaã‚’åŸºå¹¹æ¥å‹™ã§ä½¿ã„å€’ã™--ãƒŽãƒ¼ãƒãƒ©ã‚¹ ç¥žæž—é£›å¿—æ°
å°åˆ·ã™ã‚‹ ãƒ¡ãƒ¼ãƒ«ã§é€ã‚‹ ãƒ†ã‚ã‚¹ãƒˆ HTML é›»åæ›¸ç± PDF ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ ãƒ†ã‚ã‚¹ãƒˆ é›»åæ›¸ç± PDF ã‚¯ãƒªãƒƒãƒ—ã—ãŸè¨˜äº‹ã‚’Myãƒšãƒ¼ã‚¸ã‹ã‚‰èªã‚€ã“ã¨ãŒã§ãã¾ã™ æ—¥ç«‹ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã‚ºã¯12æœˆ2æ—¥ã€æ±äº¬ãƒ»å“å·ã«ã¦ã€ŒHadoopãŒå°Žãåˆ†æ•£å‡¦ç†ã«ãŠã‘ã‚‹æ¬¡ä¸–ä»£ã®ãƒãƒƒãƒå‡¦ç†é–‹ç™ºã¨ã¯ã€œAsakusa Frameworkã«ã‚ˆã‚‹Hadoopã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚ºé©ç”¨ã‚»ãƒŸãƒŠãƒ¼ã€œã€ã‚’é–‹å‚¬ã—ãŸã€‚ æœ¬ç¨¿ã§ã¯ãã®ä¸ã‹ã‚‰ã€ãƒŽãƒ¼ãƒãƒ©ã‚¹ãƒ»ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚ºä»£è¡¨å–ç· å½¹å‰¯ç¤¾é•· ç¥žæž—é£›å¿—æ°ã«ã‚ˆã‚‹è¬›æ¼”ã€ŒHadoopã«ã‚ˆã‚‹ãƒãƒƒãƒå‡¦ç†ã®å°Žå…¥ã€ã‚’ç´¹ä»‹ã™ã‚‹ã€‚ Hadoopã‚’å®šç¾©ã™ã‚‹ã®ã«ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã¨ã„ã†è¨€è‘‰ã¯å¿…è¦ã‚ã‚Šã¾ã›ã‚“â€”â€”ç¥žæž—æ°ã¯å†’é ã€ã“ã†åˆ‡ã‚Šå‡ºã—ãŸã€‚ ã„ã¾ã‚„ãƒã‚ºãƒ¯ãƒ¼ãƒ‰ã¨ã—ã¦å®šç€ã—å§‹ã‚ã¦ã„ã‚‹ã€Œãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã€ã ãŒã€ãã®è¨€è‘‰ãŒèªžã‚‰ã‚Œã‚‹ã¨ãã¯ã‚µãƒ–ã‚»ãƒƒãƒˆã®ã”ã¨ãã€Œä¸¦åˆ—åˆ†æ•£å‡¦ç†ã‚·ã‚¹ãƒ†ãƒ ã€ã¨ã—ã¦Hadoopã‚‚å¼•ãåˆã„ã«å‡ºã•ã‚Œã‚‹ã“ã¨ãŒå¤šã„ã€‚ã ãŒç¥žæž—æ°ã¯ã€Œãƒ“ãƒƒã‚°ãƒ‡
j5ik2o 2011/12/09
MRã¯é–¢æ•°åž‹ã«æ…£ã‚Œã¦ãªã„ã¨æ›¸ãã®å¤§å¤‰ã ã‚ˆã€æœ¬å½“ã«ã€‚Asakusafwã¯ä½¿ã£ãŸã»ã†ãŒã„ã„ã€‚

Hadoop

Asakusa
ãƒªãƒ³ã‚¯
Matei Zaharia - Spark
An official Spark homepage is up at spark-project.org. Redirecting you there in 3 seconds.
j5ik2o 2011/08/03
Hadoop

Scala

æ©Ÿä¼šå¦ç¿’
ãƒªãƒ³ã‚¯
1å°æ§‹æˆã®Hadoopã‚’30åˆ†ã§è©¦ã—ã¦ã¿ã‚‹(CentOS + Cloudera)
(å‚è€ƒ) Clouderaç¤¾ã®Hadoopãƒ‘ãƒƒã‚±ãƒ¼ã‚¸ã®æƒ…å ± http://archive.cloudera.com/docs/ å¿…è¦ãªã‚‚ã® ãƒ»CentOS5ã‹CentOS6ã®Linuxç’°å¢ƒ1å°(ã“ã“ã§ã¯CentOS5.6ã¨CentOS6.0ã‚’ä½¿ã„ã¾ã—ãŸã€‚CentOSã®ä»–ãƒãƒ¼ã‚¸ãƒ§ãƒ³ã‚„ã€Fedoraã€Redhatç‰ã§ã‚‚å¤§ä¸ˆå¤«ã ã¨æ€ã„ã¾ã™) ãƒ»ã‚¤ãƒ³ã‚¿ãƒ¼ãƒãƒƒãƒˆæŽ¥ç¶š ãƒ»Sunç¤¾Javaãƒ‘ãƒƒã‚±ãƒ¼ã‚¸(ãƒ‘ãƒƒã‚±ãƒ¼ã‚¸ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ã‚¤ãƒ³ã‚¿ãƒ¼ãƒãƒƒãƒˆã‹ã‚‰å–å¾—) ãƒ»Clouderaç¤¾ã®CDH3ã®Hadoopãƒ‘ãƒƒã‚±ãƒ¼ã‚¸(yumã§ã‚¤ãƒ³ã‚¿ãƒ¼ãƒãƒƒãƒˆã‹ã‚‰ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«) ä½œæ¥æ‰‹é † 0. æº–å‚™ 0-1. Sunç¤¾Javaãƒ‘ãƒƒã‚±ãƒ¼ã‚¸ã®å–å¾— http://java.sun.com/javase/downloads/ã«ã¦ã€ Java SE 6ã®[Download]ãƒœã‚¿ãƒ³ã‚’æŠ¼ã—ã¦å‡ºã‚‹ã€ŒJava SE Downloadsã€ã®ãƒšãƒ¼ã‚¸ã‹ã‚‰å¿…è¦ãªã‚‚ã®
j5ik2o 2011/07/19
hadoop
ãƒªãƒ³ã‚¯
Scalaã§Hadoopã‚’ä½¿ã£ã¦ã¿ãŸã€‚ - ã¿ãšã´ãƒ¼æ—¥è¨˜
å¤§åå¤å±‹ã“ã¨Google ã‚°ãƒ«ãƒ¼ãƒ—ã®å®¿é¡Œã§ã€ŒHadoopã‚’å‹•ã‹ã—ã¦ã¿ã‚‹ã“ã¨ã€ã¨ã„ã†ã®ãŒã‚ã£ãŸã®ã§ã€è©¦ã—ã¦ã¿ã¾ã—ãŸã€‚Javaã‚’ä½¿ã†æ°—ã«ã¯ãªã‚‰ãªã„ã®ã§ã€Scalaã§ã€‚ ã‚³ãƒ¼ãƒ‰ Hadoopã®2ç« ã®ã‚³ãƒ¼ãƒ‰ã‚’ç´ ç›´ã«å†™çµŒã™ã‚‹ã€‚ä¸€ãƒ•ã‚¡ã‚¤ãƒ«ä¸€ã‚¯ãƒ©ã‚¹ã®åˆ¶é™ãŒãªã„ã®ã¯ã„ã„ãã€‚ import java.util.Iterator import org.apache.hadoop.fs.Path import org.apache.hadoop.io._ import org.apache.hadoop.mapred._ class MapExample extends MapReduceBase with Mapper[LongWritable,Text,Text,IntWritable] { def map(key : LongWritable, value : Text, output : OutputC
j5ik2o 2011/07/16
Hadoop

Scala
ãƒªãƒ³ã‚¯
FacebookãŒHBaseã‚’å¤§è¦æ¨¡ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ å‡¦ç†ã«åˆ©ç”¨ã—ã¦ã„ã‚‹ç†ç”±ï¼ˆå‰ç·¨ï¼‰
Facebookã¯å¤§è¦æ¨¡ãªãƒ‡ãƒ¼ã‚¿å‡¦ç†ã®åŸºç›¤ã¨ã—ã¦HBaseã‚’åˆ©ç”¨ã—ã¦ã„ã¾ã™ã€‚ãªãœFacebookã¯HBaseã‚’ç”¨ã„ã¦ã„ã‚‹ã®ã‹ã€ã©ã®ã‚ˆã†ã«åˆ©ç”¨ã—ã¦ã„ã‚‹ã®ã§ã—ã‚‡ã†ã‹ï¼Ÿ 7æœˆ1æ—¥ã«éƒ½å†…ã§è¡Œã‚ã‚ŒãŸå‹‰å¼·ä¼šã§ã€Facebookã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã§ã‚ã‚‹ã‚¸ãƒ§ãƒŠã‚µãƒ³ãƒ»ã‚°ãƒ¬ã‚¤ï¼ˆJonathan Grayï¼‰æ°ã«ã‚ˆã‚‹è§£èª¬ãŒè¡Œã‚ã‚Œã¾ã—ãŸã€‚ è§£èª¬ã¯ã»ã¼ã‚¹ãƒ©ã‚¤ãƒ‰ã®å†…å®¹ãã®ã¾ã¾ã§ã—ãŸã€‚å½“æ—¥ä½¿ã‚ã‚ŒãŸæ—¥æœ¬èªžè¨³ã•ã‚ŒãŸã‚¹ãƒ©ã‚¤ãƒ‰ãŒå…¬é–‹ã•ã‚Œã¦ã„ã‚‹ã®ã§ã€ãƒã‚¤ãƒ³ãƒˆã¨ãªã‚‹ãƒšãƒ¼ã‚¸ã‚’ç´¹ä»‹ã—ã¾ã—ã‚‡ã†ã€‚ Realtime Apache Hadoop at Facebook ãªãœãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãƒ‡ãƒ¼ã‚¿ã®åˆ†æžã«ã€Hadoop/HBaseã‚’ä½¿ã†ã®ã‹ï¼Ÿ MySQLã¯å®‰å®šã—ã¦ã„ã‚‹ãŒã€åˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ ã¨ã—ã¦è¨è¨ˆã•ã‚Œã¦ãŠã‚‰ãšã€ã‚µã‚¤ã‚ºã«ã‚‚ä¸Šé™ãŒã‚ã‚‹ã€‚ä¸€æ–¹ã€Hadoopã¯ã‚¹ã‚±ãƒ¼ãƒ©ãƒ–ãƒ«ã ãŒãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ãŒé›£ã—ãã€ãƒ©ãƒ³ãƒ€ãƒ ãªæ›¸ãè¾¼ã¿ã‚„èªã¿è¾¼ã¿ã«å‘ã„ã¦ã„ãªã„ã€‚ Faceb
j5ik2o 2011/07/05
HBase

hadoop

Facebook
ãƒªãƒ³ã‚¯
http://jonhnnyweslley.net/blog/shadoop/
j5ik2o 2011/02/25
hadoop

scala
ãƒªãƒ³ã‚¯
æ¬¡ä¸–ä»£Hadoopã¯10,000å°ã«ã‚¹ã‚±ãƒ¼ãƒ«ã‚¢ã‚¦ãƒˆã—ã€MapReduceä»¥å¤–ã®ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã‚’ã‚‚ã‚µãƒãƒ¼ãƒˆã™ã‚‹ - nokunoã®æ—¥è¨˜
Yahoo!ã®ãƒ–ãƒã‚°ã«Hadoopã«é–¢ã™ã‚‹èˆˆå‘³æ·±ã„è¨˜äº‹ãŒä¸ŠãŒã£ã¦ã„ãŸã®ã§ç´¹ä»‹ã—ãŸã„ã¨æ€ã„ã¾ã™ã€‚ã‹ãªã‚Šãƒœãƒªãƒ¥ãƒ¼ãƒ ã®ã‚ã‚‹è¨˜äº‹ã§ç¿»è¨³ã™ã‚‹ã®ã¯éª¨ãŒæŠ˜ã‚Œã¾ã—ãŸã€‚The Next Generation of Apache Hadoop MapReduce Â· Yahoo! Hadoop BlogåŽŸé¡Œã¯ã‚·ãƒ³ãƒ—ãƒ«ã«ã€Œæ¬¡ä¸–ä»£ã®Apache Hadoop MapReduceã€ã§ã™ã€‚ æ¦‚è¦å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’æ‰±ã†ãƒ“ã‚¸ãƒã‚¹ã§ã¯ã€å°‘æ•°ã®å¤§è¦æ¨¡ãªã‚¯ãƒ©ã‚¹ã‚¿ã®ã»ã†ãŒå¤šæ•°ã®å°è¦æ¨¡ãªã‚¯ãƒ©ã‚¹ã‚¿ã‚ˆã‚Šã‚‚å®‰ä¾¡ã«ãªã‚Šã¾ã™ã€‚å¤§è¦æ¨¡ã‚¯ãƒ©ã‚¹ã‚¿ã¯å¤šãã®ãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆã‚’å‡¦ç†ã—ã€å¤šãã®ã‚¸ãƒ§ãƒ–ã¨å¤šãã®ãƒ¦ãƒ¼ã‚¶ã‚’ã‚µãƒãƒ¼ãƒˆã™ã‚‹å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚Apacheã®Hadoop MapReduceãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã¯ã ã„ãŸã„4,000å°ç¨‹åº¦ã§ã‚¹ã‚±ãƒ¼ãƒ©ãƒ“ãƒªãƒ†ã‚£ã®é™ç•ŒãŒæ¥ã¾ã™ã€‚ç§ãŸã¡ã¯æ¬¡ä¸–ä»£ã®Apache Hadoop MapReduceã‚’é–‹ç™ºã—ã¦ãŠã‚Šã€ãã“ã§ã¯ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã‚’æ±Ž
j5ik2o 2011/02/16
hadoop

mapreduce
ãƒªãƒ³ã‚¯
Scala ã§ Hadoop ã‚’è©¦ã—ã¦ã¿ã‚‹ | Atsushi TATSUMA Web Page
ã¯ã˜ã‚ã« Scala ã§ Hadoop ç”¨ã® jar ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ä½œã£ã¦ã¿ã¾ã—ãŸã€‚ä½œã£ã¦ã¿ãŸã®ã¯ã‚ˆãã‚ã‚‹å˜èªžã‚’æ•°ãˆã‚‹ãƒ—ãƒã‚°ãƒ©ãƒ ã§ã™ã€‚ ç’°å¢ƒã¯ã€Debian GNU/Linux ã« Cloudera ç¤¾ã® Hadoop ã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã—ãŸã‚‚ã®ã§ã™ã€‚ æº–å‚™ Scala ã§ä½œã£ãŸ jar ãƒ•ã‚¡ã‚¤ãƒ«ã‚’å®Ÿè¡Œã™ã‚‹ãŸã‚ã«ã€scala-library.jar ã‚’ Hadoop ã®ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã«é…ç½®ã—ã¾ã™ã€‚ ã“ã®ä½œæ¥ã¯ã€ãƒžã‚¹ã‚¿ãƒ¼ã¨ã‚¹ãƒ¬ãƒ¼ãƒ–ã®å…¨ãƒžã‚·ãƒ³ã§è¡Œã†å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚ [bash] $ cd /usr/lib/hadoop/lib/ $ sudo ln -s /usr/local/lib/scala/lib/scala-library.jar scala-library.jar [/bash] ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã®è¿½åŠ ã‚’åæ˜ ã•ã›ã‚‹ãŸã‚ tasktracker ã¨ jobtracker ã®å†èµ·å‹•ãŒå¿…è¦ã«ãª
j5ik2o 2011/01/30
Scala

Hadoop
ãƒªãƒ³ã‚¯
ãã‚ãã‚Hadoopã«ã¤ã„ã¦ã²ã¨ã“ã¨è¨€ã£ã¦ãŠãã‹ - nokunoã®æ—¥è¨˜
ã‚‚ã†ã“ã®æ‰‹ã®è©±é¡Œã¯å‡ºå°½ãã—ãŸæ„ŸãŒã‚ã‚Šã¾ã™ãŒã€æœ€è¿‘Hadoopã«ã¤ã„ã¦è€ƒãˆã‚‹ã“ã¨ãŒå¤šã„ã®ã§ã€ã‚¨ãƒ³ãƒˆãƒªã«ã—ã¦ã¿ã¾ã™ã€‚ãªãŠã€ã“ã“ã§ã¯ãƒ™ãƒ¼ã‚·ãƒƒã‚¯ãªMapReduce+HDFSã®ã“ã¨ã‚’Hadoopã¨å‘¼ã¶ã“ã¨ã«ã—ã¾ã™ã€‚ Hadoopã¨ã¯Hadoopã¨ã¯è¨€ã‚ãšã¨çŸ¥ã‚ŒãŸGoogleã®MapReduce/GFSã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ã‚¯ãƒãƒ¼ãƒ³ã§ã™ã€‚MapReduceã§ã¯ãƒ—ãƒã‚°ãƒ©ãƒžã¯Mapã¨Reduceã¨ã„ã†2ã¤ã®é–¢æ•°ã‚’æ›¸ãã ã‘ã§ã€ä¸¦åˆ—åˆ†æ•£å‡¦ç†ã‚’ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ã“ã‚Œã¯(1) ãƒ‡ãƒ¼ã‚¿ã‚’å®Ÿéš›ã«æŒã¤ãƒžã‚·ãƒ³ã«ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’é…å¸ƒã™ã‚‹ (2) Mapã¨Reduceã‚’ã¤ãªãShuffleãƒ•ã‚§ãƒ¼ã‚ºã§ã‚ãƒ¼ã‚’ã‚°ãƒ«ãƒ¼ãƒ—åŒ–ã—ã¦ã‚½ãƒ¼ãƒˆã™ã‚‹ã€(3) éšœå®³æ™‚ã®ãƒ•ã‚§ãƒ¼ãƒ«ã‚ªãƒ¼ãƒãƒ¼ã‚„ãƒ¬ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã€ã¨ã„ã£ãŸå‡¦ç†ã‚’ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯å´ãŒå—ã‘æŒã¤ã“ã¨ã«ã‚ˆã£ã¦ã€ãƒ—ãƒã‚°ãƒ©ãƒžå´ã®è² æ‹…ã‚’æ¸›ã‚‰ã™ã‚‚ã®ã§ã™ã€‚GFSã«å¯¾å¿œã™ã‚‹HDFSã«ã¯ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ã‚¯ãƒ©ã‚¹ã‚¿ã«åˆ†æ•£ã—ã¦ä¿å˜
j5ik2o 2011/01/05
hadoop
ãƒªãƒ³ã‚¯
Hadoopã§ã‚µãƒ³ãƒ—ãƒ«ä½œæˆ - å¿˜ã‚ŒãŒã¡ãªã‚ãªãŸã¸
j5ik2o 2010/10/01
hadoop
ãƒªãƒ³ã‚¯
Hadoopãƒ¢ãƒ‡ãƒªãƒ³ã‚°åº§è«‡ä¼š#2 - ç§‘å¦ã¨éžç§‘å¦ã®è¿·å®®
æ¦‚è¦ ã‚¤ãƒ™ãƒ³ãƒˆå Hadoopã‚’ä¸å¿ƒã¨ã—ãŸåˆ†æ•£ç’°å¢ƒã§ã®é–‹ç™ºæ–¹æ³•è«–ãƒ»ãƒ¢ãƒ‡ãƒªãƒ³ã‚°ãƒ»è¨è¨ˆæ‰‹æ³•ç‰ã«ã¤ã„ã¦ã®åº§è«‡ä¼š(ç¬¬äºŒå›ž) URL http://atnd.org/events/5987 æ—¥æ™‚ 2010/07/26 18:00 - 20:00 å ´æ‰€ ã‚¹ã‚¿ãƒ¼ç ”ä¿®ã‚»ãƒ³ã‚¿ãƒ¼ã€€å¾¡èŒ¶ãƒŽæ°´ Sunï¼ˆã‚µãƒ³ï¼‰1F twitterãƒãƒƒã‚·ãƒ¥ã‚¿ã‚° #hadoopModeling ã‚¹ãƒ¼ãƒ„è‹¥å¹²å¤šã‚ å¹´é½¢ã‚„ã‚„é«˜ã‚ å¥³æ€§ã»ã¼çš†ç„¡ #1 @shot6 å¤§è°·æ™‹å¹³ ç¾çŠ¶ã¨ç‰¹å¾´ Hadoop ã®ç¾çŠ¶ ä¸Šä½ãƒ¬ã‚¤ãƒ¤ã®é–‹ç™ºãŒãƒ›ãƒƒãƒˆ æ—¥æœ¬èªžã‚‚å……å®Ÿ Nosql ã®ç¾çŠ¶ åŠ ç†±ã—éŽãŽ Twitter ã®ãƒ‹ãƒ¥ãƒ¼ã‚¹ã¯ã„ã„å†·å´å‰¤ RDBMS ã®ç¾çŠ¶ æˆç†Ÿ Mysql ã®é–‹ç™ºè€…ã¯Mariadb & Drizzle ã¸ ãƒ—ãƒ¬ã‚¤ãƒ¤ãƒ¼ã‚‚æ–°è¦å‚å…¥è€…ã‚‚æ¸›å°‘ Hadoop ã®ç‰¹å¾´ big data Yahoo 3PB/day Facebook 90TB/day Nos
j5ik2o 2010/07/30
hadoop
ãƒªãƒ³ã‚¯
Hadoopãƒªãƒ³ã‚¯ã¾ã¨ã‚(1) - ç§‘å¦ã¨éžç§‘å¦ã®è¿·å®®
Part1 / Part2 æ›´æ–°å±¥æ´ 2010/06/20 ãƒªãƒ³ã‚¯è¿½åŠ å…¥é–€ã€äº‹ä¾‹ç´¹ä»‹ã€ãƒ‹ãƒ¥ãƒ¼ã‚¹ Part2ã¸ç§»å‹• EC2ã€Pigã€MapReduceã€HDFS æ–°è¦è¿½åŠ æ€§èƒ½æ¸¬å®š å…¬å¼ Welcome to Apache Hadoop! æ—¥æœ¬èªžè¨³ Hadoopãƒ¦ãƒ¼ã‚¶ãƒ¼ä¼š Welcome to Hadoop MapReduce! "å¤§è¦æ¨¡ãªè¨ˆç®—ãƒŽãƒ¼ãƒ‰ãƒ»ã‚¯ãƒ©ã‚¹ã‚¿ä¸Šã«ãŠã„ã¦è†¨å¤§ãªãƒ‡ãƒ¼ã‚¿ã‚’é«˜é€Ÿã§ä¸¦åˆ—å‡¦ç†ã™ã‚‹ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‚’ä½œæˆã™ã‚‹ãŸã‚ã®ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ãƒ¢ãƒ‡ãƒ«ãŠã‚ˆã³ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯" Welcome to Pig! "å¤§è¦æ¨¡ãªãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆã‚’åˆ†æžã™ã‚‹ãŸã‚ã®ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ""Pig ã®è¨€èªžãƒ¬ã‚¤ãƒ¤ã‚’æ§‹æˆã—ã¦ã„ã‚‹ã®ã¯ã€Pig Latin ã¨å‘¼ã°ã‚Œã‚‹ãƒ†ã‚ã‚¹ãƒˆãƒ™ãƒ¼ã‚¹ã®è¨€èªž" wikipedia Apache Hadoop - Wikipedia, the free encyclopedia Apa
j5ik2o 2010/07/30
hadoop
ãƒªãƒ³ã‚¯
Hadoopã‚·ã‚¹ãƒ†ãƒ æ§‹ç¯‰ã®ãƒŽã‚¦ãƒã‚¦
å‰å›žã¾ã§ã®è¨˜äº‹ã§ã¯ã€HadoopãŒã©ã®ã‚ˆã†ãªèƒŒæ™¯ã§ç™»å ´ã—ãŸã®ã‹ã€ã©ã®ã‚ˆã†ãªèƒ½åŠ›ã‚’æŒã£ã¦ã„ã‚‹ã®ã‹ã€ãƒªãƒ¬ãƒ¼ã‚·ãƒ§ãƒŠãƒ«ãƒ»ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ç®¡ç†ã‚·ã‚¹ãƒ†ãƒ ï¼ˆRDBMSï¼‰ã‚„Key-Value Storeï¼ˆKVSï¼‰åž‹ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã¨ã¯ã©ã®ã‚ˆã†ã«ç•°ãªã‚‹ã®ã‹ã‚’è§£èª¬ã—ã¦ãã¾ã—ãŸã€‚ ä»Šå›žã¯ã€Hadoopã‚’å®Ÿéš›ã«ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚ºï¼ˆä¼æ¥æƒ…å ±ã‚·ã‚¹ãƒ†ãƒ æ§‹ç¯‰ï¼‰ç”¨é€”ã«æ´»ç”¨ã™ã‚‹ã«ã‚ãŸã£ã¦ã€æŠ¼ã•ãˆã¦ãŠããŸã„ãƒã‚¤ãƒ³ãƒˆã‚’è§£èª¬ã—ã¾ã™ã€‚ Hadoopæ´»ç”¨ã®èª²é¡Œ Hadoopã¯ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã¨ã—ã¦é–‹ç™ºã•ã‚Œã¦ã„ã¾ã™ã€‚2006å¹´ã«Doug Cuttingæ°ã«ã‚ˆã£ã¦Hadoopãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆãŒç«‹ã¡ä¸Šã’ã‚‰ã‚Œã¦ä»¥æ¥ã€ã»ã¼4å¹´ãŒçµŒéŽã—ã€ç¾åœ¨ã§ã¯Apache Softwareè²¡å›£ãŒæ”¯æ´ã™ã‚‹ãƒˆãƒƒãƒ—ãƒ»ãƒ¬ãƒ™ãƒ«ãƒ»ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã¨ã—ã¦å¤šæ•°ã®é–‹ç™ºè€…ãŒå‚åŠ ã—ã¦ã„ã¾ã™ã€‚ ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆãŒç«‹ã¡ä¸ŠãŒã£ãŸå½“æ™‚ã€Hadoopã¯ã‚ãšã‹20ãƒŽãƒ¼ãƒ‰ã®ã‚¯ãƒ©ã‚¹ã‚¿ã§å‹•ä½œã—ã¦ã„ã¾ã—ãŸã€‚ç¾åœ¨ã§ã¯ã€ç±³Ya
j5ik2o 2010/06/26
Hadoop
ãƒªãƒ³ã‚¯
ÄÄƒng nháºp alo 789 Cá» báº¡c trá»±c tuyáº¿n hÃ ng Ä‘áº§u | 2024 Best Betting Sites
alo 789 Ä‘Äƒng nháºp HÃ£y tham gia nhá»¯ng trang web hÃ ng Ä‘áº§u Ä‘á»ƒ tráº£i nghiá»‡m cá» báº¡c trá»±c tuyáº¿n vÃ tÄƒng cÆ¡ há»™i giÃ nh giáº£i lá»›n cÃ¹ng vá»›i pháº§n thÆ°á»Ÿng háº¥p dáº«n, giÃºp quyáº¿t Ä‘á»‹nh dá»… dÃ ng hÆ¡n. Truy cáºp trang web hÃ ng Ä‘áº§u Ä‘á»ƒ tham gia slot game vÃ tÄƒng cÆ¡ há»™i chiáº¿n tháº¯ng báº±ng cÃ¡ch Ä‘áº·t cÆ°á»£c sau khi nghiÃªn cá»©u! Chá»n trÃ² cÃ¡ cÆ°á»£c trá»±c tuyáº¿n phá»• biáº¿n, Ä‘Äƒng kÃ½ thÃ nh viÃªn vÃ báº¯t Ä‘áº§u tráº£i nghiá»‡m ngay hÃ´m nay. SÃ n cÃ¡ cÆ°á»£c
j5ik2o 2010/06/24
hadoop
ãƒªãƒ³ã‚¯
1