2009/03/16 ç±³ã¯ã©ã¦ãã©ï¼Clouderaï¼ã¯3æ15æ¥ãJavaåãã®ãªã¼ãã³ã½ã¼ã¹åæ£å¦çãã¬ã¼ã ã¯ã¼ã¯ãHadoopããRed Hatãã¼ã¹ã®Linuxãµã¼ãã«ç°¡æã«ãã£ããã¤ã§ããããã±ã¼ã¸ãCloudera Distribution for Hadoopãããªãªã¼ã¹ãããHadoopã¯ç¾å¨tarãã¼ã«ã§é å¸ããã¦ãã¦ãå©ç¨ã«ã¯ã¤ã³ã¹ãã¼ã«ãå¿ è¦ã ã£ããã¯ã©ã¦ãã©ã¯Cent OSãRed Hat Enterprise Linux 5ãFedora Core 8ãªã©ã§å©ç¨ã§ããRPMããã±ã¼ã¸ãHadoop 0.18.3ãã¼ã¹ã§æä¾ãããã¨ã§ãHadoopã®å®è¡ç°å¢ãæ§æããæ段ãæä¾ãããåæã«å社ã¯ãAmazon EC2ä¸ã§Hadoopåãã¯ã©ã¹ã¿ãç«ã¡ä¸ããã¹ã¯ãªãããæé ãå ¬éããã ã¯ã©ã¦ãã©ã¯2008å¹´10æã«åµæ¥ããã°ããã®ãã³ãã£ã¼ã§ãã¨ã³ã¿ã¼ãã©ã¤ãºã¦ã¼ã¶
Hadoop streaming is a utility that comes with the Hadoop distribution. The utility allows you to create and run map/reduce jobs with any executable or script as the mapper and/or the reducer. For example: $HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/hadoop-streaming.jar \ -input myInputDirs \ -output myOutputDir \ -mapper /bin/cat \ -reducer /bin/wc In the above example, both the mapper and the reduce
ãªã¼ãã«ã¸ã¼ãå®é£ã¬ã é£ã¹ç©ã®é¼»å¡©å¡©(æªã ã«éããã®ããª) ãªã¼ãã«ã¸ã¼ãã¨ããã«ã¬ã¼ããåç¥ã ããã é½å ã«ããããªããªã¼å°éã®ã«ã¬ã¼å±ã§ã ãã±å¼ãªã©ã§å¤§äººæ°ã®æ¬æ ¼æ¬§é¢¨ã«ã¬ã¼ã楽ãããããã ãããªã ãããªããªãã¶ã¤ã¤ã¼ é½å ã®å¥´ãã¯ãããªè¯ãã¢ã³é£ã£ã¦ãã®ã 許ããããâ¦â¦â¦
ä½å¹´ãåã«ããã£ã¦ãããï¼ï¼ã¨ãããããªã¨ã³ããªãæ¸ãã¾ããã ä»ã¯ãå·¡ãå·¡ã£ã¦ãæ¬å½ã«å å®ãã¦ãã¾ãã ãã¾ããªçµé¨ãããã¨ã®å¤§åãã¯ãèªåãä»æµã¾ãã¦ãããã¨ãèªèã§ããããã«ãªããã¨ãªãããã¾ããã ä¸ã®äººã¯ãå¨ãåºããªã¼ã¨æããã¨ãçµæ§æãã¾ããããã¯ãããã¾ã§ã«ãããªãã®ã²ã©ãç®ã«ãã£ã¦ãããããªã®ããããã¾ããã è±ç²çã¨ããå¯é¼»è çã®çç¶ãæ²»çãå°ãã¾ã¨ãã¦ããã¾ããä»ç¾å¨ãç§ãã©ã®ãããªãã¨ãèãã¦ããããã¾ã¨ãã¦ããããã¨èãã¦ãçãæ®ã£ã¦ãã¾ããã®ã§ããã¾ãèªã¿æã®ãã¨ã¯èãã¦æ¸ããã¦ãã¾ããããããè±ç²çãå¯é¼»è çã§å°ã£ã¦ããã®ã§ããã°ãç§ã®èª¿ã¹ãæ å ±ãçµé¨ãå°ãã¯å½¹ç«ã¤ããããã¾ãã ç§ã¯ãã¢ã¬ã«ã®ã¼è©¦é¨ãããçµæãæãã²ã®ãã稲ããã®ä»ããããã«å¯¾ãã¦ã¢ã¬ã«ã®ã¼ãæããããã 1,2æãé¤ãã¦ãå¹´ä¸è±ç²çç¶æ ã ã¨è¨ããã¾ããããªããªããè¡æçã§ããã è±ç²çãã²ã©
ãç¥ãã
ã©ã³ãã³ã°
ã©ã³ãã³ã°
ãªãªã¼ã¹ãé害æ å ±ãªã©ã®ãµã¼ãã¹ã®ãç¥ãã
ææ°ã®äººæ°ã¨ã³ããªã¼ã®é ä¿¡
å¦çãå®è¡ä¸ã§ã
j次ã®ããã¯ãã¼ã¯
kåã®ããã¯ãã¼ã¯
lãã¨ã§èªã
eã³ã¡ã³ãä¸è¦§ãéã
oãã¼ã¸ãéã
{{#tags}}- {{label}}
{{/tags}}