[B! hadoop] ftnkã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

ftnk id:ftnk

hadoopã«é–¢ã™ã‚‹ftnkã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (12)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã®Hadoopè¬›æ¼”è³‡æ–™ã‚’ç´¹ä»‹ã—ã¾ã™
ã“ã‚“ã«ã¡ã¯ã€‚åºƒå ±ã‚¹ã‚¿ãƒƒãƒ•ã®æ¥¢å´Žã§ã™ã€‚ 9æœˆ10æ—¥ã€11æ—¥ã®2æ—¥é–“é–‹å‚¬ã•ã‚ŒãŸã€Œã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹2010 Tokyo/Fallã€ã«ã¦ã€ Yahoo! JAPANã¯Hadoopã«ã¤ã„ã¦è¬›æ¼”ã•ã›ã¦ã„ãŸã ãã¾ã—ãŸã€‚å¤šãã®æ–¹ã«ã”å‚åŠ ã„ãŸã ãã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã™ã€‚ ï¼ˆå†™çœŸï¼šæ˜Žæ˜Ÿå¤§å¦ãƒ»æ—¥é‡Žã‚ãƒ£ãƒ³ãƒ‘ã‚¹ã«ã¦ï¼‰ ã“ã“ã§ã¯ã€å½“æ—¥è¬›æ¼”ã§ä½¿ç”¨ã—ãŸãƒ—ãƒ¬ã‚¼ãƒ³è³‡æ–™ã‚’ç´¹ä»‹ã•ã›ã¦ã„ãŸã ãã¾ã™ã€‚ â—Hadoopã€€ï½žYahoo! JAPANã®æ´»ç”¨ã«ã¤ã„ã¦ï½ž ãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ R&Dçµ±æ‹¬æœ¬éƒ¨ è§’ç”°ç›´è¡Œã€å‰ç”°ä¸€æ˜Ÿ
ftnk 2010/09/16
yahoo

hadoop
ãƒªãƒ³ã‚¯
Adobe releases their Puppet recipes for automating Hadoop/HBase deployments
Puppet is the industry standard for IT automation. Modernize, manage and bring your hybrid infrastructure into compliance through Puppet's powerful continuous automation.
ftnk 2010/06/03
puppet

hadoop
ãƒªãƒ³ã‚¯
Automating Hadoop/HBase deployments with Puppet
The guys from the Adobe SaaS team â€” same guys that shared with us their experience and reasons for using HBase â€” have â˜ž open sourced their Puppet[1] recipes for automating Hadoop/HBase deployments. Right now we are open-sourcing on GitHub, Puppet recipes for: creating the user under which the entire hstack runs.changing system settings, like the ssh keys, authorizing machines to talk to each other
ftnk 2010/06/03
puppet

hadoop
ãƒªãƒ³ã‚¯
HadoopAndScalaPackagesForCentOS - mizzy.org - Trac
Hadoop ã‚’ CentOS5 ã§åˆ©ç”¨ã™ã‚‹å ´åˆã€Clouderaâ€™s Distribution for Hadoop (CDH) ã‚’ yum ã§ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ« ã™ã‚‹ã®ãŒç°¡å˜ãªã‚“ã§ã™ãŒã€http://java.sun.com/ ã‹ã‚‰å…¥æ‰‹ã§ãã‚‹ JDK ãƒ‘ãƒƒã‚±ãƒ¼ã‚¸ã«ä¾å˜ã—ã¦ã‚‹ã®ã§ã€CentOS5ã§ yum install ã§ãã‚‹ OpenJDK ãƒ‘ãƒƒã‚±ãƒ¼ã‚¸ ãŒä½¿ãˆã¾ã›ã‚“ã€‚ Hadoop ä½¿ã†ã ã‘ãªã‚‰ãã‚Œã§ã‚‚ã„ã„ã‚“ã§ã™ãŒã€ä»–ã® yum ã§å…¥ã‚‹ ant ç‰ã® Java è£½ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚’åˆ©ç”¨ã—ã‚ˆã†ã¨æ€ã†ã¨ã€Sun ã‹ã‚‰å…¥æ‰‹ã—ãŸ JDK ãƒ‘ãƒƒã‚±ãƒ¼ã‚¸ã¨ yum ã§å…¥ã‚‹ OpenJDK ãƒ‘ãƒƒã‚±ãƒ¼ã‚¸ãŒåŒå±…ã—ã¦ã€æ°—æŒã¡ãŒæ‚ªã„ã§ã™ã€‚ å¹¸ã„ã€CDH ã® SRPM ã‚‚å…¥æ‰‹ã§ãã‚‹ã®ã§ã€ã“ã„ã¤ã‚’ OpenJDK ãƒ‘ãƒƒã‚±ãƒ¼ã‚¸ã‚’åˆ©ç”¨ã™ã‚‹å½¢ã§ãƒ‘ãƒƒã‚±ãƒ¼ã‚¸ãƒ³ã‚°ã—ãªãŠã—ã¾ã—ãŸã€‚ http://svn.mizzy.org/publi
ftnk 2010/04/17
hadoop

centos

scala
ãƒªãƒ³ã‚¯
Hadoopã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ« - hshinjiã®æ—¥è¨˜
Hadoopã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã«æ‰‹é–“å–ã£ãŸã®ã§ã€å‚™å¿˜éŒ²ã€‚ å‚è€ƒã«ã—ãŸã‚µã‚¤ãƒˆ 4å°æ§‹æˆã®Hadoopã‚’100åˆ†ã§è©¦ã—ã¦ã¿ã‚‹(CentOS + Cloudera) ã€œ ãã‚Šã‚“ã•ã‚“æ—¥è¨˜ ã‚¯ãƒ©ã‚¹ã‚¿ã‚»ãƒƒãƒˆã‚¢ãƒƒãƒ— ã€œ Hadoopæ—¥æœ¬èªžã‚µã‚¤ãƒˆ å‰ææ¡ä»¶ ä»¥ä¸‹ã®ç’°å¢ƒã§å‹•ä½œã•ã›ã¦ã„ã¾ã™ã€‚ ãƒ€ã‚¤ãƒŠãƒŸãƒƒã‚¯DNSã¨DHCPã®ã‚ã‚‹ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ Ubuntuã®ä»®æƒ³ãƒžã‚·ãƒ³ï¼ˆKVMï¼‰ä¸Šã§å‹•ä½œï¼ˆãƒžã‚·ãƒ³ã¯ã€Intel Core i7 920, ãƒ¡ãƒ¢ãƒª 6Gï¼‰ ã¾ãŸã€Hadoopã®ãƒžã‚¹ã‚¿ãƒ¼ãƒŽãƒ¼ãƒ‰ã®ãƒ›ã‚¹ãƒˆåã‚’ã€Œhmasterã€ã€ã‚¹ãƒ¬ãƒ¼ãƒ–ã‚’ã€Œhslave1, hslave2, ...ã€ã¨ã—ã¾ã™ã€‚ ã‚²ã‚¹ãƒˆOSã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ï¼ˆCentOSï¼‰ KVMä¸Šã§å‹•ä½œã™ã‚‹CentOSã®ã‚¤ãƒ¡ãƒ¼ã‚¸ã‚’ä¸€ã¤ä½œæˆã—ã¾ã™ã€‚å„ãƒŽãƒ¼ãƒ‰ã¯ã“ã®ã‚¤ãƒ¡ãƒ¼ã‚¸ã®ã‚³ãƒ”ãƒ¼ã‚’ä½¿ç”¨ã—ã¾ã™ã€‚ å†èµ·å‹•å¾Œã®æœ€åˆã®è¨å®šã§ã¯ã€Firewallã¨SELinuxã‚’ç„¡åŠ¹ã«ã—ã¦ãŠãã¾ã™ã€‚ ãã®ä»–ã®Ce
ftnk 2010/03/31
hadoop
ãƒªãƒ³ã‚¯
GoogleãŒMapReduceç‰¹è¨±ã‚’å–å¾—ã€‚Googleã¯ç”¨é€”ã«ã¤ã„ã¦ã‚³ãƒ¡ãƒ³ãƒˆã›ãš - Wataru's blog
æœ¬æ—¥æœã«Webã‚’å·¡å›žã—ã¦ã„ãŸã‚‰å…¥ã£ã¦ããŸãƒ‹ãƒ¥ãƒ¼ã‚¹ãŒã“ã¡ã‚‰ã€‚ "USPTO Grants Google a Patent On MapReduce" ä½•ã¨ã€GoogleãŒMapReduceã®ç‰¹è¨±ã‚’å–å¾—ã¨ã®ã“ã¨ã€‚ MapReduceã¯ã€è«–æ–‡ãŒç™ºè¡¨ã•ã‚Œã€æ›´ã«ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚¯ãƒãƒ¼ãƒ³ã§ã‚ã‚‹HadoopãŒæ—¢ã«ä¸–ã«å‡ºã¦ã„ã‚‹ã®ã§ã€ã“ã®ã‚¿ã‚¤ãƒŸãƒ³ã‚°ã§ç‰¹è¨±ãŒå‡ºã¦ãã‚‹ã“ã¨ã¯å¤šãã®äººã¯äºˆæƒ³ã—ã¦ã„ãªã‹ã£ãŸã®ã§ã¯ãªã„ã‹ã¨æ€ã„ã¾ã™ã€‚ãã®ãŸã‚ã§ã—ã‚‡ã†ã‹ã€ã“ã®ãƒ‹ãƒ¥ãƒ¼ã‚¹ã¯Twitterãªã©ã§åºƒã¾ã‚Šã€Hadoopã¸ã®æ‚ªå½±éŸ¿ã‚’æ‡¸å¿µã™ã‚‹ã‚³ãƒ¡ãƒ³ãƒˆãŒéšæ‰€ã«è¦‹ã‚‰ã‚Œã¾ã—ãŸã€‚ ãã‚“ãªã¨ãã€GigaOMã‹ã‚‰ã‚ˆã„ã‚¨ãƒ³ãƒˆãƒªãŒã€‚ Why Hadoop Users Shouldn't Fear Google's New MapReduce Patent â€” Tech News and Analysis Then there is the questio
ftnk 2010/01/21
google

Mapreduce

hadoop

patent
ãƒªãƒ³ã‚¯
IntelãŒ48ã‚³ã‚¢ã®ã€Œã‚·ãƒ³ã‚°ãƒ«ãƒãƒƒãƒ—ãƒ»ã‚¯ãƒ©ã‚¦ãƒ‰ãƒ»ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ã‚¿ã€è©¦ä½œï¼ŒHadoopã‚‚ç§»æ¤ã¸
ç±³Intelã¯ç±³å›½æ™‚é–“2009å¹´12æœˆ2æ—¥ï¼Œ1ã¤ã®LSIãƒãƒƒãƒ—ã«æ¼”ç®—ã‚³ã‚¢48å€‹ã‚’é›†ç©ã—ãŸè©¦ä½œãƒ—ãƒã‚»ã‚µã‚’ç™ºè¡¨ã—ãŸã€‚2010å¹´ã«æ•°åã®ä¼æ¥ï¼å¤§å¦ã¸100å€‹ä»¥ä¸Šã®è©¦ä½œãƒ—ãƒã‚»ã‚µã‚’æä¾›ã—ï¼Œå¤šã‚³ã‚¢ãƒ»ãƒ—ãƒã‚»ã‚µã‚’åŠ¹çŽ‡ã‚ˆãåˆ©ç”¨ã§ãã‚‹ã‚½ãƒ•ãƒˆã‚¦ã‚¨ã‚¢ï¼ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ãƒ»ãƒ¢ãƒ‡ãƒ«ã®ç ”ç©¶é–‹ç™ºã‚’æŽ¨é€²ã™ã‚‹è¨ˆç”»ã€‚ è©¦ä½œãƒ—ãƒã‚»ã‚µã¯Intel Architectureï¼ˆIAï¼‰ãƒ™ãƒ¼ã‚¹ã®æ¼”ç®—ã‚³ã‚¢ã‚’48å€‹æè¼‰ã—ï¼Œå„ã‚³ã‚¢ã‚’ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯åŒ–ã—ãŸã€‚æ–°ãŸãªé›»åŠ›ç®¡ç†æŠ€è¡“ã‚’ç”¨ã„ï¼Œæ¶ˆè²»é›»åŠ›ã‚’25ï½ž125Wã«æŠ‘ãˆãŸã¨ã—ã¦ã„ã‚‹ã€‚ã‚³ã‚¢é–“ã®ç›´æŽ¥ãƒ‡ãƒ¼ã‚¿äº¤æ›ã«å¯¾å¿œã—ã¦ãŠã‚Šï¼Œå¤–éƒ¨ãƒ¡ãƒ¢ãƒªãƒ¼ã«ã‚¢ã‚¯ã‚»ã‚¹ã™ã‚‹å¿…è¦æ€§ã‚’ä¸‹ã’ã¦ã„ã‚‹ãŸã‚ï¼Œé«˜é€Ÿãªæ¼”ç®—ãŒå¯èƒ½ã¨ã„ã†ã€‚ãƒ‡ãƒ¼ã‚¿è»¢é€è·é›¢ã‚‚çŸããªã‚‹ã®ã§ï¼Œæ¶ˆè²»é›»åŠ›ã®å‰Šæ¸›åŠ¹æžœã‚‚å¾—ã‚‰ã‚Œã‚‹ã€‚ã‚¯ãƒ©ã‚¦ãƒ‰å¯¾å¿œãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼ç”¨ã‚½ãƒ•ãƒˆã‚¦ã‚¨ã‚¢ã§ä½¿ã‚ã‚Œã‚‹ä¸¦åˆ—ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ãƒ»ãƒ¢ãƒ‡ãƒ«ã‚’æŽ¡ç”¨ã§ãã‚‹ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ã¨ã—ãŸã€‚ Intelã¯ç±³Hewlett-Packardï¼ˆHP
ftnk 2009/12/05
Intel

hadoop
ãƒªãƒ³ã‚¯
Rubyã§Hadoopã‚’ãƒ©ãƒƒãƒ—ã€åˆ†æ•£å‡¦ç†ãƒ„ãƒ¼ãƒ«ã‚ãƒƒãƒˆãŒç™»å ´ ï¼ ï¼ IT
2009/05/12 ç±³æ–°èžç¤¾å¤§æ‰‹ã®ãƒ‹ãƒ¥ãƒ¼ãƒ¨ãƒ¼ã‚¯ãƒ»ã‚¿ã‚¤ãƒ ã‚ºã¯5æœˆ11æ—¥ã€Rubyã«ã‚ˆã‚‹å¤§è¦æ¨¡åˆ†æ•£å‡¦ç†ã®ãƒ„ãƒ¼ãƒ«ã‚ãƒƒãƒˆã€ŒMap/Reduce Toolkitã€ï¼ˆMRToolkitï¼‰ã‚’GPLv3ã®ä¸‹ã«ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã§å…¬é–‹ã—ãŸã¨ç™ºè¡¨ã—ãŸã€‚MRToolkitã¯ã€ã™ã§ã«ç¨¼åƒã—ã¦ã„ã‚‹ã‚¯ãƒ©ã‚¹ã‚¿ä¸Šã®Hadoopã¨åˆã‚ã›ã¦ä½¿ã†ã“ã¨ã§Rubyã§å®¹æ˜“ã«Map/Reduceå‡¦ç†ã‚’è¨˜è¿°ã™ã‚‹ã“ã¨ãŒã§ãã‚‹ä¸€ç¨®ã®ãƒ©ãƒƒãƒ‘ãƒ¼ã€‚å‡¦ç†è‡ªä½“ã¯HadoopãŒè¡Œã†ã€‚ã™ã§ã«Hadoopã‚’ä½¿ã£ã¦ã„ã‚‹ãƒ¦ãƒ¼ã‚¶ãƒ¼ã§ã‚ã‚Œã°ã€ä¸å°è¦æ¨¡ã®ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã«å¯¾ã—ã¦ã€ã™ãã«MRToolkitã‚’é©ç”¨å¯èƒ½ã¨ã—ã¦ã„ã‚‹ã€‚ ãƒ‡ãƒ•ã‚©ãƒ«ãƒˆã§æœ‰ç”¨ãªMapã€Reduceã®å‡¦ç†ãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«ãŒå«ã¾ã‚Œã¦ã„ã¦ã€æ•°è¡Œã®Rubyã‚¹ã‚¯ãƒªãƒ—ãƒˆã‚’æ›¸ãã ã‘ã§ã€ä¾‹ãˆã°è†¨å¤§ãªApacheã®ãƒã‚°ã‹ã‚‰IPã‚¢ãƒ‰ãƒ¬ã‚¹åˆ¥ã®é–²è¦§å±¥æ´ã‚’ã¾ã¨ã‚ã‚‹ã¨ã„ã£ãŸå‡¦ç†ãŒå¯èƒ½ã¨ã„ã†ã€‚ç‹¬è‡ªã«Mapã‚„Reduceã®å‡¦ç†ã‚’å®šç¾©ã™ã‚‹ã“ã¨ã‚‚
ftnk 2009/05/15
ruby

Hadoop

mapreduce
ãƒªãƒ³ã‚¯
ç±³ClouderaãŒHadoopãƒ‡ã‚£ã‚¹ãƒˆãƒªãƒ“ãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã‚’ç™ºè¡¨ã€OSSã‚¯ãƒ©ã‚¦ãƒ‰ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã‚’ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚ºã¸ | OSDN Magazine
ãƒ™ãƒ³ãƒãƒ£ãƒ¼ä¼æ¥ã®ç±³Clouderaã¯3æœˆ15æ—¥ï¼ˆç±³å›½æ™‚é–“ï¼‰ã€MapReduceã®Javaå®Ÿè£…ã€ŒApache Hadoopã€ã‚’ãƒ™ãƒ¼ã‚¹ã¨ã—ãŸãƒ‡ã‚£ã‚¹ãƒˆãƒªãƒ“ãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã€ŒCloudera Distribution for Hadoopã€ã‚’ç™ºè¡¨ã—ãŸã€‚Hadoopã®è¨å®šã€å®Ÿè£…ã€ç®¡ç†ã‚’å®¹æ˜“ã«è¡Œã†ãƒ‘ãƒƒã‚±ãƒ¼ã‚¸ã¨ãªã‚‹ã€‚ Hadoopã¯ã€Apache Software Foundationï¼ˆASFï¼‰ã§é–‹ç™ºãŒé€²ã‚ã‚‰ã‚Œã¦ã„ã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã€‚ç±³Googleã®MapReduceã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ å®Ÿè£…ã‚’å«ã‚€åˆ†æ•£ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ãƒ†ã‚£ãƒ³ã‚°ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã€‚ Clouderaã¯ã€Hadoopã‚’ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚ºå‘ã‘ã«æä¾›ã™ã‚‹ã“ã¨ã‚’ç›®æŒ‡ã™ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ä¼æ¥ã€‚å‰µæ¥ãƒ¡ãƒ³ãƒãƒ¼ã«ã¯ã€ç±³Oracleã®å¹¹éƒ¨ã§Sleepycat Softwareã®CEOã‚’å‹™ã‚ãŸMike Olsonæ°ã‚’ã¯ã˜ã‚ã€ç±³Yahoo!ã€Googleãªã©ã®å‡ºèº«è€…ãŒåã‚’é€£ãã¦ã„
ftnk 2009/03/17
Linux

Hadoop
ãƒªãƒ³ã‚¯
Hadoopã§ã€ã‹ã‚“ãŸã‚“åˆ†æ•£å‡¦ç† (Yahoo! JAPAN Tech Blog)
ãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã¯ã€2023å¹´10æœˆ1æ—¥ã«LINEãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã«ãªã‚Šã¾ã—ãŸã€‚LINEãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã®æ–°ã—ã„ãƒ–ãƒã‚°ã¯ã“ã¡ã‚‰ã§ã™ã€‚LINEãƒ¤ãƒ•ãƒ¼ Tech Blog ã“ã‚“ã«ã¡ã¯ã€åœ°åŸŸã‚µãƒ¼ãƒ“ã‚¹äº‹æ¥éƒ¨ã®å‰ç”°ä¸€æ˜Ÿã§ã™ã€‚ ä»Šå›žã¯ã€Hadoopã«ã¤ã„ã¦ã€Yahoo! JAPANã§ã®å®Ÿéš›ã®ä½¿ç”¨ä¾‹ã‚’äº¤ãˆãªãŒã‚‰æ›¸ããŸã„ã¨æ€ã„ã¾ã™ã€‚Hadoopã¨ã¯ã€å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’æ‰‹è»½ã«è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã—ã¦å‡¦ç†ã§ãã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã§ã™ã€‚ è¤‡æ•°ã®ãƒžã‚·ãƒ³ã¸ã®åˆ†æ•£å‡¦ç†ã¯ã€ãƒ—ãƒã‚»ã‚¹é–“é€šä¿¡ã‚„ã€éšœå®³æ™‚ã¸ã®å¯¾å¿œãªã©ã‚’è€ƒãˆãªã‘ã‚Œã°ãªã‚‰ãšã€ãƒ—ãƒã‚°ãƒ©ãƒžã«ã¨ã£ã¦æ•·å±…ãŒé«˜ã„ã‚‚ã®ã§ã™ãŒã€ Hadoopã¯ãã†ã„ã£ãŸé¢å€’ãã•ã„åˆ†æ•£å‡¦ç†ã‚’ä¸€æ‰‹ã«å¼•ãå—ã‘ã¦ãã‚Œã¾ã™ã€‚ 1å°ã§ã¯å‡¦ç†ã«ã‹ãªã‚Šæ™‚é–“ãŒã‹ã‹ã‚‹ã‚ˆã†ãªå¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚‚ã€è¤‡æ•°ãƒžã‚·ãƒ³ã«åˆ†æ•£ã•ã›ã‚‹ã“ã¨ã§ã€é©šãã¹ãã‚¹ãƒ”ãƒ¼ãƒ‰ã§å‡¦ç†ã‚’è¡Œã†ã“ã¨ãŒã§ãã¾ã™ã€‚ ä¾‹ãˆã°ã€ä»Šã¾ã§1å°ã§ã‚„ã£ã¦ã„ãŸã€ã‚ã‚‹ãƒã‚°é›†è¨ˆå‡¦ç†
ftnk 2009/03/03
Yahoo

mapreduce

Hadoop
ãƒªãƒ³ã‚¯
æ¥½å¤©ç‰ˆMapReduceãƒ»Hadoopã¯Rubyã‚’æ´»ç”¨ ï¼ ï¼ IT
2008/12/01 æ¥½å¤©ã¯11æœˆ29æ—¥ã€æ±äº¬ãƒ»å“å·ã®æœ¬ç¤¾ã§é–‹å‚¬ã—ãŸæŠ€è¡“ç³»ã‚¤ãƒ™ãƒ³ãƒˆã€Œæ¥½å¤©ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹2008ã€ã«ãŠã„ã¦ã€è¿‘ã„å°†æ¥ã«åŒç¤¾ã®Eã‚³ãƒžãƒ¼ã‚¹ã‚µãƒ¼ãƒ“ã‚¹ã€Œæ¥½å¤©å¸‚å ´ã€ã‚’æ”¯ãˆã‚‹è¨ˆç”»ãŒã‚ã‚‹Rubyãƒ™ãƒ¼ã‚¹ã®å¤§è¦æ¨¡åˆ†æ•£å‡¦ç†æŠ€è¡“ã€ŒROMAã€ï¼ˆãƒãƒ¼ãƒžï¼‰ã¨ã€Œfairyã€ï¼ˆãƒ•ã‚§ã‚¢ãƒªãƒ¼ï¼‰ã«ã¤ã„ã¦ã€ãã®æ¦‚è¦ã‚’æ˜Žã‚‰ã‹ã«ã—ãŸã€‚ ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ã®å‡¦ç†è‡ªä½“ã¯ã‚·ãƒ³ãƒ—ãƒ« æ¥½å¤©å¸‚å ´ã§ã¯ç¾åœ¨ã€2600ä¸‡ç‚¹ã®å•†å“ã‚’å–ã‚Šæ‰±ã„ã€4200ä¸‡äººã®ä¼šå“¡ã«å¯¾ã—ã¦ã‚µãƒ¼ãƒ“ã‚¹ã‚’æä¾›ã—ã¦ã„ã‚‹ã€‚ã“ã®è¦æ¨¡ã®ä¼šå“¡æ•°ãƒ»å•†å“ç‚¹æ•°ã§ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ï¼ˆå•†å“ã®æŽ¨è–¦ï¼‰ã‚’è¡Œã†ã®ã¯å®¹æ˜“ã§ã¯ãªã„ã€‚ â€»è¨˜äº‹åˆå‡ºæ™‚ã«æ¥½å¤©å¸‚å ´ã®ä¼šå“¡æ•°ã‚’4800ä¸‡äººã¨ã—ã¦ã‚ã‚Šã¾ã—ãŸãŒã€ã“ã‚Œã¯æ¥½å¤©ã‚°ãƒ«ãƒ¼ãƒ—ã®ã‚µãƒ¼ãƒ“ã‚¹åˆ©ç”¨è€…å…¨ä½“ã®æ•°å—ã§ã—ãŸã€‚æ¥½å¤©å¸‚å ´ã®ä¼šå“¡æ•°ã¯æ£ã—ãã¯4200ä¸‡äººã¨ã®ã“ã¨ã§ã™ã€‚ãŠè©«ã³ã—ã¦è¨‚æ£ã„ãŸã—ã¾ã™ã€‚ ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ã®ä»•çµ„ã¿ã¨ã—ã¦åŒç¤¾ã¯ã€ä¸€èˆ¬çš„ã§ã‚·ãƒ³ãƒ—ãƒ«ãªã‚¢
ftnk 2008/12/02
mapreduce

hadoop

ruby

rakuten
ãƒªãƒ³ã‚¯
Hadoopã‚’ç”¨ã„ãŸã‚¯ãƒ©ã‚¹ã‚¿ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ãƒ†ã‚£ãƒ³ã‚°ç’°å¢ƒã®æ§‹ç¯‰ - SourceForge.JP Magazine : ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®è©±é¡Œæº€è¼‰
ãƒšã‚¿ãƒã‚¤ãƒˆè¦æ¨¡ã®ãƒ‡ãƒ¼ã‚¿ã‚’æ ¼ç´ã•ã›ã‚‹åˆ†æ•£ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ãƒ†ã‚£ãƒ³ã‚°ç”¨ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã‚’æŽ¢ã—ã¦ã„ã‚‹ã®ã§ã‚ã‚Œã°ã€ãã®ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã¨ã—ã¦ Hadoop ã®ä½¿ç”¨ã‚’æ¤œè¨Žã™ã¹ãã ã‚ã†ã€‚Hadoopã¯Javaãƒ™ãƒ¼ã‚¹ã§ä½œæˆã•ã‚Œã¦ã„ã‚‹ãŸã‚ã€Linuxã€Windowsã€Solarisã€BSDã€Mac OS Xã«ã¦ä½¿ç”¨ã§ãã‚‹ã€‚ã“ã†ã—ãŸHadoopã‚’å®Ÿéš›ã«æŽ¡ç”¨ã—ã¦ã„ã‚‹çµ„ç¹”ã«å…±é€šã™ã‚‹ã®ã¯ã€å®‰ä¾¡ï¼ˆç‰¹æ®Šãªãƒãƒ¼ãƒ‰ã‚¦ã‚§ã‚¢ãŒä¸è¦ï¼‰ã‹ã¤åŠ¹çŽ‡çš„ã§ã‚¹ã‚±ãƒ¼ãƒ©ãƒ“ãƒªãƒ†ã‚£ã¨ä¿¡é ¼æ€§ã‚’å…¼ãå‚™ãˆãŸãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã«ã‚ˆã‚‹ã€è†¨å¤§ãªé‡ã®ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã‚’å¿…è¦ã¨ã—ã¦ã„ã‚‹ã¨ã„ã†ç‚¹ã ã€‚ Hadoopã§ã¯ã€ã“ã†ã—ãŸè†¨å¤§ãªé‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’æ ¼ç´ã™ã‚‹ãŸã‚ã«ã€Hadoop Distributed File Systemï¼ˆHDFSï¼‰ã‚’æŽ¡ç”¨ã—ã¦ã„ã‚‹ã€‚å®Ÿéš›ã€HDFSã®ãƒžã‚¹ã‚¿/ã‚¹ãƒ¬ãƒ¼ãƒ–ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ã¯ã€Hadoopã®ã‚¯ãƒ©ã‚¹ã‚¿æ©Ÿèƒ½ã®ä¸æ ¸ã‚’æˆã—ã¦ã„ã‚‹ã€‚ã“ã“ã§ã‚µãƒãƒ¼ãƒˆã•ã‚Œã¦ã„ã‚‹ã®ã¯ã€ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†
ftnk 2008/10/26
cluster

Hadoop
ãƒªãƒ³ã‚¯
1