[B! mapreduce] jazzanovaã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

jazzanova id:jazzanova

mapreduceã«é–¢ã™ã‚‹jazzanovaã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (17)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

MapReduce - Docs-Japanese - 10gen Confluence
shardç’°å¢ƒä¸ã§ã¯ã€ã™ã¹ã¦ã®shardã§ä¸¦è¡Œã—ã¦ãƒ‡ãƒ¼ã‚¿å‡¦ç†ãŒèµ°ã‚Šã¾ã™ã€‚ Â (æ³¨æ„: 2010/2/2: shardå†…ã§ã®map/reduceã¯ãƒšãƒ³ãƒ†ã‚£ãƒ³ã‚°ä¸ã§ã™ãŒã€ã™ãã«æˆ»ã‚Šã¾ã™) map/reduce ã¯ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ [command] ã‚’çµŒç”±ã—ã¦ã€å‘¼ã³å‡ºã•ã‚Œã¾ã™ã€‚ Â ãƒ‡ãƒ¼ã‚¿ãƒãƒ¼ã‚¹ã¯ä¸€æ™‚çš„ãªã‚³ãƒ¬ã‚¯ã‚·ãƒ§ãƒ³ã‚’å‡ºåŠ›çµæžœç”¨ã«ä½œæˆã—ã¾ã™ã€‚ã“ã®ä¸€æ™‚çš„ãªã‚³ãƒ¬ã‚¯ã‚·ãƒ§ãƒ³ã¯ã€ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã®ã‚³ãƒã‚¯ã‚·ãƒ§ãƒ³ãŒé–‰ã˜ãŸã¨ãã€ã¾ãŸã¯æ˜Žç¤ºçš„ã«dropã•ã‚ŒãŸå ´åˆå‰Šé™¤ã•ã‚Œã¾ã™ã€‚ã¾ãŸã€æ°¸ç¶šçš„ãªå‡ºåŠ›ç”¨ã®ã‚³ãƒ¬ã‚¯ã‚·ãƒ§ãƒ³åã‚’æŒ‡å®šã™ã‚‹ã“ã¨ã‚‚ã§ãã¾ã™ã€‚Â map ã¨ reduce ãƒ•ã‚¡ãƒ³ã‚¯ã‚·ãƒ§ãƒ³ã¯JavaScriptã§æ›¸ãã€ã‚µãƒ¼ãƒä¸Šã§å®Ÿè¡Œã•ã‚Œã¾ã™ã€‚ ã‚³ãƒžãƒ³ãƒ‰ã®æ–‡æ³•: db.runCommand( { mapreduce : <collection>, map : <map ãƒ•ã‚¡ãƒ³ã‚¯ã‚·ãƒ§ãƒ³å>, reduce : <reduce ãƒ•
jazzanova 2012/03/29
mapreduce
ãƒªãƒ³ã‚¯
MapReduceã«ã‚ˆã‚‹å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’åˆ©ç”¨ã—ãŸæ©Ÿæ¢°å¦ç¿’
[DLè¼ªèªä¼š]Vision Transf ormer with Deformable Attention ï¼ˆDeformable Attention Tra...
jazzanova 2011/02/24
mapreduce
ãƒªãƒ³ã‚¯
Amazon MapReduceã‚’ä½¿ã£ã¦PHPã§ç”»åƒå‡¦ç†ã—ã¦ã¿ã‚‹ - ku-sukeã®ãƒ–ãƒã‚°
ä»Šæ—¥ã¯ã¨ã‚ã‚‹ç§çš„ãªãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã§ç”»åƒã®æƒ…å ±æ“ä½œãŒå¿…è¦ã«ãªã£ãŸã®ã§ã€ãƒãƒ¼ã‚«ãƒ«ã§è¨ˆç®—ã—ã¦ã‚‚ã„ã„ã‚“ã ã‘ã©ä»Šå¾Œã‚‚ãƒ‘ãƒ©ãƒ¡ãƒ¼ã‚¿ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚°ã§ä½•åº¦ã‹ç™ºç”Ÿã—ãã†ãªã®ã§ã€Amazonã®MapReduceã‚’ä½¿ã£ã¦ã¿ã¾ã—ãŸã€‚ ä»Šå›žã®æ§‹æˆå›³ã¯ã“ã‚“ãªã‹ã‚“ã˜ã€‚å…¨éƒ¨Amazonã§å…¨éƒ¨PHPã§ã‚„ã£ã¦ã¿ãŸã€‚ ã‚„ã‚ã†ã¨ãŠã‚‚ã£ãŸãã£ã‹ã‘ åˆ¥ã«5ä¸‡æžšãã‚‰ã„ã˜ã‚ƒå®Ÿã¯Amazonã˜ã‚ƒãªãã¦ã‚‚ã‚ˆã‹ã£ãŸã‚Šã—ã¾ã™ã€‚ä¸€æ™©ãƒšãƒãºãƒ¼ã®ã‚¹ã‚¯ãƒªãƒ—ãƒˆã‚’4ã€œ5æœ¬å¹³è¡Œã§èµ°ã‚‰ã›ã¦ãŠã‘ã°ã€ãƒãƒ¼ã‚«ãƒ«ã®MySQLã«çµæžœã‚’ãŸã‚ã‚‹ãã‚‰ã„å¯èƒ½ã§ã™ã€‚ã§ã‚‚ã€ ä»Šå¾Œã®ãŸã‚ã«å‹‰å¼·ã—ãŸã‹ã£ãŸã€‚MapReduceã§èª¿ã¹ã¦ã‚‚ã€Apacheã®ãƒã‚°ã¨ã‹ãƒ†ã‚ã‚¹ãƒˆæ“ä½œãã‚‰ã„ã—ã‹è¦‹ã¤ã‹ã‚‰ãªã‹ã£ãŸã®ã§ã€‚ ãƒ‡ãƒ¼ã‚¿ã‚’ã‚ªãƒ³ãƒ©ã‚¤ãƒ³ã«ç½®ããŸã‹ã£ãŸãƒ»ãƒãƒ¼ã‚«ãƒ«ã«ç½®ããŸããªã‹ã£ãŸã€‚ ãã†ã™ã‚‹ã¨ã€MapReduceã™ã‚‹ã«ã›ã‚ˆã—ãªã„ã«ã›ã‚ˆS3ãŒã‚ˆã•ãã†ã ã£ãŸã€‚ ã˜ã‚ƒã‚ã€EC2ä¸€æ™©å‹•ã‹ã™ã‚ˆã‚Šã€MapReduceã§ä¸€
jazzanova 2009/11/27
amazon

mapreduce

php

image
ãƒªãƒ³ã‚¯
Announcing the Map/Reduce Toolkit
By Charles Hayden May 11, 2009 5:35 pm May 11, 2009 5:35 pm Part of what we do here is monitor how readers are using NYTimes.com. All activity at the Web site is logged, but the overwhelming volume of data makes analyzing it difficult. Recently weâ€™ve been exploring the on-demand storage and computation tools offered by Amazon Web Services, along with an open-source toolkit called Apache Hadoop. Th
jazzanova 2009/05/12
mapreduce
ãƒªãƒ³ã‚¯
Hadoop / MapReduceï¼šæ—¥æœ¬èªžã®æŠ€è¡“è³‡æ–™ã¸ã®ãƒªãƒ³ã‚¯é›† - M's View
ãƒ—ãƒªãƒ•ã‚¡ãƒ¼ãƒ‰ ã‚¤ãƒ³ãƒ•ãƒ©ã‚¹ãƒˆãƒ©ã‚¯ãƒãƒ£ CTO å¤ªç”°ä¸€æ¨¹æ°ã«ã‚ˆã£ã¦ CodeZine ã«å¯„ã›ã‚‰ã‚ŒãŸ Hadoop ã®è§£èª¬ã€ã‚¬ãƒªãƒ¬ã‚ª å°å±±åšå²æ°ã«ã‚ˆã£ã¦ @IT ã«å¯„ã›ã‚‰ã‚ŒãŸ MapReduce ã®è§£èª¬ãªã©ã€Hadoop ã¨ MapReduce ã«é–¢ã™ã‚‹æ—¥æœ¬èªžã®æŠ€è¡“è³‡æ–™ã¸ã®ãƒªãƒ³ã‚¯ã‚’é›†ã‚ã¦ã¿ãŸã€‚ CodeZine ã® Hadoop è§£èª¬è¨˜äº‹ï¼ˆå¤ªç”°ä¸€æ¨¹æ°ï¼‰ï¼š ã€ŒHadoopã€hBaseã§æ§‹ç¯‰ã™ã‚‹å¤§è¦æ¨¡åˆ†æ•£ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã‚·ã‚¹ãƒ†ãƒ ã€ ã€ŒHadoopã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã¨ã‚µãƒ³ãƒ—ãƒ«ãƒ—ãƒã‚°ãƒ©ãƒ ã®å®Ÿè¡Œã€ ã€Œè¤‡æ•°ãƒžã‚·ãƒ³ã¸Hadoopã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã™ã‚‹ã€ ã€Œblogeyeã®å®Ÿè£…ã«å¦ã¶ã€Amazon EC2/S3ã§ã®Hadoopæ´»ç”¨è¡“ã€ï¼ˆå¤§å€‰ å‹™ æ° --- ç¾ Google ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ï¼‰ Hadoop ã®æŠ€è¡“è§£æžè³‡æ–™ï¼ˆNTT ãƒ¬ã‚¾ãƒŠãƒ³ãƒˆã€ãƒ—ãƒªãƒ•ã‚¡ãƒ¼ãƒ‰ ã‚¤ãƒ³ãƒ•ãƒ©ã‚¹ãƒˆãƒ©ã‚¯ãƒãƒ£ï¼‰ Amazon Elastic MapReduce
jazzanova 2009/04/22
mapreduce

hadoop

ã¾ã¨ã‚
ãƒªãƒ³ã‚¯
å¤§è¦æ¨¡ã‚¤ãƒ³ãƒ•ãƒ©å€‹äººé‹ç”¨ï¼šAWS+Hadoopã®æˆåŠŸä¾‹ | wrong, rogue and log
ã“ã‚Œã¯è¥¿æ‘ã•ã‚“ã‹ã‚‰Twitterã§æ•™ãˆã¦ã‚‚ã‚‰ã£ãŸã“ã¨ãªã®ã§ã‚ã‚‹ãŒã€AWS+Hadoopã®å¹¸ã›ãªæˆåŠŸä¾‹ã§ã‚ã‚‹ï¼š Self-service, Prorated Super Computing Fun! NY TimesãŒéŽåŽ»ã®ã‚¢ãƒ¼ã‚«ã‚¤ãƒ–ã‚’å«ã‚ã¦ã™ã¹ã¦ç„¡æ–™åŒ–ã—ãŸã‚ã‘ã ãŒã€ãã®ã‚·ã‚¹ãƒ†ãƒ çš„ãªç§»è¡ŒæŽªç½®ã¨ã—ã¦éŽåŽ»ã®ã‚¹ã‚ãƒ£ãƒ³ã—ãŸTIFFç”»åƒã‚’PDFã«å¤‰æ›ã™ã‚‹å¿…è¦ãŒã‚ã£ãŸã®ã ã€‚TIFFã®ã‚µã‚¤ã‚ºã¯åˆã‚ã›ã¦4TBã¨ã„ã†å·¨å¤§ã•ã€‚ ã“ã‚Œã‚’è¡Œã†ã®ã«æ¬¡ã®æ§‹æˆã‚’ã¨ã£ãŸãã†ã ï¼šPDFå¤‰æ›ã«iTextã‚’ç”¨ã„ã‚‹ã€‚å¤‰æ›ã™ã‚‹ãƒžã‚·ãƒ³ã¯AWSä¸Šã®100ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ã‚’Hadoopã§MapReduceæ§‹æˆã‚’ã¨ã‚‹ã“ã¨ã§ä¸¦åˆ—åŒ–ã—ãŸã€‚ã“ã‚Œã«ã‚ˆã‚Šã™ã¹ã¦ã®PDFå¤‰æ›ï¼ˆãªã‚“ã¨æˆæžœç‰©ã¯1.5TB)ãŒã€24æ™‚é–“æœªæº€ã®æ™‚é–“ã§çµ‚äº†ã—ãŸã®ã ã€‚ãã—ã¦ä½œæ¥ã‚’ã—ãŸã®ã¯ã€ä¸€äººã®ãƒ—ãƒã‚°ãƒ©ãƒžã ã‘ã§ã‚ã‚‹ã€‚ ã ã‹ã‚‰è¨€ã£ãŸã§ã—ã‚‡ã€‚ã‚‚ã†æ™‚ä»£ã¯ä¸€äººå¤§è¦æ¨¡ã‚µãƒ¼ãƒ“ã‚¹ã®æ™‚ä»£ãªã‚“ã§ã™ã‚ˆã€‚ã
jazzanova 2009/04/21
amazon

mapreduce

hadoop
ãƒªãƒ³ã‚¯
MapReduce on Tyrant - mixi engineer blog
å…ˆæ—¥ã€éš…ç”°å·ã®å±‹å½¢èˆ¹ã§èŠ±è¦‹ã¨æ´’è½è¾¼ã‚“ã ã®ã§ã™ãŒã€ãã®æ—¥ã¯ã¾ã ä¸€åˆ†å’²ãã‚‚è¡Œã£ã¦ãªãã¦æ‚²ã—ã„æ€ã„ã‚’ã—ãŸmikioã§ã™ã€‚ä»Šå›žã¯Tokyo Tyrantï¼ˆTTï¼‰ã«æ ¼ç´ã—ãŸãƒ‡ãƒ¼ã‚¿ã‚’å¯¾è±¡ã¨ã—ã¦MapReduceã®ãƒ¢ãƒ‡ãƒ«ã«åŸºã¥ãè¨ˆç®—ã‚’ã™ã‚‹æ–¹æ³•ã«ã¤ã„ã¦è¿°ã¹ã¾ã™ã€‚ MapReduceã¨ã¯ GoogleãŒä½¿ã£ã¦ã„ã‚‹ã¨ã„ã†åˆ†æ•£å‡¦ç†ã®è¨ˆç®—ãƒ¢ãƒ‡ãƒ«ãŠã‚ˆã³ãã®å®Ÿè£…ã®ã“ã¨ã ãã†ã§ã™ãŒã€è©³ã—ã„ã“ã¨ã¯ã‚°ã‚°ã£ã¦ãã ã•ã„ã€‚Googleã«ã‚ˆã‚‹å‡ºè‡ªã®è«–æ–‡ã‚„Apacheãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã«ã‚ˆã‚‹Hadoopãªã©ã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹å®Ÿè£…ã«ã‚ãŸã‚‹ã®ã‚‚ã‚ˆã„ã§ã—ã‚‡ã†ï¼ˆç§ã¯ä¸¡è€…ã¨ã‚‚è©³ã—ãè¦‹ã¦ã„ã¾ã›ã‚“ãŒï¼‰ã€‚ ä»Šå›žã®è¶£æ—¨ã¯ã€CouchDBãŒMapReduceã¨ç§°ã—ã¦JavaScriptã§å®Ÿç¾ã—ã¦ã„ã‚‹ãƒ‡ãƒ¼ã‚¿é›†è¨ˆæ–¹æ³•ã‚’TTã¨TCã¨Luaã§ã‚„ã£ã¦ã¿ã‚ˆã†ã˜ã‚ƒãªã„ã‹ã¨ã„ã†ã“ã¨ã§ã™ã€‚ç°¡å˜ã«è¨€ãˆã°ã€ä»¥ä¸‹ã®å‡¦ç†ã‚’å®Ÿè£…ã—ã¾ã™ã€‚ ãƒ¦ãƒ¼ã‚¶ã‹ã‚‰è¨ˆç®—é–‹å§‹ãŒæŒ‡ç¤ºã•ã‚Œã‚‹ã¨ã€TTã¯ã€DBå†…ã®
jazzanova 2009/04/08
mapreduce

tokyotyrant
ãƒªãƒ³ã‚¯
Last.fm â€“ the Blog Â· Mapreduce Bash Script
One night at the pub we discussed whether one could replace Hadoop (a massive and comprehensive implementation of Mapreduce) with a single bash script, an awk command, sort, and a sprinkling of netcat. This turned into a weekend project dubbed bashreduce. To be fair, Hadoop probably does a few more things than bashreduce. But weâ€™ve managed to cover a few key concepts in our script: Task coordinati
jazzanova 2009/04/07
mapreduce
ãƒªãƒ³ã‚¯
ã‚¢ãƒžã‚¾ãƒ³ã€ã‚¦ã‚£ã‚¶ãƒ¼ãƒ‰ã ã‘ã§ä½¿ãˆã‚‹Hadoopã‚µãƒ¼ãƒ“ã‚¹é–‹å§‹ ï¼ ï¼ IT
2009/04/02 ç±³ã‚¢ãƒžã‚¾ãƒ³ã®åä¼šç¤¾ã€Amazon Web Servicesï¼ˆAWSï¼‰ã¯4æœˆ2æ—¥ã€å¤šæ•°ã®OSã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ã‚’èµ·å‹•ã—ã¦å¤§è¦æ¨¡åˆ†æ•£å‡¦ç†ã‚’è¡Œãˆã‚‹ã€ŒAmazon Elastic MapReduceã€ã®ãƒ™ãƒ¼ã‚¿ã‚µãƒ¼ãƒ“ã‚¹ã‚’é–‹å§‹ã—ãŸã€‚ Amazon Elastic MapReduceã¯ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®åˆ†æ•£å‡¦ç†ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯Apache Hadoop 0.18.3ã‚’åˆ©ç”¨ã—ãŸã‚µãƒ¼ãƒ“ã‚¹ã§ã€Webãƒ–ãƒ©ã‚¦ã‚¶ãƒ™ãƒ¼ã‚¹ã®ç®¡ç†ã‚³ãƒ³ã‚½ãƒ¼ãƒ«ã‚„ã‚³ãƒžãƒ³ãƒ‰ãƒ©ã‚¤ãƒ³ãƒ„ãƒ¼ãƒ«ã€APIã‚’ä½¿ã£ã¦ã‚¸ãƒ§ãƒ–ã‚’æŠ•å…¥ã™ã‚‹ã“ã¨ã§ã€å¤§é‡ãƒ‡ãƒ¼ã‚¿ã®è§£æžã‚„è¨ˆç®—é‡ã®å¤šã„ç§‘å¦è¨ˆç®—ã€çµ±è¨ˆå‡¦ç†ãŒå¯èƒ½ã€‚å¤§é‡ã®ãƒã‚°å‡¦ç†ã‚„æ©Ÿæ¢°å¦ç¿’ã€é‡‘èžè¨ˆç®—ã€ãƒ‡ãƒ¼ã‚¿ãƒžã‚¤ãƒ‹ãƒ³ã‚°ã€Webã‚µã‚¤ãƒˆã®ã‚¤ãƒ³ãƒ‡ã‚¯ã‚·ãƒ³ã‚°å‡¦ç†ãªã©ã«ä½¿ãˆã‚‹ã¨ã„ã†ã€‚ ã‚¸ãƒ§ãƒ–ã‚’å‡¦ç†ã™ã‚‹ãƒŽãƒ¼ãƒ‰ã¯ã€å¾“æ¥ã‹ã‚‰AWSãŒæä¾›ã—ã¦ã„ã‚‹Amazon EC2ã§ç¨¼åƒã—ã€ãƒ‡ãƒ¼ã‚¿ã®å…¥å‡ºåŠ›ã«ã¯Amazon S3ãŒä½¿ãˆã‚‹ã€‚ãƒ‡ãƒ¼ã‚¿ã®å…¥åŠ›ã«ã¯ã‚¤
jazzanova 2009/04/07
amazon

hadoop

mapreduce
ãƒªãƒ³ã‚¯
http://as-is.net/blog/archives/001418.html
jazzanova 2009/04/03
amazon

mapreduce
ãƒªãƒ³ã‚¯
Amazon Elastic MapReduceã‚’ä½¿ã£ã¦ã¿ãŸ - moratorium
Amazon Elastic MapReduceã‚’ä½¿ã£ã¦ã¿ãŸ 2009-04-03 (Fri) 3:06 Amazon EC2 é€£æ—¥ã®EC2ãƒã‚¿ã§ã™ã€‚æœ¬æ—¥ã€Amazonã‹ã‚‰Elastic MapReduceã¨ã„ã†ã‚µãƒ¼ãƒ“ã‚¹ãŒãƒªãƒªãƒ¼ã‚¹ã•ã‚Œã¾ã—ãŸã€‚å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿å‡¦ç†æŠ€è¡“ãŒä¸€æ°—ã«æ°‘é–“ã®æ‰‹ã«ä¸‹ã‚Šã¦ãã‚‹ã€ã¾ã•ã«é©å‘½çš„ãªã‚µãƒ¼ãƒ“ã‚¹ã ã¨æ€ã„ã¾ã™ã€‚ Amazon Elastic MapReduce Amazon ElasticMapReduce ç´¹ä»‹ãƒ“ãƒ‡ã‚ª With Hadoop, Amazon Adds A Web-Scale Data Processing Engine To Its Cloud Computer by techcrunch.com Elastic MapReduceã¯ã€Googleã®åŸºç›¤æŠ€è¡“ã®ä¸€ã¤ã§ã‚ã‚‹MapReduceã‚’æ™‚é–“å˜ä½èª²é‡‘ã§å®Ÿè¡Œã§ãã‚‹ã‚µãƒ¼ãƒ“ã‚¹ã§ã™ã€‚MapReduceã«ã¤ã„ã¦ã¯ä»¥
jazzanova 2009/04/03
amazon

mapreduce
ãƒªãƒ³ã‚¯
Big Data Platform - Amazon EMR - AWS
Amazon EMR is accessible in the next generation of Amazon SageMaker Amazon EMR Easily run and scale Apache Spark, Trino, and other big data workloads Amazon EMR is a big data processing service that accelerates analytics workloads with unmatched flexibility and scale. EMR features performance-optimized runtimes for Apache Spark, Trino, Apache Flink, and Apache Hive, drastically cutting costs and p
jazzanova 2009/04/02
amazon

mapreduce
ãƒªãƒ³ã‚¯
Hadoopã§ã€ã‹ã‚“ãŸã‚“åˆ†æ•£å‡¦ç† (Yahoo! JAPAN Tech Blog)
ãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã¯ã€2023å¹´10æœˆ1æ—¥ã«LINEãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã«ãªã‚Šã¾ã—ãŸã€‚LINEãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã®æ–°ã—ã„ãƒ–ãƒã‚°ã¯ã“ã¡ã‚‰ã§ã™ã€‚LINEãƒ¤ãƒ•ãƒ¼ Tech Blog ã“ã‚“ã«ã¡ã¯ã€åœ°åŸŸã‚µãƒ¼ãƒ“ã‚¹äº‹æ¥éƒ¨ã®å‰ç”°ä¸€æ˜Ÿã§ã™ã€‚ ä»Šå›žã¯ã€Hadoopã«ã¤ã„ã¦ã€Yahoo! JAPANã§ã®å®Ÿéš›ã®ä½¿ç”¨ä¾‹ã‚’äº¤ãˆãªãŒã‚‰æ›¸ããŸã„ã¨æ€ã„ã¾ã™ã€‚Hadoopã¨ã¯ã€å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’æ‰‹è»½ã«è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã—ã¦å‡¦ç†ã§ãã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã§ã™ã€‚ è¤‡æ•°ã®ãƒžã‚·ãƒ³ã¸ã®åˆ†æ•£å‡¦ç†ã¯ã€ãƒ—ãƒã‚»ã‚¹é–“é€šä¿¡ã‚„ã€éšœå®³æ™‚ã¸ã®å¯¾å¿œãªã©ã‚’è€ƒãˆãªã‘ã‚Œã°ãªã‚‰ãšã€ãƒ—ãƒã‚°ãƒ©ãƒžã«ã¨ã£ã¦æ•·å±…ãŒé«˜ã„ã‚‚ã®ã§ã™ãŒã€ Hadoopã¯ãã†ã„ã£ãŸé¢å€’ãã•ã„åˆ†æ•£å‡¦ç†ã‚’ä¸€æ‰‹ã«å¼•ãå—ã‘ã¦ãã‚Œã¾ã™ã€‚ 1å°ã§ã¯å‡¦ç†ã«ã‹ãªã‚Šæ™‚é–“ãŒã‹ã‹ã‚‹ã‚ˆã†ãªå¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚‚ã€è¤‡æ•°ãƒžã‚·ãƒ³ã«åˆ†æ•£ã•ã›ã‚‹ã“ã¨ã§ã€é©šãã¹ãã‚¹ãƒ”ãƒ¼ãƒ‰ã§å‡¦ç†ã‚’è¡Œã†ã“ã¨ãŒã§ãã¾ã™ã€‚ ä¾‹ãˆã°ã€ä»Šã¾ã§1å°ã§ã‚„ã£ã¦ã„ãŸã€ã‚ã‚‹ãƒã‚°é›†è¨ˆå‡¦ç†
jazzanova 2009/03/04
hadoop

mapreduce
ãƒªãƒ³ã‚¯
Collaborative Map-Reduce in the Browser - igvita.com
By Ilya Grigorik on March 03, 2009 After immersing yourself into the field of distributed computing and large data sets you inevitably come to appreciate the elegance of Google's Map-Reduce framework. Both the generality and the simplicity of its map, em it, and reduce pha ses is what makes it such a powerful tool. However, while Google has made the theory public, the underlying software implementat
jazzanova 2009/03/04
browser

mapreduce

javascript

ruby
ãƒªãƒ³ã‚¯
IBM Developer
jazzanova 2008/10/23
mapreduce
ãƒªãƒ³ã‚¯
Hadoop Streaming - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼
id:naoya:20080511:1210506301 ã®ã‚¨ãƒ³ãƒˆãƒªã®ã‚³ãƒ¡ãƒ³ãƒˆæ¬„ã§ kzk ã•ã‚“ã«æ•™ãˆã¦ã„ãŸã ã„ãŸ Hadoop Streaming ã‚’è©¦ã—ã¦ã„ã¾ã™ã€‚ Hadoop ã¯ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã® MapReduce + åˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚Java ã§ä½œã‚‰ã‚Œã¦ã„ã¾ã™ã€‚Yahoo! Inc ã®ãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰ã‚„ã€Facebookã€Amazon.com ãªã©ã§ã‚‚åˆ©ç”¨ã•ã‚Œã¦ã„ã‚‹ã¨ã®ã“ã¨ã§ã™ã€‚è©³ã—ãã¯ http://codezine.jp/a/article/aid/2448.aspx (kzk ã•ã‚“ã«ã‚ˆã‚‹é€£è¼‰è¨˜äº‹)ã‚’å‚ç…§ã—ã¦ãã ã•ã„ã€‚ Hadoop Streaming è¨˜äº‹ã«ã‚‚ã‚ã‚Šã¾ã™é€šã‚Šã€Hadoop æ‹¡å¼µã® Hadoop Streaming ã‚’ä½¿ã†ã¨æ¨™æº–å…¥å‡ºåŠ›ã‚’ä»‹ã™ã‚‹ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’è¨˜è¿°ã™ã‚‹ã ã‘ã§ã€Hadoop ã«ã‚ˆã‚‹ MapReduce ã‚’åˆ©ç”¨ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ã¤ã¾ã‚Šã€Java ä»¥å¤–
jazzanova 2008/05/14
hadoop

mapreduce
ãƒªãƒ³ã‚¯
MapReduce - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼
"MapReduce" ã¯ Google ã®ãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰ã§åˆ©ç”¨ã•ã‚Œã¦ã„ã‚‹ä¸¦åˆ—è¨ˆç®—ã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã®ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ä½œæˆã‚’ã¯ã˜ã‚ã¨ã™ã‚‹ã€å¤§è¦æ¨¡ãªå…¥åŠ›ãƒ‡ãƒ¼ã‚¿ã«å¯¾ã™ã‚‹ãƒãƒƒãƒå‡¦ç†ã‚’æƒ³å®šã—ã¦ä½œã‚‰ã‚ŒãŸã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚ MapReduce ã®é¢ç™½ã„ã¨ã“ã‚ã¯ã€map() ã¨ reduce() ã¨ã„ã†äºŒã¤ã®é–¢æ•°ã®çµ„ã¿åˆã‚ã›ã‚’å®šç¾©ã™ã‚‹ã ã‘ã§ã€å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã«å¯¾ã™ã‚‹æ§˜ã€…ãªè¨ˆç®—å•é¡Œã‚’è§£æ±ºã™ã‚‹ã“ã¨ãŒã§ãã‚‹ç‚¹ã§ã™ã€‚ MapReduce ã®è¨ˆç®—ãƒ¢ãƒ‡ãƒ« map() ã«ã¯ãã®è¨ˆç®—å•é¡Œã®ãƒ‡ãƒ¼ã‚¿ã¨ã—ã¦ã® key-value ãƒšã‚¢ãŒæ¬¡ã€…ã«æ¸¡ã£ã¦ãã¾ã™ã€‚map() ã§ã¯ key-value å€¤ã®ãƒšã‚¢ã‚’ç•°ãªã‚‹è¤‡æ•°ã® key-value ãƒšã‚¢ã«å¤‰æ›ã—ã¾ã™ã€‚reduce() ã«ã¯ã€map() ã§ä½œã£ãŸ key-value ãƒšã‚¢ã‚’åŒä¸€ã® key ã§æŸããŸã‚‚ã®ãŒé †ç•ªã«æ¸¡ã£ã¦ãã¾ã™ã€‚ãã® key-values ãƒšã‚¢ã‚’ä»»æ„ã®å½¢å¼ã«å¤‰æ›ã™ã‚‹ã“ã¨
jazzanova 2008/05/12
mapreduce

google

perl
ãƒªãƒ³ã‚¯
1