yebo blog: Googleã¯æ—¢ã«MapReduceを使ã£ã¦ã„ãªã„2010/09/13 Googleã¯æ—¢ã«MapReduceを使ã£ã¦ã„ãªã„ Googleã®æ–°ã—ã„検索基盤「Caffeineã€ã§ã¯ã€MapReduceを使ã£ã¦ã„ãªã„ãã†ã [register]。新ã—ã„検索基盤ã¯GFS (Google File System) をオーãƒãƒ¼ãƒ›ãƒ¼ãƒ«ã—ãŸGFS2を活用ã—ã¦ãŠã‚Šã€åˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹BigTableã«ç›´æŽ¥ã‚¤ãƒ³ãƒ‡ã‚¯ã‚·ãƒ³ã‚°ã‚’è¡Œã†ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹é§†å‹•ã®æ–¹å¼ã«å¤‰ã‚ã£ã¦ã„る。ã“ã®æ¤œç´¢åŸºç›¤ã‚’「Colossusã€ã¨å‘¼ã‚“ã§ã„ã‚‹ãã†ã 。インデックスã®ä½œæˆæ™‚é–“ã‚’çŸç¸®ã™ã‚‹ã“ã¨ã§(MapReduceã«ã‚ˆã‚‹å‡¦ç†ãŒä¸è¦)ã€æ¤œç´¢ã®ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ 性を増ã™ã®ã ã‚ã†ã€‚Microsoftã€Facebookã€Yahoo!ãŒã¾ã MapReduceã®ã‚ªãƒ¼ãƒ—ンソース版ã¨ã‚‚ã„ãˆã‚‹ã€ŒHadoopã€ã‚’使ã£ã¦ã„ã‚‹ã“ã¨ã‚’考ãˆã‚‹ã¨Googleã¯å…ˆã«é€²ã‚“ã§ã„る。ã“ã®æˆæžœãŒã€ŒGoogle Instantã€ã«ç¹‹ãŒã£ã¦ã„ã‚‹ã®ã ã‚ã†
ã“ã£ã¡ã¯æœ¬ç‰©ã®MapReduceã ï¼ ã‚°ãƒ¼ã‚°ãƒ«ãŒAppEngine-MapReduceをオープンソースã§é–‹ç™ºä¸
Task Queueã¯MapReduceã®å¤¢ã‚’見る㋠- スティルãƒã‚¦ã‚¹ã®æ›¸åº«ã®æ›¸åº«
Cascading
{{#tags}}- {{label}}
{{/tags}}