The Elephant was a Trojan Horse: On the Death of Map-Reduce at Google - Paper Trail
Note: this is a personal blog post, and doesn’t reflect the views of my employers at Cloudera Map-Reduce is on its way out. But we shouldn’t measure its importance in the number of bytes it crunches, but the fundamental shift in data processing architectures it helped popularise. This morning, at their I/O Conference, Google revealed that they’re not using Map-Reduce to process data internally at
æƒ…å ±ç³»ã®å¦ç”ŸãŒã‚„ã£ã¦ãŠãã¹ã10000ã®ã“㨠- nokunoã®æ—¥è¨˜
ã€Œæƒ…å ±ç³»ã®å¦ç”ŸãŒã‚„ã£ã¦ãŠãã¹ã10000ã®ã“ã¨ã€ã¨ã„ã†ã‚¿ã‚¤ãƒˆãƒ«ã®è¨˜äº‹ãŒã‚ã£ãŸã®ã§ã€ä½•äº‹ã‹ã¨æ€ã„ã¾ã—ãŸã€‚10000 things all ICS students should do before graduating | Tagide10000個もã‚ã‚‹ã®ã‹â€¦ã¨ã³ã£ãã‚Šã—ã¾ã—ãŸãŒã€ã‚ˆãèªã‚€ã¨2進数ã§æ›¸ã‹ã‚Œã¦ã„ã¦ã€16個ã¨ã„ã†æ„味ã§ã—ãŸã€‚内容もã¨ã¦ã‚‚良ã„ã“ã¨ã‚’言ã£ã¦ã„ã‚‹ã¨æ€ã†ã®ã§ã€ç°¡å˜ã«ç´¹ä»‹ã—ã¦ã¿ã¾ã™ã€‚ 0000 – 自分ã®ãƒ‰ãƒ¡ã‚¤ãƒ³ã‚’買ㆠ0001 – Apacheをインストールã—ã¦è¨å®šã‚’ã„ã˜ã‚‹ï¼ˆè¤‡æ•°ãƒ‰ãƒ¡ã‚¤ãƒ³å¯¾å¿œã¨ã‹ï¼‰ 0010 – WordPressをインストールã—ã¦ãƒ–ãƒã‚°ã‚’書ãã€‚æ–‡ç« ã‚¹ã‚ルも大事。 0011 – 自分ã®ã‚¦ã‚§ãƒ–サイトをé‹å–¶ã™ã‚‹ 0100 – LAMPã§ã‚¦ã‚§ãƒ–アプリを書ã。少ãªãã¨ã‚‚1ã¤ã€ã§ãã‚Œã°PHPã¨Pythonã§ã€‚ 0101 – 自分ã®ã‚µãƒ¼ãƒãƒ¼ï¼ˆç‰©ç†orクラウド）をæŒã¤
グーグルã€ãƒ•ãƒ«æ©Ÿèƒ½ã®MapReduceã‚’Google App Engineã§æä¾›ã¸
グーグルã¯åŒç¤¾ã®ã‚¯ãƒ©ã‚¦ãƒ‰ã‚µãƒ¼ãƒ“スã§ã‚ã‚‹Google App Engineã§ã€ãƒ•ãƒ«æ©Ÿèƒ½ã®MapReduce機能をæä¾›ã™ã‚‹ã“ã¨ãŒåŒç¤¾ã®ã‚¤ãƒ™ãƒ³ãƒˆGoogle I/O 2011ã§æ˜Žã‚‰ã‹ã«ã—ã¾ã—ãŸã€‚ ã“ã‚Œã¾ã§Google App Engineã§ã¯MapReduceを構æˆã™ã‚‹ã€ŒMapã€ã€ŒShuffleã€ã€ŒRuduceã€ã®3ã¤ã®ã†ã¡ã€Mapperã®æ©Ÿèƒ½ã®æä¾›ãŒè¡Œã‚ã‚Œã¦ãã¾ã—ãŸã€‚ Google I/O 2011ã§è¡Œã‚ã‚ŒãŸã‚»ãƒƒã‚·ãƒ§ãƒ³ã€ŒApp Engine MapReduceã€ã§ã¯ã€MapReduceを構æˆã™ã‚‹ã™ã¹ã¦ã®æ©Ÿèƒ½ã®æä¾›ãŒè¡Œã‚れるã“ã¨ãŒç™ºè¡¨ã•ã‚Œã¦ã„ã¾ã™ã€‚ セッションã®ãƒã‚¤ãƒ³ãƒˆã‚’紹介ã—ã¾ã—ょã†ã€‚ App Engine MapReduce App Engineエンジニアリングãƒãƒ¼ãƒ ã®Mike Aizatskyæ°ã€‚ MapReduceã¯æ•°å¹´å‰ã«ã‚°ãƒ¼ã‚°ãƒ«ãŒé–‹ç™ºã—ãŸå‡¦ç†ã€‚社内ã§ã¯ã»ã¨ã‚“ã©ã‚らゆるãƒãƒ¼ãƒ ãŒã“ã®å‡¦ç†
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
English (US)
Scalaã§MapReduceã®é¢å€’ãªè¨˜è¿°ã‚’çœç•¥ã—よã†ã¨ã—ãŸãƒ¡ãƒ¢ : mwSoft blog
{{#tags}}- {{label}}
{{/tags}}