[B! mapreduce] lizyã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

lizy id:lizy

mapreduceã«é–¢ã™ã‚‹lizyã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (65)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Googleã€Hadoopä¸Šã§ãƒã‚¤ãƒ†ã‚£ãƒ–ã‚³ãƒ¼ãƒ‰ã‚’å‹•ã‹ã™MR4Cã‚’ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹å…¬é–‹
ã‚ãªãŸã«ã¨ã£ã¦é‡è¦ãªãƒˆãƒ”ãƒƒã‚¯ã‚„åŒåƒšã®æœ€æ–°æƒ…å ±ã‚’å…¥æ‰‹ã—ã¾ã—ã‚‡ã†æœ€æ–°ã®æ´žå¯Ÿã¨ãƒˆãƒ¬ãƒ³ãƒ‰ã«é–¢ã™ã‚‹æœ€æ–°æƒ…å ±ã‚’å³åº§ã«å—ã‘å–ã‚Šã¾ã—ã‚‡ã†ã€‚ ç¶™ç¶šçš„ãªå¦ç¿’ã®ãŸã‚ã«ã€ç„¡æ–™ã®ãƒªã‚½ãƒ¼ã‚¹ã«æ‰‹è»½ã«ã‚¢ã‚¯ã‚»ã‚¹ã—ã¾ã—ã‚‡ã†ãƒŸãƒ‹ãƒ–ãƒƒã‚¯ã€ãƒˆãƒ©ãƒ³ã‚¹ã‚¯ãƒªãƒ—ãƒˆä»˜ãå‹•ç”»ã€ãŠã‚ˆã³ãƒˆãƒ¬ãƒ¼ãƒ‹ãƒ³ã‚°æ•™æã€‚ è¨˜äº‹ã‚’ä¿å˜ã—ã¦ã€ã„ã¤ã§ã‚‚èªã‚€ã“ã¨ãŒã§ãã¾ã™è¨˜äº‹ã‚’ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ã—ã¦ã€æº–å‚™ãŒã§ããŸã‚‰ã„ã¤ã§ã‚‚èªã‚ã¾ã™ã€‚
lizy 2015/03/11
mapreduce

hadoop

c
ãƒªãƒ³ã‚¯
ä¸¦åˆ—ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã‚·ã‚¹ãƒ†ãƒ ã®æ¦‚å¿µã¨åŽŸç†
2014/01/30 ç‘æ³¢å¤§å¦æƒ…å ±ã‚·ã‚¹ãƒ†ãƒ ç‰¹åˆ¥è¬›ç¾©Dã®è¬›ç¾©è³‡æ–™ã§ã™ã€‚ joiné–¢ä¿‚ã¯NAISTæ™‚ä»£ã®å®®å´Žå…ˆç”Ÿã®ãƒ‡ãƒ¼ã‚¿å·¥å¦â…¡ã®å†…å®¹ã‚’å‚è€ƒã«ã—ã¦ã¾ã™ã€‚ animationæœ‰åŠ¹ãªãƒ“ãƒ‡ã‚ªã¯ã“ã¡ã‚‰ https://vimeo.com/85598907
lizy 2014/02/02
database

mapreduce

bigdata

parallel

concurrent
ãƒªãƒ³ã‚¯
AWS News Blog
Amazon SageMaker Geospatial Capabilities Now Generally Available with Security Updates and More Use Case Samples At AWS re:Invent 2022, we previewed Amazon SageMaker geospatial capabilities, allowing data scientists and machine learning (ML) engineers to build, train, and deploy ML models using geospatial data. Geospatial ML with Amazon SageMaker supports access to readily available geospatial dat
lizy 2012/02/09
amazon

cloudcomputing

aws

mapreduce
ãƒªãƒ³ã‚¯
Hadoopã‚’æ¥å‹™ã§ä½¿ã£ã¦ã¿ã¾ã—ãŸ
Hadoop is an open-source software framework for distributed storage and processing of large datasets across clusters of computers. It allows for the distributed processing of large datasets across clusters of nodes using simple programming models. Hadoop can distribute data and computations across a cluster of commodity machines and scale to thousands of nodes, handling failures in an automatic wa
lizy 2012/01/05
mapreduce

hadoop
ãƒªãƒ³ã‚¯
NoSQLã¨Hadoopã‚’ã€ã‚ªãƒ©ã‚¯ãƒ«ã¯ä¼æ¥ãŒä½¿ã†ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã¨ã—ã¦ã©ã†ä½ç½®ã¥ã‘ã‚ˆã†ã¨ã—ã¦ã„ã‚‹ã®ã‹ï¼Ÿ
ã€ŒNoSQLã¯ã‚½ãƒ¼ã‚·ãƒ£ãƒ«ãƒ¡ãƒ‡ã‚£ã‚¢ã®ã‚ˆã†ãªãƒãƒƒãƒˆã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³å‘ã‘ã§ã‚ã‚Šã€ä¼æ¥å†…ã®ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã¨ã—ã¦ã¯å‘ã‹ãªã„ã€ã€‚ã“ã‚Œã¾ã§NoSQLãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã¯ä¸€èˆ¬ã«ãã†æ€ã‚ã‚Œã¦ã„ã¾ã—ãŸã€‚ ã—ã‹ã—ã‚ªãƒ©ã‚¯ãƒ«ã¯ä»Šæœˆã€ã‚µãƒ³ãƒ•ãƒ©ãƒ³ã‚·ã‚¹ã‚³ã§é–‹å‚¬ã—ãŸã€ŒOracle OpenWorld 2011ã€ã§ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿å¸‚å ´ã¸ã®å‚å…¥ã‚’è¡¨æ˜Žã€‚è£½å“ã¨ã—ã¦ã€ä¼æ¥å‘ã‘ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã¨ã—ã¦ã‚ãƒ¼ãƒãƒªãƒ¥ãƒ¼åž‹ãƒ‡ãƒ¼ã‚¿ã‚¹ãƒˆã‚¢ã€ŒOracle NoSQL Databaseã€ã¨ã€ŒApache Hadoopã€ã‚’æè¼‰ã—ãŸã€ŒOracle Big Data Applianceã€ã‚’ç™ºè¡¨ã—ã¾ã—ãŸã€‚ ã‚ªãƒ©ã‚¯ãƒ«ã¯ä¼æ¥ãŒä½¿ã†ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã¨ã—ã¦NoSQLã‚„Hadoopã‚’ã©ã®ã‚ˆã†ã«ä½ç½®ã¥ã‘ã‚ˆã†ã¨ã—ã¦ã„ã‚‹ã®ã§ã—ã‚‡ã†ã‹ï¼Ÿ æ˜¨æ—¥10æœˆ25æ—¥ã«éƒ½å†…ã§é–‹å‚¬ã•ã‚ŒãŸæ—¥æœ¬ã‚ªãƒ©ã‚¯ãƒ«ä¸»å‚¬ã®ã‚¤ãƒ™ãƒ³ãƒˆã€ŒOracle Database/Exadata Summitã€ã«ãŠã„ã¦ã€ç±³ã‚ªãƒ©ã‚¯ãƒ«ã§ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹è£½
lizy 2011/10/26
NoSQLï¼ç‰©ç½®ï¼Ÿ

oracle

database

nosql

hadoop

mapreduce
ãƒªãƒ³ã‚¯
ç±³ãƒžã‚¤ã‚¯ãƒã‚½ãƒ•ãƒˆã€Windows Serverã¨Windows Azureå‘ã‘ã®ã€ŒHadoopã€
ç±³ãƒžã‚¤ã‚¯ãƒã‚½ãƒ•ãƒˆã¯2011å¹´10æœˆ12æ—¥ï¼ˆç±³å›½æ™‚é–“ï¼‰ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚¨ã‚¢ï¼ˆOSSï¼‰ã®åˆ†æ•£ãƒãƒƒãƒå‡¦ç†ã‚½ãƒ•ãƒˆã€ŒHadoopã€ã®ä¸å¿ƒçš„ãªé–‹ç™ºä¼æ¥ã®ä¸€ã¤ã§ã‚ã‚‹ç±³ãƒ›ãƒ¼ãƒˆãƒ³ãƒ¯ãƒ¼ã‚¯ã‚¹ã¨ææºã—ã¦ã€Windows Serverã¨Windows Azureå‘ã‘ã®Hadoopãƒ‡ã‚£ã‚¹ãƒˆãƒªãƒ“ãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã‚’æä¾›ã™ã‚‹ã¨ç™ºè¡¨ã—ãŸã€‚2011å¹´æœ«ã¾ã§ã«ã€Windows Azureå‘ã‘Hadoopã®CTPï¼ˆã‚³ãƒŸãƒ¥ãƒ‹ãƒ†ã‚£å‘ã‘æŠ€è¡“è©•ä¾¡ç‰ˆï¼‰ã‚’ãƒªãƒªãƒ¼ã‚¹ã™ã‚‹ã€‚ Hadoopã¯ã€ç±³ã‚°ãƒ¼ã‚°ãƒ«ã®ã€ŒMapReduceã€ã‚„ã€ŒGoogle File Systemã€ã‚’å‚è€ƒã«ã—ãŸåˆ†æ•£ãƒãƒƒãƒå‡¦ç†ã‚½ãƒ•ãƒˆã§ã€ç±³ãƒ¤ãƒ•ãƒ¼ãŒä¸å¿ƒã¨ãªã£ã¦é–‹ç™ºã—ã¦ããŸã€‚ãƒ›ãƒ¼ãƒˆãƒ³ãƒ¯ãƒ¼ã‚¯ã‚¹ã¯ã€ãƒ¤ãƒ•ãƒ¼ã®Hadoopé–‹ç™ºãƒãƒ¼ãƒ ãŒä»Šå¹´6æœˆã«ç‹¬ç«‹ã—ãŸä¼æ¥ã§ã‚ã‚‹ã€‚ã¾ãŸHadoopã¯ç¾åœ¨ã€Apacheã‚½ãƒ•ãƒˆã‚¦ã‚¨ã‚¢è²¡å›£ã®ãƒˆãƒƒãƒ—ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã§ã‚ã‚‹ã€‚ MSã¨ãƒ›ãƒ¼ãƒˆãƒ³ãƒ¯ãƒ¼ã‚¯ã‚¹ã¯å…±åŒã§ã€Windowså‘
lizy 2011/10/13
mapreduce

hadoop

microsoft

windows

windows azure
ãƒªãƒ³ã‚¯
ã„ã¾ã•ã‚‰èžã‘ãªã„Hadoopã¨ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°å…¥é–€
ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿æ™‚ä»£ã®æ•‘ä¸–ä¸»ã€ŒHadoopã€ã¨ã¯ ã€ŒApache Hadoopã€ã¯ä»Šã€æœ€ã‚‚æ³¨ç›®ã‚’é›†ã‚ã¦ã„ã‚‹æŠ€è¡“ã®1ã¤ã§ã™ã€‚Hadoopã¨ã¯ã€å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’æ‰‹è»½ã«è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã—ã¦å‡¦ç†ã§ãã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã§ã™ã€‚ Hadoopã‚’æ´»ç”¨ã—ã¦ã„ã‚‹ä¼æ¥ã¯å¹´ã€…å¢—ãˆç¶šã‘ã¦ã„ã¦ã€ä¸å¯æ¬ ãªæŠ€è¡“ã«ãªã‚Šã¤ã¤ã‚ã‚‹ã¨ã„ãˆã‚‹ã§ã—ã‚‡ã†ã€‚ æœ¬é€£è¼‰ã§ã¯ã€Hadoopã¨ã¯ä½•ã‹ã€HadoopãŒã©ã†æ´»ç”¨ã§ãã‚‹ã®ã‹ã¨ã„ã†ã“ã¨ã‚’ã€ã€Œãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã€ã«ç„¦ç‚¹ã‚’å½“ã¦ã¦è§£èª¬ã—ã¦ã„ããŸã„ã¨æ€ã„ã¾ã™ã€‚ é‡ã„å‡¦ç†ã‚’è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã•ã›ã‚‹ è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«å‡¦ç†ã‚’åˆ†æ•£ã•ã›ã‚‹ã«ã¯ã€ãƒ—ãƒã‚»ã‚¹åŒå£«ã®é€šä¿¡ã€ç›£è¦–ã€éšœå®³æ™‚ã®å¯¾å¿œãªã©ã‚’è€ƒãˆãªã‘ã‚Œã°ãªã‚‰ãšã€ãƒ—ãƒã‚°ãƒ©ãƒžã«ã¨ã£ã¦ãƒãƒ¼ãƒ‰ãƒ«ãŒé«˜ã„ã‚‚ã®ã§ã™ã€‚ã—ã‹ã—ã€Hadoopã¯ãã†ã„ã£ãŸé¢å€’ãã•ã„å‡¦ç†ã‚’ä¸€æ‰‹ã«å¼•ãå—ã‘ã¦ãã‚Œã€ãƒ—ãƒã‚°ãƒ©ãƒžã¯ã€ã‚„ã‚ŠãŸã„å‡¦ç†ã ã‘ã«é›†ä¸ã§ãã¾ã™ã€‚ ä¾‹ãˆã°ã€Hadoopã‚’ä½¿ã†ã¨ã€1
lizy 2011/06/21
hadoop

mapreduce
ãƒªãƒ³ã‚¯
ã‚°ãƒ¼ã‚°ãƒ«ã€ãƒ•ãƒ«æ©Ÿèƒ½ã®MapReduceã‚’Google App Engineã§æä¾›ã¸
ã‚°ãƒ¼ã‚°ãƒ«ã¯åŒç¤¾ã®ã‚¯ãƒ©ã‚¦ãƒ‰ã‚µãƒ¼ãƒ“ã‚¹ã§ã‚ã‚‹Google App Engineã§ã€ãƒ•ãƒ«æ©Ÿèƒ½ã®MapReduceæ©Ÿèƒ½ã‚’æä¾›ã™ã‚‹ã“ã¨ãŒåŒç¤¾ã®ã‚¤ãƒ™ãƒ³ãƒˆGoogle I/O 2011ã§æ˜Žã‚‰ã‹ã«ã—ã¾ã—ãŸã€‚ ã“ã‚Œã¾ã§Google App Engineã§ã¯MapReduceã‚’æ§‹æˆã™ã‚‹ã€ŒMapã€ã€ŒShuffleã€ã€ŒRuduceã€ã®3ã¤ã®ã†ã¡ã€Mapperã®æ©Ÿèƒ½ã®æä¾›ãŒè¡Œã‚ã‚Œã¦ãã¾ã—ãŸã€‚ Google I/O 2011ã§è¡Œã‚ã‚ŒãŸã‚»ãƒƒã‚·ãƒ§ãƒ³ã€ŒApp Engine MapReduceã€ã§ã¯ã€MapReduceã‚’æ§‹æˆã™ã‚‹ã™ã¹ã¦ã®æ©Ÿèƒ½ã®æä¾›ãŒè¡Œã‚ã‚Œã‚‹ã“ã¨ãŒç™ºè¡¨ã•ã‚Œã¦ã„ã¾ã™ã€‚ ã‚»ãƒƒã‚·ãƒ§ãƒ³ã®ãƒã‚¤ãƒ³ãƒˆã‚’ç´¹ä»‹ã—ã¾ã—ã‚‡ã†ã€‚ App Engine MapReduce App Engineã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ãƒªãƒ³ã‚°ãƒãƒ¼ãƒ ã®Mike Aizatskyæ°ã€‚ MapReduceã¯æ•°å¹´å‰ã«ã‚°ãƒ¼ã‚°ãƒ«ãŒé–‹ç™ºã—ãŸå‡¦ç†ã€‚ç¤¾å†…ã§ã¯ã»ã¨ã‚“ã©ã‚ã‚‰ã‚†ã‚‹ãƒãƒ¼ãƒ ãŒã“ã®å‡¦ç†
lizy 2011/05/30
google

mapreduce

cloudcomputing

google app engine
ãƒªãƒ³ã‚¯
Hadoopã‚’ç”¨ã„ãŸå¤§è¦æ¨¡ãƒã‚°è§£æž
HDFSæ–°æ©Ÿèƒ½ç·ã¾ã¨ã‚in 2015 ï¼ˆæ—¥æœ¬Hadoopãƒ¦ãƒ¼ã‚¶ãƒ¼ä¼š ãƒ©ã‚¤ãƒˆãƒ‹ãƒ³ã‚°ãƒˆãƒ¼ã‚¯ï¼ Cloudera World Tokyo 2015ã€€è¬›æ¼”è³‡æ–™ï¼‰
lizy 2011/04/11
hadoop

mapreduce
ãƒªãƒ³ã‚¯
[O] Hadoop Conference Japan 2011 ã«å‚åŠ ã—ã¦ãã¾ã—ãŸ #hcj2011
overlasting.net 2019 Copyright. All Rights Reserved. The Sponsored Listings displayed above are served automatically by a third party. Neither the service provider nor the domain owner maintain any relationship with the advertisers. In case of trademark issues please contact the domain owner directly (contact information can be found in whois). Privacy Policy
lizy 2011/02/22
hadoop

mapreduce
ãƒªãƒ³ã‚¯
ã€Œæ¬¡ä¸–ä»£Hadoopã®é–‹ç™ºã«ç€æ‰‹ã™ã‚‹ã€Yahoo!ãŒå®£è¨€ã€æ•°ä¸‡å°ä»¥ä¸Šã®ã‚¯ãƒ©ã‚¹ã‚¿ã‚’ã‚µãƒãƒ¼ãƒˆã¸
ç±³Yahoo!ãŒå¤§è¦æ¨¡åˆ†æ•£å‡¦ç†ã®ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã€ŒHadoopã€ã®æ¬¡ä¸–ä»£ç‰ˆã‚’é–‹ç™ºã™ã‚‹ã“ã¨ã‚’ã€ãƒ–ãƒã‚°Yahoo! Developers Networkã«ãƒã‚¹ãƒˆã—ãŸã‚¨ãƒ³ãƒˆãƒªã€ŒThe Next Generation of Apache Hadoop MapReduceã€ã§æ˜Žã‚‰ã‹ã«ã—ã¾ã—ãŸã€‚ Yahoo!ã«ã‚ˆã‚‹ã¨ã€ç¾åœ¨ã®Hadoopã®å®Ÿè£…ã§ã¯1ã‚¯ãƒ©ã‚¹ã‚¿ã‚ãŸã‚Š4000å°ç¨‹åº¦ã§ã‚¹ã‚±ãƒ¼ãƒ©ãƒ“ãƒªãƒ†ã‚£ã®é™ç•Œã«ã‚ãŸã‚‹ãŸã‚ã€ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ã‚’è¦‹ç›´ã—ã¦ä¿¡é ¼æ€§ã‚„å¯ç”¨æ€§ã‚’é«˜ã‚ã‚‹ã¨åŒæ™‚ã«ã€1ä¸‡å°ã‹ã‚‰2ä¸‡å°ã‚’è¶…ãˆã‚‹ã‚¯ãƒ©ã‚¹ã‚¿ã®ã‚¹ã‚±ãƒ¼ãƒ©ãƒ“ãƒªãƒ†ã‚£ã‚’å®Ÿç¾ã—ãŸã†ãˆã§ã€å¾“æ¥ã®Hadoopã¨ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã®äº’æ›æ€§ã‚’ä¿ã¤äºˆå®šã¨ã®ã“ã¨ã€‚ã•ã‚‰ã«ã€ãƒžãƒ«ãƒãƒ†ãƒŠãƒ³ãƒˆå¯¾å¿œã€å¤šè¨€èªžãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ã®ã‚µãƒãƒ¼ãƒˆãªã©ã‚‚å®Ÿç¾ã™ã‚‹äºˆå®šã®ã‚ˆã†ã§ã™ã€‚ Apache Hadoopã‚³ãƒŸãƒ¥ãƒ‹ãƒ†ã‚£ã¨å”åŠ›ã—ã¦é–‹ç™ºã‚’é€²ã‚ã‚‹ Yahoo!ã¯ãƒ–ãƒã‚°ã§æ¬¡ã®ã‚ˆã†ã«æ›¸ã„ã¦ã„ã¾ã™ã€‚ The c
lizy 2011/02/21
mapreduce

hadoop
ãƒªãƒ³ã‚¯
HadoopãŒJavaã§ã¯ãªãC/C++ã§å®Ÿè£…ã•ã‚Œã¦ã„ãŸã‚‰ã©ã†é•ã£ã¦ã„ãŸã‹ï¼Ÿ - nokunoã®æ—¥è¨˜
Quoraã§ã“ã‚“ãªè³ªå•ã‚’è¦‹ã¤ã‘ãŸã®ã§é©å½“ã«ç¿»è¨³ã—ã¦ã¿ã¾ã—ãŸã€‚Would Hadoop be different if it were coded in C/C++ instead of Java? How? - Quora å›žç”1å®Ÿéš›ã®ã¨ã“ã‚é›£ã—ã„ã‘ã©ã€è€ƒãˆã¦ã¿ã‚‹ã®ã¯æ¥½ã—ã„ãã€‚ å®Ÿè¡Œæ™‚é–“ã¯é€Ÿããªã‚‹ã¨æ€ã†ã‘ã©ã€ãã‚ŒãŒæ±ºå®šçš„ãªé•ã„ã«ãªã‚‹ã‹ã©ã†ã‹ã¯ã‚ã‹ã‚‰ãªã„ã€‚ ã‚»ã‚ãƒ¥ãƒªãƒ†ã‚£ã‚„ã„ãã¤ã‹ã®æ©Ÿèƒ½ã¯å®Ÿè£…ã—ã‚„ã™ããªã‚‹ã‹ã‚‚ã—ã‚Œãªã„ ä»–ã®ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°è¨€èªžã¸ã®å¯¾å¿œã¯ã—ã‚„ã™ããªã‚‹ã€‚Java/Pipes/Streamingã‚’é¸ã¶ä»£ã‚ã‚Šã«ã€ã‚³ãƒ³ãƒ‘ã‚¤ãƒ«ã—ã¦ãƒªãƒ³ã‚¯ã™ã‚Œã°ã„ã„ã€‚ ã‚³ãƒ¼ãƒ‰é‡ã¯éžå¸¸ã«å¤§ãããªã‚‹ã€‚ã‚¨ãƒ©ãƒ¼ãƒã‚§ãƒƒã‚¯ã®ãŸã‚ã«ãã€‚ ã‚³ãƒ¼ãƒ‰ãƒ™ãƒ¼ã‚¹ãŒå¤§ãããªã‚Œã°ã€é–‹ç™ºã‚¹ãƒ”ãƒ¼ãƒ‰ã¯é…ããªã‚‹ã€‚HadoopãŒä»Šã®ã‚ˆã†ã«æˆé•·ã—ãŸã‹ã©ã†ã‹ã‚ã‹ã‚‰ãªã„ã€‚ Pigã¯ç™»å ´ã—ãŸã ã‚ã†ã‹ï¼Ÿã€€ç§ã«ã¯ãã†ã¯æ€ãˆãªã„ã€‚å›žç”2ã¯ç•¥ å›žç”3C/C++ã¨Ja
lizy 2011/02/04
å›žç”3ã¯ã€ã‚½ãƒ¼ã‚¹ã‚’é€ã‚Šè¾¼ã‚“ã§on-the-flyã§ã‚³ãƒ³ãƒ‘ã‚¤ãƒ«ã•ã›ã‚‹ã¨ã‹ï¼Ÿ

hadoop

mapreduce

c++
ãƒªãƒ³ã‚¯
ç¬¬3å›žã€€Amazon Elastic MapReduce Ruby Clientã§EMRã‚’èµ·å‹•ã™ã‚‹ | gihyo.jp
å‰å›žã¯ã€Web Consoleã‹ã‚‰Amazon Elastic MapReduceã‚’èµ·å‹•ã™ã‚‹æ–¹æ³•ã‚’èª¬æ˜Žã—ã¾ã—ãŸã€‚ä»Šå›žã¯APIã§ã®èµ·å‹•æ–¹æ³•ã‚’ç´¹ä»‹ã—ã¦ã„ãã¾ã™ã€‚ Web Consoleã¨APIã¯ã©ã“ãŒé•ã†ã®ã‹ ä½¿ç”¨å‰ã«ã€ã¾ãšWeb Consoleã¨APIã®é•ã„ã‚’ãŠã•ãˆã¦ãŠãã¾ã—ã‚‡ã†ã€‚ Webã‚³ãƒ³ã‚½ãƒ¼ãƒ«ã¯ã€1å›žã®æ“ä½œã§Jobã‚’1ã¤ã—ã‹å®Ÿè¡Œã§ãã¾ã›ã‚“ã€‚ã“ã‚Œã ã¨ã€æ¯Žå›žEC2ã®ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ãŒèµ·å‹•ã€ã‚¿ãƒ¼ãƒŸãƒãƒ¼ãƒˆãŒèµ°ã‚Šã€ã‚ã¾ã‚ŠåŠ¹çŽ‡çš„ã¨ã¯ã„ãˆã¾ã›ã‚“ã€‚ ä¸€æ–¹APIã‚’ä½¿ç”¨ã™ã‚‹ã¨ã€1å›žã®èµ·å‹•ã§è¤‡æ•°ã®Jobã‚’å®Ÿè¡Œã§ãã¾ã™ã€‚ãŸã¨ãˆã°ã€3ã¤ã®Jobã‚’å®Ÿè¡Œã—ãŸã„å ´åˆã¯ã€ä»¥ä¸‹ã®ã‚ˆã†ãªæ“ä½œãŒå¯èƒ½ã«ãªã‚Šã¾ã™ã€‚ APIã§EMRã‚’èµ·å‹•ã™ã‚‹ â†“ 3ã¤ã®Jobã‚’æŠ•å…¥ã™ã‚‹ â†“ ã™ã¹ã¦ã®JobãŒçµ‚äº†ã—ãŸã‚‰ã€EMRã‚’ã‚¿ãƒ¼ãƒŸãƒãƒ¼ãƒˆã™ã‚‹ ã¾ãŸã€ã€Œâ æœ€è¿‘EMRã§åŠ ã‚ã£ãŸæ–°æ©Ÿèƒ½ã‚’åˆ©ç”¨ä¸ã«ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹æ•°ã‚’å¤‰æ›´ã€ã¨ã„ã£ãŸã“ã¨ã‚‚ã§ãã¾ã™ã€‚ EMRã§ã¯ã©ã®
lizy 2011/01/28
amazon

cloudcomputing

mapreduce
ãƒªãƒ³ã‚¯
Amazon Elastic MapReduceã«ä»Šã•ã‚‰å…¥é–€ã—ã¦ã¿ãŸ - nokunoã®æ—¥è¨˜
ã¨ã„ã†ã‚ã‘ã§å†¬ä¼‘ã¿æœ€å¾Œã®è‡ªç”±ç ”ç©¶ã¨ã—ã¦ã€Amazon Elastic MapReduceï¼ˆEMRï¼‰ã‚’ä½¿ã£ã¦ã¿ã¾ã—ãŸã€‚ä»Šãªã‚‰å…¬å¼ãƒšãƒ¼ã‚¸ã‚‚ã»ã¼æ—¥æœ¬èªžåŒ–ã—ã¦ã„ã¦æ¥½ãƒãƒ³ã§ã™ã€‚Amazon Web Services (æ—¥æœ¬èªž) Amazon Elastic MapReduceã¨ã¯Amazon EMRã¯ã€Amazonã®ã‚¤ãƒ³ãƒ•ãƒ©ä¸Šã§å‹•ä½œã™ã‚‹ä»®æƒ³ã‚µãƒ¼ãƒãƒ¼ã‚’ä½¿ã£ãŸHadoopã‚¯ãƒ©ã‚¹ã‚¿ã‚’æ™‚é–“å˜ä¾¡ã§è²¸ã—å‡ºã™ã‚µãƒ¼ãƒ“ã‚¹ã§ã™ã€‚å°‘ã€…ã‚ã‹ã‚Šã«ãã„ã®ã§ã€Amazon Web Service(AWS)ã®é–¢é€£ã™ã‚‹è£½å“ç¾¤ã«ã¤ã„ã¦æ•´ç†ã—ã¦ãŠãã¾ã™ã€‚EC2 (Elastic Compute Cloud) EC2ã¯ã€ä»®æƒ³ãƒžã‚·ãƒ³ã‚’æ™‚é–“å˜ä¾¡ã§è²¸ã—å‡ºã™ã‚µãƒ¼ãƒ“ã‚¹ã§ã™ã€‚ EMRã‚’ä½¿ã‚ãšã«ã€EC2ã«è‡ªå‰ã§Hadoopã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã—ã¦ä½¿ã†ã‚„ã‚Šæ–¹ã‚‚ã‚ã‚Šã¾ã™ï¼ˆEMRãŒå‡ºæ¥ã‚‹ä»¥å‰ã¯ãã‚Œã—ã‹ãªã‹ã£ãŸï¼‰ã€‚ EMRã‚’ä½¿ã†å ´åˆã§ã‚‚ã€ãƒãƒƒã‚¯ã‚°ãƒ©ã‚¦ãƒ³ãƒ‰ã§ã¯è‡ªå‹•çš„ã«
lizy 2011/01/04
amazon

cloudcomputing

mapreduce
ãƒªãƒ³ã‚¯
ãã‚ãã‚Hadoopã«ã¤ã„ã¦ã²ã¨ã“ã¨è¨€ã£ã¦ãŠãã‹ - nokunoã®æ—¥è¨˜
ã‚‚ã†ã“ã®æ‰‹ã®è©±é¡Œã¯å‡ºå°½ãã—ãŸæ„ŸãŒã‚ã‚Šã¾ã™ãŒã€æœ€è¿‘Hadoopã«ã¤ã„ã¦è€ƒãˆã‚‹ã“ã¨ãŒå¤šã„ã®ã§ã€ã‚¨ãƒ³ãƒˆãƒªã«ã—ã¦ã¿ã¾ã™ã€‚ãªãŠã€ã“ã“ã§ã¯ãƒ™ãƒ¼ã‚·ãƒƒã‚¯ãªMapReduce+HDFSã®ã“ã¨ã‚’Hadoopã¨å‘¼ã¶ã“ã¨ã«ã—ã¾ã™ã€‚ Hadoopã¨ã¯Hadoopã¨ã¯è¨€ã‚ãšã¨çŸ¥ã‚ŒãŸGoogleã®MapReduce/GFSã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ã‚¯ãƒãƒ¼ãƒ³ã§ã™ã€‚MapReduceã§ã¯ãƒ—ãƒã‚°ãƒ©ãƒžã¯Mapã¨Reduceã¨ã„ã†2ã¤ã®é–¢æ•°ã‚’æ›¸ãã ã‘ã§ã€ä¸¦åˆ—åˆ†æ•£å‡¦ç†ã‚’ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ã“ã‚Œã¯(1) ãƒ‡ãƒ¼ã‚¿ã‚’å®Ÿéš›ã«æŒã¤ãƒžã‚·ãƒ³ã«ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’é…å¸ƒã™ã‚‹ (2) Mapã¨Reduceã‚’ã¤ãªãShuffleãƒ•ã‚§ãƒ¼ã‚ºã§ã‚ãƒ¼ã‚’ã‚°ãƒ«ãƒ¼ãƒ—åŒ–ã—ã¦ã‚½ãƒ¼ãƒˆã™ã‚‹ã€(3) éšœå®³æ™‚ã®ãƒ•ã‚§ãƒ¼ãƒ«ã‚ªãƒ¼ãƒãƒ¼ã‚„ãƒ¬ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã€ã¨ã„ã£ãŸå‡¦ç†ã‚’ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯å´ãŒå—ã‘æŒã¤ã“ã¨ã«ã‚ˆã£ã¦ã€ãƒ—ãƒã‚°ãƒ©ãƒžå´ã®è² æ‹…ã‚’æ¸›ã‚‰ã™ã‚‚ã®ã§ã™ã€‚GFSã«å¯¾å¿œã™ã‚‹HDFSã«ã¯ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ã‚¯ãƒ©ã‚¹ã‚¿ã«åˆ†æ•£ã—ã¦ä¿å˜
lizy 2011/01/03
mapreduce

hadoop
ãƒªãƒ³ã‚¯
NTTãƒ‡ãƒ¼ã‚¿ãŒHadoopãƒ“ã‚¸ãƒã‚¹ã‚’æ‹¡å¤§ã€ç±³ã‚¯ãƒ©ã‚¦ãƒ‡ãƒ©ã¨ææº
NTTãƒ‡ãƒ¼ã‚¿ã¯ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®åˆ†æ•£ãƒãƒƒãƒå‡¦ç†ã‚½ãƒ•ãƒˆã€ŒHadoopã€å°‚æ¥ã®ãƒ™ãƒ³ãƒãƒ£ãƒ¼ä¼æ¥ã§ã‚ã‚‹ç±³ã‚¯ãƒ©ã‚¦ãƒ‡ãƒ©ã¨ææºã—ã€ã‚¯ãƒ©ã‚¦ãƒ‡ãƒ©ã®é–‹ç™ºã™ã‚‹Hadoopé–¢é€£è£½å“ã‚’ã€æ—¥æœ¬ã‚’å«ã‚€ã‚¢ã‚¸ã‚¢å¤ªå¹³æ´‹åœ°åŸŸã§è²©å£²ã™ã‚‹ã€‚2010å¹´10æœˆ12æ—¥ï¼ˆç±³å›½æ™‚é–“ï¼‰ã«ç±³å›½ãƒ‹ãƒ¥ãƒ¼ãƒ¨ãƒ¼ã‚¯ã§é–‹å‚¬ã•ã‚Œã‚‹ã€ŒHadoop World 2010ã€ã§ã€NTTãƒ‡ãƒ¼ã‚¿ã®å±±ç”°ä¼¸ä¸€å¸¸å‹™ãŒç™ºè¡¨ã™ã‚‹ã€‚ä¸¡ç¤¾ã¯å…±åŒã§ã€Hadoopã®ã‚µãƒãƒ¼ãƒˆã‚„ç ”ä¿®ã‚µãƒ¼ãƒ“ã‚¹ãªã©ã‚‚å±•é–‹ã™ã‚‹ã€‚ Hadoopã¯ã€åˆ†æ•£å‡¦ç†ã‚·ã‚¹ãƒ†ãƒ ã‚’æ§‹ç¯‰ã™ã‚‹ãŸã‚ã®ãƒŸãƒ‰ãƒ«ã‚¦ã‚¨ã‚¢ã€‚ã‚°ãƒ¼ã‚°ãƒ«ãŒWebæ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã®ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ã‚’ä½œæˆã™ã‚‹ãŸã‚ã«ç‹¬è‡ªé–‹ç™ºã—ãŸåˆ†æ•£ãƒãƒƒãƒå‡¦ç†ã‚½ãƒ•ãƒˆã€ŒMapReduceã€ã¨ã€åˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã®ã€ŒGoogle File Systemï¼ˆGFSï¼‰ã€ã‚’åŸºã«ã—ã¦ä½œã‚‰ã‚ŒãŸã€‚ãƒ—ãƒã‚°ãƒ©ãƒžã¯Hadoopã‚’ä½¿ã†ã“ã¨ã§ã€ãƒ‡ãƒ¼ã‚¿ã‚’ãƒŽãƒ¼ãƒ‰ã«åˆ†æ•£ã—ãŸã‚Šé›†ç´„ã—ãŸã‚Šã™ã‚‹ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯å‡¦ç†æ©Ÿæ§‹ã‚’ã€ç‹¬è‡ªã«é–‹ç™ºã™ã‚‹å¿…è¦
lizy 2010/10/13
hadoop

business

mapreduce
ãƒªãƒ³ã‚¯
Hadoopã¯å€Ÿã‚Šã¦ä½¿ãˆ - masayang's diary
NTTãƒ‡ãƒ¼ã‚¿ãŒå…¬é–‹ã—ãŸHadoopè³‡æ–™ãŒè©±é¡Œã«ãªã£ã¦ã„ã‚‹ã€‚ã–ã£ã¨èªã‚€é™ã‚Šã€ã‚³ãƒ¼ãƒ‰äº‹ä¾‹ã‚‚ã‚ã£ã¦å‚è€ƒã«ãªã‚‹ã“ã¨ã¯ç¢ºã‹ã€‚èªã¾ãªã„æ‰‹ã¯ãªã„ã ã‚ã†ã€‚ ã ã‘ã©ã€Hadoopç’°å¢ƒã‚’è‡ªå‰ã§æ§‹ç¯‰ã™ã‚‹ã“ã¨ã«ã¯ç§ã¯ã‚ã¾ã‚Šè³›åŒã§ããªã„ã€‚æŠ€è¡“å±‹ãŒå‹‰å¼·ã™ã‚‹ãŸã‚ã€ã¨ã„ã†ã®ãªã‚‰è©±ã¯åˆ¥ã ã‘ã©ã€äº‹æ¥ã§Hadoopã‚’ä½¿ã†ã®ãªã‚‰ã‚¯ãƒ©ã‚¦ãƒ‰ä¸Šã®ã‚’å€Ÿã‚Šã‚‹ã“ã¨ã‚’ãŠå‹§ã‚ã™ã‚‹ã€‚ ä¾‹ãˆã°1000å°ã®ã‚¯ãƒ©ã‚¹ã‚¿ã‚’æ§‹ç¯‰ã—ã¦ã€ãƒ‡ã‚¤ãƒªãƒ¼ãƒãƒƒãƒå‡¦ç†ãŒ5åˆ†ã§çµ‚ã‚ã‚‹ã‚ˆã†ã«ãªã£ãŸï¼ã€€ã¨å–œã¶ã®ã‚‚è‰¯ã„ã ã‚ã†ã€‚ã§ã‚‚ã€æ®‹ã‚Šã®23æ™‚é–“55åˆ†ã¯ãã®ã‚¯ãƒ©ã‚¹ã‚¿ã©ã†ã™ã‚‹ã®ã‹ï¼Ÿå¯ã‹ã›ã¦ãŠãã®ã§ã‚ã‚Œã°ROIè©•ä¾¡ã¯éžå¸¸ã«ä½Žã„ã‚‚ã®ã«ãªã‚‹ã ã‚ã†ã€‚ ã‹ã¨ã„ã£ã¦ã‚±ãƒã£ã¦5å°ã®ã‚¯ãƒ©ã‚¹ã‚¿ã«ã—ãŸã‚‰ã»ã¼1æ—¥ä¸ç¨¼å‹•ã—ãŸã®ã§ROIã¯é«˜ããªã‚Šã¾ã—ãŸãŒå‡¦ç†æ™‚é–“çŸç¸®ã«ã¯è‡³ã‚Šã¾ã›ã‚“ã§ã—ãŸã€ãªã‚“ã¦ã„ã†ã®ã‚‚é¦¬é¹¿ã’ã¦ã„ã‚‹ã€‚ ã˜ã‚ƒã€ã©ã“ã«æœ€é©ç‚¹ãŒã‚ã‚‹ã®ã‹ï¼Ÿ ç”ã¯ã€Œè‡ªå‰ã§æŒãŸãšã€å¿…è¦ãªã¨ãã«å¿…è¦ãªå°æ•°ã®ã‚¯ãƒ©ã‚¹ã‚¿ã‚’å€Ÿã‚Šã‚‹ã€
lizy 2010/09/30
cloudcomputing

hadoop

mapreduce
ãƒªãƒ³ã‚¯
CloudantãŒ CouchDBç”¨ã®Javaãƒ™ãƒ¼ã‚¹ã®View Serverã‚’ãƒªãƒªãƒ¼ã‚¹
ã‚ãªãŸã«ã¨ã£ã¦é‡è¦ãªãƒˆãƒ”ãƒƒã‚¯ã‚„åŒåƒšã®æœ€æ–°æƒ…å ±ã‚’å…¥æ‰‹ã—ã¾ã—ã‚‡ã†æœ€æ–°ã®æ´žå¯Ÿã¨ãƒˆãƒ¬ãƒ³ãƒ‰ã«é–¢ã™ã‚‹æœ€æ–°æƒ…å ±ã‚’å³åº§ã«å—ã‘å–ã‚Šã¾ã—ã‚‡ã†ã€‚ ç¶™ç¶šçš„ãªå¦ç¿’ã®ãŸã‚ã«ã€ç„¡æ–™ã®ãƒªã‚½ãƒ¼ã‚¹ã«æ‰‹è»½ã«ã‚¢ã‚¯ã‚»ã‚¹ã—ã¾ã—ã‚‡ã†ãƒŸãƒ‹ãƒ–ãƒƒã‚¯ã€ãƒˆãƒ©ãƒ³ã‚¹ã‚¯ãƒªãƒ—ãƒˆä»˜ãå‹•ç”»ã€ãŠã‚ˆã³ãƒˆãƒ¬ãƒ¼ãƒ‹ãƒ³ã‚°æ•™æã€‚ è¨˜äº‹ã‚’ä¿å˜ã—ã¦ã€ã„ã¤ã§ã‚‚èªã‚€ã“ã¨ãŒã§ãã¾ã™è¨˜äº‹ã‚’ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ã—ã¦ã€æº–å‚™ãŒã§ããŸã‚‰ã„ã¤ã§ã‚‚èªã‚ã¾ã™ã€‚
lizy 2010/09/30
couchdb

mapreduce

java

jvm
ãƒªãƒ³ã‚¯
NTTãƒ‡ãƒ¼ã‚¿ã®Hadoopå ±å‘Šæ›¸ãŒã™ã”ã‹ã£ãŸ - ç§‘å¦ã¨éžç§‘å¦ã®è¿·å®®
æ¥ç•Œãƒˆãƒƒãƒ— ã®ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚º Hadoop ä¼æ¥ Cloudera ã«å…¥ç¤¾ã—ã¾ã—ãŸ http://www.cloudera.co.jp/ ä»Šå¹´ã®6æœˆã«ã€ã€Œå¹³æˆï¼’ï¼‘å¹´åº¦ ç”£å¦é€£æºã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢å·¥å¦å®Ÿè·µäº‹æ¥å ±å‘Šæ›¸ã€ã¨ã„ã†ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆç¾¤ãŒçµŒç”£çœã‹ã‚‰å…¬è¡¨ã•ã‚Œã¾ã—ãŸã€‚ ãã®ã†ã¡ã®ä¸€ã¤ã«ã€NTTãƒ‡ãƒ¼ã‚¿ã«å§”è¨—ã•ã‚ŒãŸHadoopã«é–¢ã™ã‚‹å®Ÿè¨¼å®Ÿé¨“ã®å ±å‘Šæ›¸ãŒã‚ã‚Šã¾ã—ãŸã®ã§ã€ä»Šæ›´ãªãŒã‚‰èªã‚“ã§ã¿ã‚‹ã“ã¨ã«ã—ã¾ã—ãŸã€‚ Hadoopç•Œéšˆã®äººã¯ã‚‚ã†ã¿ã‚“ãªã¨ã£ãã«èªã‚“ã§ã‚‹ã®ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ã‘ã©ã€‚ http://www.meti.go.jp/policy/mono_info_service/joho/downloadfiles/2010software_research/clou_dist_software.pdf ã€Œé«˜ä¿¡é ¼ã‚¯ãƒ©ã‚¦ãƒ‰å®Ÿç¾ç”¨ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢é–‹ç™ºï¼ˆåˆ†æ•£åˆ¶å¾¡å‡¦ç†æŠ€è¡“ç‰ã«ä¿‚ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼é«˜ä¿¡é ¼åŒ–ã«å‘ã‘ãŸå®Ÿè¨¼äº‹æ¥ï¼‰ã€ã¨ã„ã†
lizy 2010/09/29
hadoop

mapreduce
ãƒªãƒ³ã‚¯
yebo blog: Googleã¯æ—¢ã«MapReduceã‚’ä½¿ã£ã¦ã„ãªã„
2010/09/13 Googleã¯æ—¢ã«MapReduceã‚’ä½¿ã£ã¦ã„ãªã„ Googleã®æ–°ã—ã„æ¤œç´¢åŸºç›¤ã€ŒCaffeineã€ã§ã¯ã€MapReduceã‚’ä½¿ã£ã¦ã„ãªã„ãã†ã [register]ã€‚æ–°ã—ã„æ¤œç´¢åŸºç›¤ã¯GFS (Google File System) ã‚’ã‚ªãƒ¼ãƒãƒ¼ãƒ›ãƒ¼ãƒ«ã—ãŸGFS2ã‚’æ´»ç”¨ã—ã¦ãŠã‚Šã€åˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹BigTableã«ç›´æŽ¥ã‚¤ãƒ³ãƒ‡ã‚¯ã‚·ãƒ³ã‚°ã‚’è¡Œã†ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹é§†å‹•ã®æ–¹å¼ã«å¤‰ã‚ã£ã¦ã„ã‚‹ã€‚ã“ã®æ¤œç´¢åŸºç›¤ã‚’ã€ŒColossusã€ã¨å‘¼ã‚“ã§ã„ã‚‹ãã†ã ã€‚ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ã®ä½œæˆæ™‚é–“ã‚’çŸç¸®ã™ã‚‹ã“ã¨ã§(MapReduceã«ã‚ˆã‚‹å‡¦ç†ãŒä¸è¦)ã€æ¤œç´¢ã®ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ æ€§ã‚’å¢—ã™ã®ã ã‚ã†ã€‚Microsoftã€Facebookã€Yahoo!ãŒã¾ã MapReduceã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ç‰ˆã¨ã‚‚ã„ãˆã‚‹ã€ŒHadoopã€ã‚’ä½¿ã£ã¦ã„ã‚‹ã“ã¨ã‚’è€ƒãˆã‚‹ã¨Googleã¯å…ˆã«é€²ã‚“ã§ã„ã‚‹ã€‚ã“ã®æˆæžœãŒã€ŒGoogle Instantã€ã«ç¹‹ãŒã£ã¦ã„ã‚‹ã®ã ã‚ã†
lizy 2010/09/13
google

mapreduce

architecture
ãƒªãƒ³ã‚¯
1 2 3 4 æ¬¡ã®ãƒšãƒ¼ã‚¸