[B! hadoop] bigwestã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

bigwest id:bigwest

hadoopã«é–¢ã™ã‚‹bigwestã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (14)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

æ—¥ã€…é€²åŒ–ã™ã‚‹Hadoopã® ã€Œã„ã¾ã€
1. ç¬¬2å›ž NHNãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ ï¼ˆ2012å¹´8æœˆ18æ—¥ï¼‰ æ—¥ã€…é€²åŒ–ã™ã‚‹Hadoopã® ã€Œã„ã¾ã€ æ ªå¼ä¼šç¤¾NTTãƒ‡ãƒ¼ã‚¿ ï¼ æ—¥æœ¬Hadoopãƒ¦ãƒ¼ã‚¶ãƒ¼ä¼š æ¿±é‡Ž è³¢ä¸€æœ— Copyright Â© 2012 NTT DATA Corporation 2. è‡ªå·±ç´¹ä»‹ ï® æ¿±é‡Ž è³¢ä¸€æœ— ï¼ˆã¯ã¾ã® ã‘ã‚“ã„ã¡ã‚ã†ï¼‰ @hamaken ï¬ æ ªå¼ä¼šç¤¾NTTãƒ‡ãƒ¼ã‚¿ åŸºç›¤ã‚·ã‚¹ãƒ†ãƒ äº‹æ¥æœ¬éƒ¨ ã‚·ãƒ‹ã‚¢ã‚¨ã‚ã‚¹ãƒ‘ãƒ¼ãƒˆ â€¢ ã€ŽBizXaaS Hadoopæ§‹ç¯‰ãƒ»é‹ç”¨ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã€ ã€ŽCDH Hadoopã‚µãƒãƒ¼ãƒˆã‚µãƒ¼ãƒ“ã‚¹ã€ ã®ä¸ã®äºº ï¬ æ—¥æœ¬Hadoopãƒ¦ãƒ¼ã‚¶ãƒ¼ä¼š ï¬ ç¿”æ³³ç¤¾ ã€ŽHadoopå¾¹åº•å…¥é–€ã€ ç›£ä¿®è€… ï¬ è©±é¡Œã«ãªã£ãŸçµŒç”£çœã®Hadoopå ±å‘Šæ›¸ã®PM â€¢ çµŒæ¸ˆç”£æ¥çœ ã€Žåˆ†æ•£åˆ¶å¾¡å‡¦ç†æŠ€è¡“ç‰ã«ä¿‚ã‚‹ ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼é«˜ä¿¡é ¼åŒ–ã«å‘ã‘ãŸå®Ÿè¨¼äº‹æ¥ã€ â€¢ http://www.meti.go.jp/policy/mono
bigwest 2012/08/20
hadoop
ãƒªãƒ³ã‚¯
ãƒ‘ãƒ–ãƒªãƒƒã‚¯ã‚¯ãƒ©ã‚¦ãƒ‰ã®Hadoopå¯¾å¿œçŠ¶æ³ã‚’æ¯”è¼ƒã™ã‚‹â”€â”€Amazonã€Googleã€Herokuã®å ´åˆ
2012å¹´ã¯ã‚¯ãƒ©ã‚¦ãƒ‰ã®ã€Œãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã€å…ƒå¹´ã¨ã„ã‚ã‚Œã¦ãŠã‚Šã€ç±³Amazon.comã€ç±³Googleã€ç±³Herokuï¼ˆç±³Salesforce.comï¼‰ã€ç±³IBMã€ç±³Microsoftãªã©ã®å¤§æ‰‹PaaSï¼ˆPlatform as a Serviceï¼‰ãƒ—ãƒ¬ãƒ¼ãƒ¤ãƒ¼ã«æ³¨ç›®ãŒé›†ã¾ã£ã¦ã„ã‚‹ã€‚ã§ã¯ã€ãƒ‘ãƒ–ãƒªãƒƒã‚¯ã‚¯ãƒ©ã‚¦ãƒ‰ã§Apache Hadoopã®ã‚¤ãƒ³ãƒ—ãƒªãƒ¡ãƒ³ãƒ†ãƒ¼ã‚·ãƒ§ãƒ³ã‚’æœ€ã‚‚åŒ…æ‹¬çš„ãªå½¢ã§æä¾›ã—ã¦ã„ã‚‹ã®ã¯ã©ã®ãƒ™ãƒ³ãƒ€ãƒ¼ã ã‚ã†ã‹ã€‚ Apache Hadoopã¯HDFSã€MapReduceã€Hiveã€Pigãªã©ã®ã‚µãƒ–ã‚³ãƒ³ãƒãƒ¼ãƒãƒ³ãƒˆã¨ã¨ã‚‚ã«ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿åˆ†æžã®ä¸»æµæŠ€è¡“ã«ãªã‚Šã¤ã¤ã‚ã‚‹ã€‚ãã®èƒŒæ™¯ã«ã¯ã€ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚ºãƒ‡ãƒ¼ã‚¿ã‚¦ã‚§ã‚¢ãƒã‚¦ã‚¸ãƒ³ã‚°ã«PaaSåž‹ã‚¯ãƒ©ã‚¦ãƒ‰ãƒ¢ãƒ‡ãƒ«ã‚’æŽ¡ç”¨ã™ã‚‹ä¼æ¥ãŒå¢—ãˆã¦ã„ã‚‹ã“ã¨ãŒã‚ã‚‹ã€‚Apache Software Foundationã¯ã€HadoopãŒæˆç†Ÿã—ã€æ¥å‹™ç”¨åˆ†æžã‚¯ãƒ©ã‚¦ãƒ‰ç’°å¢ƒã¨ã—ã¦æ´»ç”¨ã§ãã‚‹ã‚ˆã†ã«ãªã£ãŸ
bigwest 2012/05/29
cloud

hadoop
ãƒªãƒ³ã‚¯
é¹¿é§†å‹•å‹‰å¼·ä¼š é’æ±Ÿç™ºè¡¨è³‡æ–™
2. è‡ªå·±ç´¹ä»‹ ï³ é’æ±Ÿ å´‡ ï³ ï¼ˆæ ªï¼‰ãƒŽãƒ¼ãƒãƒ©ã‚¹ãƒ»ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚ºæ‰€å±ž ï³ Twitter ID: aoetk / Hatena ID: aoe-tk ï³ å¥ˆè‰¯è‚²ã¡ï¼ ï³ ä»Šã¯æ±äº¬ã§ä»•äº‹ã—ã¦ã¾ã™ãŒ ï³ æœ€è¿‘ã¯Hadoopãªã©ã®åˆ†æ•£ãƒŸãƒ‰ãƒ«ã‚¦ã‚§ã‚¢ã‚’ç”¨ã„ãŸ æ¥å‹™ãƒãƒƒãƒé–‹ç™ºã«ã¤ã„ã¦ã€ãã®é–‹ç™ºæ¨™æº–ã‚’è€ƒãˆãŸ ã‚Šé‹ç”¨å‘¨ã‚Šã®åŸºç›¤é–‹ç™ºã‚’ã‚„ã£ãŸã‚Šã¨ã‹ã—ã¦ã¾ã™ 3. è‡ªå·±ç´¹ä»‹ï¼ˆç¶šãï¼‰ ï³ ãã‚Œã¾ã§ã¯å‰²ã¨å…¸åž‹çš„ãªSIé–‹ç™ºã‚„ã£ã¦ã¦ä¸»ã« JavaEEç³»ã®è‰²ã‚“ãªã‚·ã‚¹ãƒ†ãƒ ä½œã£ã¦ã¾ã—ãŸ ï³ B2Cã‚„B2Bã®Webã‚µãƒ¼ãƒ“ã‚¹ã¨ã‹ã€ç¤¾å†…åŸºå¹¹ã‚·ã‚¹ãƒ†ãƒ ã¨ ã‹è‰²ã€… ï³ è¿‘å¹´ã¯Flexã‚„JavaScriptã‚’ä½¿ã£ãŸRIAé–‹ç™ºã¨ã‹ã‚‚ ï³ ãªã®ã§å€‹äººçš„ã«ã¯GUIé–‹ç™ºã«ã™ã”ãèˆˆå‘³æœ‰ã‚Š ï³ ä»ŠJava FXè¿½ã£ã‹ã‘ã¦ã¾ã™ï¼
bigwest 2012/05/01
hadoop
ãƒªãƒ³ã‚¯
Hadoopã‚’ç”¨ã„ãŸå¤§è¦æ¨¡ãƒã‚°è§£æž
this document is for #tokyowebmining held at 2011/04/10Read less
bigwest 2011/04/11
hadoop
ãƒªãƒ³ã‚¯
Hadoop Conference Japanã«å‚åŠ ã—ã¾ã—ãŸ #hcj2011 - nokunoã®æ—¥è¨˜
ã¨ã„ã†ã‚ã‘ã§Hadoop Conference Japanã«å‚åŠ ã—ã¾ã—ãŸã€‚Hadoop Conference Japan 2011ä¼šå ´ã¯è±Šæ´²ã®NTTãƒ‡ãƒ¼ã‚¿æœ¬ç¤¾ã§ã€åˆã‚ã¦æ¥ãŸã®ã§ã™ãŒé§…å‰ã®åºƒå ´ãŒæ¥½å¤©ã®ã‚ã‚‹å“å·ã‚·ãƒ¼ã‚µã‚¤ãƒ‰ã¨å…¨ãåŒã˜ã§ã³ã£ãã‚Šã—ã¾ã—ãŸã€‚ ã€ŽHadoop on ã‚¯ãƒ©ã‚¦ãƒ‰ / Amazon Elastic MapReduceã®çœŸä¾¡ã€ï¼ˆAmazon Web Services, Jeff Barrï¼‰ Introduction AWS: 2002-Twitter: @jeffbarr What is Big Data Doesn't refer just to volume Big Data Tool EMR Overview Hadoop Hosting Framework Launch and monitor job flows: Web, CUI, REST Upload data
bigwest 2011/02/24
hadoop
ãƒªãƒ³ã‚¯
ã€Žãƒ¢ãƒã‚²ãƒ¼ã®å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ãƒžã‚¤ãƒ‹ãƒ³ã‚°åŸºç›¤ã«ãŠã‘ã‚‹Hadoopæ´»ç”¨ã€ï¼Hadoop Conference Japan 2011ï¼ #hcj2011
ã€Žãƒ¢ãƒã‚²ãƒ¼ã®å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ãƒžã‚¤ãƒ‹ãƒ³ã‚°åŸºç›¤ã«ãŠã‘ã‚‹Hadoopæ´»ç”¨ã€ï¼Hadoop Conference Japan 2011ï¼ #hcj2011 2011/02/22 [ç™»å£‡å¾Œã‚¨ãƒ³ãƒˆãƒª] ï¼š" ã€Œãƒ¢ãƒã‚²ãƒ¼ã®å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ãƒžã‚¤ãƒ‹ãƒ³ã‚°åŸºç›¤ã«ãŠã‘ã‚‹Hadoopæ´»ç”¨ã€ï¼Hadoop Conference Japan 2011 #hcj2011 ã§ç™»å£‡ã—ã¦ãã¾ã—ãŸ " http://d.hatena.ne.jp/hamadakoichi/20110222/p1Read less
bigwest 2011/02/23
Hadoop

ãƒ‡ãƒ¼ã‚¿ãƒžã‚¤ãƒ‹ãƒ³ã‚°
ãƒªãƒ³ã‚¯
Hadoopã§ã€ã‹ã‚“ãŸã‚“åˆ†æ•£å‡¦ç† (Yahoo! JAPAN Tech Blog)
ãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã¯ã€2023å¹´10æœˆ1æ—¥ã«LINEãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã«ãªã‚Šã¾ã—ãŸã€‚LINEãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã®æ–°ã—ã„ãƒ–ãƒã‚°ã¯ã“ã¡ã‚‰ã§ã™ã€‚LINEãƒ¤ãƒ•ãƒ¼ Tech Blog ã“ã‚“ã«ã¡ã¯ã€åœ°åŸŸã‚µãƒ¼ãƒ“ã‚¹äº‹æ¥éƒ¨ã®å‰ç”°ä¸€æ˜Ÿã§ã™ã€‚ ä»Šå›žã¯ã€Hadoopã«ã¤ã„ã¦ã€Yahoo! JAPANã§ã®å®Ÿéš›ã®ä½¿ç”¨ä¾‹ã‚’äº¤ãˆãªãŒã‚‰æ›¸ããŸã„ã¨æ€ã„ã¾ã™ã€‚Hadoopã¨ã¯ã€å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’æ‰‹è»½ã«è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã—ã¦å‡¦ç†ã§ãã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã§ã™ã€‚ è¤‡æ•°ã®ãƒžã‚·ãƒ³ã¸ã®åˆ†æ•£å‡¦ç†ã¯ã€ãƒ—ãƒã‚»ã‚¹é–“é€šä¿¡ã‚„ã€éšœå®³æ™‚ã¸ã®å¯¾å¿œãªã©ã‚’è€ƒãˆãªã‘ã‚Œã°ãªã‚‰ãšã€ãƒ—ãƒã‚°ãƒ©ãƒžã«ã¨ã£ã¦æ•·å±…ãŒé«˜ã„ã‚‚ã®ã§ã™ãŒã€ Hadoopã¯ãã†ã„ã£ãŸé¢å€’ãã•ã„åˆ†æ•£å‡¦ç†ã‚’ä¸€æ‰‹ã«å¼•ãå—ã‘ã¦ãã‚Œã¾ã™ã€‚ 1å°ã§ã¯å‡¦ç†ã«ã‹ãªã‚Šæ™‚é–“ãŒã‹ã‹ã‚‹ã‚ˆã†ãªå¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚‚ã€è¤‡æ•°ãƒžã‚·ãƒ³ã«åˆ†æ•£ã•ã›ã‚‹ã“ã¨ã§ã€é©šãã¹ãã‚¹ãƒ”ãƒ¼ãƒ‰ã§å‡¦ç†ã‚’è¡Œã†ã“ã¨ãŒã§ãã¾ã™ã€‚ ä¾‹ãˆã°ã€ä»Šã¾ã§1å°ã§ã‚„ã£ã¦ã„ãŸã€ã‚ã‚‹ãƒã‚°é›†è¨ˆå‡¦ç†
bigwest 2011/02/01
hadoop
ãƒªãƒ³ã‚¯
ã‚°ãƒ¼ã‚°ãƒ«ç™ºã€ŒHadoopã€ã€æ—¥æœ¬ä¼æ¥ã‚‚åˆ©ç”¨ã¸
Hadoopã¯ã€ã‚°ãƒ¼ã‚°ãƒ«ãŒæ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ç”¨ã«é–‹ç™ºã—ãŸãƒãƒƒãƒå‡¦ç†ã‚·ã‚¹ãƒ†ãƒ ã‚’åŸºã«é–‹ç™ºã•ã‚ŒãŸã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã ã€‚ã‚°ãƒ¼ã‚°ãƒ«ãŒé–‹ç™ºã—ãŸåˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã€ŒGoogle File Systemï¼ˆGFSï¼‰ã€ã‚’æ¨¡ã—ãŸã€ŒHadoop Distributed File Systemï¼ˆHD FSï¼‰ã€ã¨ã€ãƒ‡ãƒ¼ã‚¿å‡¦ç†æ©Ÿæ§‹ã€ŒMapReduceã€ã‚’æ¨¡ã—ãŸã€ŒHadoop MapReduceã€ã§æ§‹æˆã™ã‚‹ã€‚ ç±³å›½ã§ã¯ç±³VISAã‚„ç±³JPãƒ¢ãƒ«ã‚¬ãƒ³ãƒ»ãƒã‚§ãƒ¼ã‚¹ã®ã‚ˆã†ãªå¤§æ‰‹é‡‘èžæ©Ÿé–¢ãŒã€ãƒãƒƒãƒå‡¦ç†ã«Hadoopã‚’ä½¿ç”¨ã™ã‚‹ã€‚ ãã®HadoopãŒã„ã‚ˆã„ã‚ˆã€æ—¥æœ¬ä¼æ¥ã§ã‚‚ä½¿ã‚ã‚Œå§‹ã‚ãŸã€‚ä¾‹ãˆã°æ¥½å¤©ã¯ã€ã‚ã‚‹å•†å“ã«å¯¾ã™ã‚‹ãŠè–¦ã‚å•†å“ã‚’ãƒªã‚¹ãƒˆã‚¢ãƒƒãƒ—ã™ã‚‹ã€Œãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‰å‡¦ç†ã€ã«Hadoopã‚’ä½¿ç”¨ã™ã‚‹ã€‚NTTãƒ‡ãƒ¼ã‚¿ã¯ã€å…¨å›½ã®æ¸‹æ»žæƒ…å ±ã‚’ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ã«å¯è¦–åŒ–ã™ã‚‹ã‚·ã‚¹ãƒ†ãƒ ã®æ§‹ç¯‰ã«Hadoopã‚’æŽ¡ç”¨ã—ãŸã€‚ä¸‰è±UFJã‚¤ãƒ³ãƒ•ã‚©ãƒ¡ãƒ¼ã‚·ãƒ§ãƒ³ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚‚Hadoopã‚’ä½¿ã£
bigwest 2011/01/19
hadoop
ãƒªãƒ³ã‚¯
ãã‚ãã‚Hadoopã«ã¤ã„ã¦ã²ã¨ã“ã¨è¨€ã£ã¦ãŠãã‹ - nokunoã®æ—¥è¨˜
ã‚‚ã†ã“ã®æ‰‹ã®è©±é¡Œã¯å‡ºå°½ãã—ãŸæ„ŸãŒã‚ã‚Šã¾ã™ãŒã€æœ€è¿‘Hadoopã«ã¤ã„ã¦è€ƒãˆã‚‹ã“ã¨ãŒå¤šã„ã®ã§ã€ã‚¨ãƒ³ãƒˆãƒªã«ã—ã¦ã¿ã¾ã™ã€‚ãªãŠã€ã“ã“ã§ã¯ãƒ™ãƒ¼ã‚·ãƒƒã‚¯ãªMapReduce+HDFSã®ã“ã¨ã‚’Hadoopã¨å‘¼ã¶ã“ã¨ã«ã—ã¾ã™ã€‚ Hadoopã¨ã¯Hadoopã¨ã¯è¨€ã‚ãšã¨çŸ¥ã‚ŒãŸGoogleã®MapReduce/GFSã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ã‚¯ãƒãƒ¼ãƒ³ã§ã™ã€‚MapReduceã§ã¯ãƒ—ãƒã‚°ãƒ©ãƒžã¯Mapã¨Reduceã¨ã„ã†2ã¤ã®é–¢æ•°ã‚’æ›¸ãã ã‘ã§ã€ä¸¦åˆ—åˆ†æ•£å‡¦ç†ã‚’ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ã“ã‚Œã¯(1) ãƒ‡ãƒ¼ã‚¿ã‚’å®Ÿéš›ã«æŒã¤ãƒžã‚·ãƒ³ã«ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’é…å¸ƒã™ã‚‹ (2) Mapã¨Reduceã‚’ã¤ãªãShuffleãƒ•ã‚§ãƒ¼ã‚ºã§ã‚ãƒ¼ã‚’ã‚°ãƒ«ãƒ¼ãƒ—åŒ–ã—ã¦ã‚½ãƒ¼ãƒˆã™ã‚‹ã€(3) éšœå®³æ™‚ã®ãƒ•ã‚§ãƒ¼ãƒ«ã‚ªãƒ¼ãƒãƒ¼ã‚„ãƒ¬ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã€ã¨ã„ã£ãŸå‡¦ç†ã‚’ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯å´ãŒå—ã‘æŒã¤ã“ã¨ã«ã‚ˆã£ã¦ã€ãƒ—ãƒã‚°ãƒ©ãƒžå´ã®è² æ‹…ã‚’æ¸›ã‚‰ã™ã‚‚ã®ã§ã™ã€‚GFSã«å¯¾å¿œã™ã‚‹HDFSã«ã¯ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ã‚¯ãƒ©ã‚¹ã‚¿ã«åˆ†æ•£ã—ã¦ä¿å˜
bigwest 2011/01/16
hadoop
ãƒªãƒ³ã‚¯
ä¼æ¥ã§ä½¿ã‚ã‚Œã‚‹Hadoop
Copyright Â© 2004-2024 Impress Corporation. An Impress Group Company. All rights reserved.
bigwest 2010/11/17
hadoop
ãƒªãƒ³ã‚¯
è³‡æ–™ã‚’å…¬é–‹ã—ã¾ã—ãŸï¼ˆé “æ™ºãƒ»Ã—ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰åˆåŒå‹‰å¼·ä¼šã€€ã€€ï½žè£å´ã®æŠ€è¡“ã¨ãã‚Œãžã‚Œã®é–‹ç™ºã‚¹ã‚¿ã‚¤ãƒ«ï½žï¼‰ - ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰é–‹ç™ºè€…ãƒ–ãƒã‚°
9æœˆ30æ—¥ï¼ˆæœ¨ï¼‰ã«é “æ™ºãƒ‰ãƒƒãƒˆæ ªå¼ä¼šç¤¾æ§˜ã¨å…±åŒã§å‹‰å¼·ä¼šã‚’é–‹å‚¬ã„ãŸã—ã¾ã—ãŸã€‚ å½“æ—¥ã¯å¤šãã®çš†ã•ã¾ã«ãŠé›†ã¾ã‚Šé ‚ãã€èª ã«ã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã—ãŸã€‚ ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰ã‹ã‚‰ç™ºè¡¨ã—ãŸä½ã€…æœ¨é”ä¹Ÿã®è³‡æ–™ã‚’ã‚¢ãƒƒãƒ—ã„ãŸã—ã¾ã™ã®ã§ã€ æ˜¯éžã”è¦§ãã ã•ã„ã¾ã›ã€‚ ã€ŒHadoopã‚’EMRçµŒç”±ã§åˆ©ç”¨ã™ã‚‹æ–¹æ³•ã€ ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰æ ªå¼ä¼šç¤¾ã€€ãƒžãƒ¼ã‚±ãƒ†ã‚£ãƒ³ã‚°æ”¯æ´äº‹æ¥éƒ¨ã€€ä½ã€…æœ¨ é”ä¹Ÿ [slideshare id=5368698&doc=hadoopemr-101006000854-phpapp01]
bigwest 2010/10/28
hadoop
ãƒªãƒ³ã‚¯
NTTãƒ‡ãƒ¼ã‚¿ã®Hadoopå ±å‘Šæ›¸ãŒã™ã”ã‹ã£ãŸ - ç§‘å¦ã¨éžç§‘å¦ã®è¿·å®®
æ¥ç•Œãƒˆãƒƒãƒ— ã®ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚º Hadoop ä¼æ¥ Cloudera ã«å…¥ç¤¾ã—ã¾ã—ãŸ http://www.cloudera.co.jp/ ä»Šå¹´ã®6æœˆã«ã€ã€Œå¹³æˆï¼’ï¼‘å¹´åº¦ ç”£å¦é€£æºã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢å·¥å¦å®Ÿè·µäº‹æ¥å ±å‘Šæ›¸ã€ã¨ã„ã†ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆç¾¤ãŒçµŒç”£çœã‹ã‚‰å…¬è¡¨ã•ã‚Œã¾ã—ãŸã€‚ ãã®ã†ã¡ã®ä¸€ã¤ã«ã€NTTãƒ‡ãƒ¼ã‚¿ã«å§”è¨—ã•ã‚ŒãŸHadoopã«é–¢ã™ã‚‹å®Ÿè¨¼å®Ÿé¨“ã®å ±å‘Šæ›¸ãŒã‚ã‚Šã¾ã—ãŸã®ã§ã€ä»Šæ›´ãªãŒã‚‰èªã‚“ã§ã¿ã‚‹ã“ã¨ã«ã—ã¾ã—ãŸã€‚ Hadoopç•Œéšˆã®äººã¯ã‚‚ã†ã¿ã‚“ãªã¨ã£ãã«èªã‚“ã§ã‚‹ã®ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ã‘ã©ã€‚ http://www.meti.go.jp/policy/mono_info_service/joho/downloadfiles/2010software_research/clou_dist_software.pdf ã€Œé«˜ä¿¡é ¼ã‚¯ãƒ©ã‚¦ãƒ‰å®Ÿç¾ç”¨ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢é–‹ç™ºï¼ˆåˆ†æ•£åˆ¶å¾¡å‡¦ç†æŠ€è¡“ç‰ã«ä¿‚ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼é«˜ä¿¡é ¼åŒ–ã«å‘ã‘ãŸå®Ÿè¨¼äº‹æ¥ï¼‰ã€ã¨ã„ã†
bigwest 2010/10/07
hadoop

cloud

è³‡æ–™
ãƒªãƒ³ã‚¯
Googleã®åŸºç›¤ã‚¯ãƒãƒ¼ãƒ³ Hadoopã«ã¤ã„ã¦
2. è‡ªå·±ç´¹ä»‹ å¤ªç”°ä¸€æ¨¹ æ±äº¬å¤§å¦æƒ…å ±ç†å·¥å¦ç³»ç ”ç©¶ç§‘ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ã‚¿ãƒ¼ç§‘å¦å°‚æ”»çŸ³å·ç ”ç©¶å®¤ M1 HPC ç³»ã®è©± ( ä¸¦åˆ—ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ) å€‹äººã‚µã‚¤ãƒˆ http://kzk9.net/ http://kzk9.net/blog/ èˆˆå‘³ OS, ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ , I/O, åˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ OSS çš„æ´»å‹• I was a committer of KDE, uim, SigScheme copybench? Kernel Reporter 3. ã¨ã¯ï¼Ÿ Google ã®åŸºç›¤ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã®ã‚¯ãƒãƒ¼ãƒ³ Google File System, MapReduce Yahoo Research ã® Doug Cutting æ°ãŒé–‹ç™º å…ƒã€…ã¯ Lucene ã®ã‚µãƒ–ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆ Doug ã®åä¾›ã®æŒã£ã¦ã„ã‚‹ã¬ã„ãã‚‹ã¿ã®åå‰ Java ã§è¨˜è¿° ! 4. Google é–¢é€£ å‚è€ƒè«–æ–‡ & ã‚¹ãƒ©ã‚¤ãƒ‰ The Goog
bigwest 2010/04/22
hadoop

google

mapreduce
ãƒªãƒ³ã‚¯
Hadoopã‚’æ¥å‹™ã§ä½¿ã£ã¦ã¿ãŸè©± - ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰é–‹ç™ºè€…ãƒ–ãƒã‚°
8æœˆã«å…¥ç¤¾ã—ãŸä½ã€…æœ¨ã§ã™ã€‚ã“ã‚“ã«ã¡ã‚ï¼ å…¥ç¤¾ã—ã¦ã‹ã‚‰ã¯Hadoopã‚’ä½¿ã†ã“ã¨ãŒå¤šãã€æ—¥ã€…ã€å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã¨æ ¼é—˜ã—ã¦ã„ã¾ã™ã€‚å¤§å¤‰ã§ã¯ã‚ã‚Šã¾ã™ãŒã€å€‹äººã§ã¯ãªã‹ãªã‹è§¦ã‚‹ã“ã¨ãŒå‡ºæ¥ãªã„ã‚ˆã†ãªå¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’è§¦ã‚Œã‚‹ã®ã¯æ¥½ã—ã„ã§ã™ã€‚ ã•ã¦ã€Hadoopã¯æœ€è¿‘è‰²ã€…ãªã¨ã“ã‚ã§ä½¿ã‚ã‚Œå§‹ã‚ã¦ãã¦ã„ã‚‹ã¨æ€ã†ã‚“ã§ã™ãŒã€å®Ÿéš›ã«åˆ©ç”¨ã—ã¦ã¿ã¦å›°ã£ãŸäº‹ã‚„tipsãªã©ã€å®Ÿè·µçš„ãªæƒ…å ±ã¯ã¾ã ã‚ã¾ã‚Šå…¬é–‹ã•ã‚Œã¦ã„ã¾ã›ã‚“ã€‚ãã®è¾ºã®æƒ…å ±ã‚’ã¿ã‚“ãªæ±‚ã‚ã¦ã„ã‚‹ã¯ãšâ€¦ï¼ï¼ ãã“ã§ã€åƒ•ãŒå®Ÿéš›ã«è§¦ã£ã¦ã¿ã¦å›°ã£ãŸäº‹ã‚„Hadoopã‚’ä½¿ã†ä¸Šã§ãƒã‚¤ãƒ³ãƒˆã ã¨æ€ã£ãŸã“ã¨ãªã©ã‚’ç¤¾å†…å‹‰å¼·ä¼šã§ç™ºè¡¨ã—ãŸã®ã§å…¬é–‹ã—ã¦ã¿ã¾ã™ã€‚Hadoopã‚’ä½¿ã£ã¦ã„ã‚‹ï¼ˆä½¿ã„ãŸã„ã¨æ€ã£ã¦ã„ã‚‹ï¼‰æ–¹ã®å‚è€ƒã«ãªã‚Œã°å¹¸ã„ã§ã™ã€‚ [slideshare id=2711363&doc=20091214tech blog-091213183529-phpapp02] Hadoopã®åˆ©ç”¨ã¯ã¾ã ã¾ã è©¦è¡ŒéŒ¯èª¤ã®é€£ç¶š
bigwest 2009/12/18
storage

hadoop

S3
ãƒªãƒ³ã‚¯
1