[B! hadoop] Arisonã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

Arison id:Arison

hadoopã«é–¢ã™ã‚‹Arisonã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (6)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿æŠ€è¡“ã®ç¾çŠ¶ã¨ä»Šå¾Œã®æ–¹å‘æ€§
ã¾ãŸã€ãƒ‡ãƒ¼ã‚¿ã®å…¨ä»¶å‡¦ç†ã€ç‰¹ã«I/Oã®æ€§èƒ½ãŒæ±‚ã‚ã‚‰ã‚Œã‚‹å¤šé‡ã®ãƒãƒƒãƒå‡¦ç†ã«ã¯MapReduceãŒæ–°ãŸãªé¸æŠžè‚¢ã¨ã—ã¦åŠ ã‚ã‚Šã¾ã™ã€‚MapReduceã¯ãƒ‡ãƒ¼ã‚¿ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚·ãƒ³ã‚°ã‚„éžæ§‹é€ åŒ–ãƒ‡ãƒ¼ã‚¿ã®å‰å‡¦ç†ï¼ˆETLã€ã‚¯ãƒ¬ãƒ³ã‚¸ãƒ³ã‚°ï¼‰ã¸ã®é©ç”¨ãŒæœ‰åã§ã™ãŒã€ã‚ˆã‚Šæ±Žç”¨çš„ãªãƒãƒƒãƒå‡¦ç†ã®ã‚¤ãƒ³ãƒ•ãƒ©æŠ€è¡“[3]ã¨ã—ã¦é©ç”¨ç¯„å›²ãŒåºƒãŒã£ã¦ã„ã¾ã™ã€‚ ã“ã†ã—ãŸæŠ€è¡“ã®é¸æŠžè‚¢ã®ä¸ã§ã€ç‰¹ã«ã‚¹ã‚±ãƒ¼ãƒ«ã•ã›ã‚‹ãŸã‚ã«ã¯ãƒ‡ãƒ¼ã‚¿ã‚’åˆ†å‰²ã—ã€åˆ†æ•£é…ç½®ã•ã›ã‚‹ã“ã¨ã¨ã€ãƒ‡ãƒ¼ã‚¿ã®é…ç½®å ´æ‰€ã«å‡¦ç†ã‚’æŒã£ã¦ã„ãã“ã¨ã€ã¤ã¾ã‚Šã€ã‚·ã‚§ã‚¢ãƒ¼ãƒ‰ãƒŠãƒƒã‚·ãƒ³ã‚°ã®ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹æŠ€è¡“ãŒã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ãƒ¼ã«å¤§ããªå½±éŸ¿ã‚’åŠã¼ã—ã¦ã„ã¾ã™ã€‚ éžæ§‹é€ åŒ–ãƒ‡ãƒ¼ã‚¿ã‚’å«ã‚ãŸå¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿åˆ†æžã¯MapReduceã§å®Ÿè¡Œã—ã€ãã®çµæžœã®é›†è¨ˆã‚„ãƒ¬ãƒãƒ¼ãƒˆæ©Ÿèƒ½ã«RDBã‚’åˆ©ç”¨ã—ã¦åˆ†æžçµæžœã®å¯è¦–åŒ–ã‚’ã™ã‚‹ã®ãŒç¾åœ¨ã¯ä¸»æµã¨ãªã£ã¦ã„ã¾ã™ã€‚ã—ã‹ã—ã€ã“ã®æ–¹æ³•ã¯ååˆ†ã«å…¨ä½“æœ€é©åŒ–ãŒã•ã‚Œã¦ãªãã€ãƒ‡ãƒ¼ã‚¿è»¢é€ã‚³ã‚¹ãƒˆã®ç„¡é§„ãŒç™ºç”Ÿã—ã¦
Arison 2012/03/25
ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã«ã¤ã„ã¦

hadoop

bigdata
ãƒªãƒ³ã‚¯
ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿æŠ€è¡“ã®æœ¬å‘½ã€ŒHadoop World 2011ã€é–‹å‚¬--NTTãƒ‡ãƒ¼ã‚¿ãªã©è¬›æ¼”
11æœˆ8æ—¥ã‚ˆã‚Š2æ—¥é–“ã€ç±³å›½ãƒ‹ãƒ¥ãƒ¼ãƒ¨ãƒ¼ã‚¯ã§ã‚¤ãƒ™ãƒ³ãƒˆã€ŒHadoop World NYC 2011ã€ãŒé–‹å‚¬ã•ã‚ŒãŸã€‚Hadoop Worldã¯ç¬¬3å›žç›®ã®é–‹å‚¬ã§ã€æœ€æ–°äº‹ä¾‹ã‚„æŠ€è¡“ã«é–¢ã™ã‚‹æƒ…å ±ãŒä¸€åŒã«é›†ã¾ã‚‹ã‚¤ãƒ™ãƒ³ãƒˆã¨ã—ã¦çŸ¥ã‚‰ã‚Œã¦ã„ã‚‹ã€‚27ã‚«å›½ã‹ã‚‰1400åä»¥ä¸ŠãŒé›†ã¾ã‚Šã€60ã‚’è¶…ãˆã‚‹è¬›æ¼”ãŒç¹°ã‚Šåºƒã’ã‚‰ã‚ŒãŸã€‚æ—¥æœ¬ã‹ã‚‰ã¯ã€NTTãƒ‡ãƒ¼ã‚¿ã‚„å¯Œå£«é€šãŒå–ã‚Šçµ„ã¿ã‚’ç™ºè¡¨ã—ãŸã€‚ æ³¨ç›®ãŒé›†ã¾ã£ã¦ã„ã‚‹ãƒ“ãƒƒã‚¯ãƒ‡ãƒ¼ã‚¿åˆ†é‡Žã‚’æ”¯ãˆã‚‹æŠ€è¡“ã®æœ¬å‘½ã¯ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®åˆ†æ•£å‡¦ç†ã‚½ãƒ•ãƒˆHadoopã ã€‚Hadoopã¯ã€Googleç¤¾ãŒå”±ãˆã‚‹å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿å‡¦ç†æ–¹å¼ã‚’å®Ÿè£…ã—ãŸã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§ã€ãƒ†ãƒ©ãƒã‚¤ãƒˆï½žãƒšã‚¿ãƒã‚¤ãƒˆç´šã®ãƒ‡ãƒ¼ã‚¿ã®è“„ç©ãƒ»å‡¦ç†ã‚’å¾—æ„ã¨ã™ã‚‹ã€‚IBMã¯Hadoopã‚’ãƒ™ãƒ¼ã‚¹ã¨ã—ãŸè£½å“ã‚’ãƒªãƒªãƒ¼ã‚¹ã—ã€ã‚ªãƒ©ã‚¯ãƒ«ã¯ä¸»è¦è£½å“Exadataã¨Hadoopã®ã‚³ãƒã‚¯ã‚¿ã‚’ç™ºè¡¨ã—ã¦é€£æºã‚’æŽ¨ã—é€²ã‚ã¦ã„ã‚‹çŠ¶æ³ã ã€‚
Arison 2011/11/10
hadoop
ãƒªãƒ³ã‚¯
NTTãƒ‡ãƒ¼ã‚¿ãŒã€ŒHadoopã€æˆ¦ç•¥ã®æœ€æ–°å‹•å‘ã‚’ç±³å›½ã§æŠ«éœ²--å¯Œå£«é€šã¨ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚·ã‚¹ãƒ†ãƒ å…±åŒé–‹ç™º
æ³¨ç›®ãŒé›†ã¾ã‚‹ãƒ“ãƒƒã‚¯ãƒ‡ãƒ¼ã‚¿åˆ†é‡Žã‚’æ”¯ãˆã‚‹æŠ€è¡“ã®æœ¬å‘½ã¯ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®åˆ†æ•£å‡¦ç†ã‚½ãƒ•ãƒˆHadoopã ã‚ã†ã€‚Hadoopã¯ã€GoogleãŒå”±ãˆã‚‹å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿å‡¦ç†æ–¹å¼ã‚’å®Ÿè£…ã—ãŸã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§ã€ãƒ†ãƒ©ãƒã‚¤ãƒˆï½žãƒšã‚¿ãƒã‚¤ãƒˆç´šã®ãƒ‡ãƒ¼ã‚¿ã®è“„ç©ãƒ»å‡¦ç†ã‚’å¾—æ„ã¨ã™ã‚‹ã€‚IBMã¯Hadoopã‚’ãƒ™ãƒ¼ã‚¹ã¨ã—ãŸè£½å“ã‚’ãƒªãƒªãƒ¼ã‚¹ã—ã€ã‚ªãƒ©ã‚¯ãƒ«ã¯ä¸»è¦è£½å“Exadataã¨Hadoopã®ã‚³ãƒã‚¯ã‚¿ã‚’ç™ºè¡¨ã—ã¦é€£æºã‚’æŽ¨ã—é€²ã‚ã¦ã„ã‚‹çŠ¶æ³ã ã€‚ ã“ã†ã—ãŸä¸ã€ç±³å›½ãƒ‹ãƒ¥ãƒ¼ãƒ¨ãƒ¼ã‚¯ã§11æœˆ8æ—¥ã‚ˆã‚Š2æ—¥é–“ã€ŒHadoop World NYC 2011ã€ãŒé–‹å‚¬ã•ã‚ŒãŸã€‚Hadoop Worldã¯ç¬¬3å›žç›®ã®é–‹å‚¬ã§ã€æœ€æ–°äº‹ä¾‹ã‚„æŠ€è¡“ã«é–¢ã™ã‚‹æƒ…å ±ãŒä¸€åŒã«é›†ã¾ã‚‹ã‚¤ãƒ™ãƒ³ãƒˆã¨ã—ã¦çŸ¥ã‚‰ã‚Œã¦ã„ã‚‹ã€‚27ã‚«å›½ã‹ã‚‰1400åä»¥ä¸ŠãŒé›†ã¾ã‚Šã€60ã‚’è¶…ãˆã‚‹è¬›æ¼”ãŒç¹°ã‚Šåºƒã’ã‚‰ã‚ŒãŸã€‚ ã“ã®ã‚¤ãƒ™ãƒ³ãƒˆã«ãŠã„ã¦ã€NTTãƒ‡ãƒ¼ã‚¿ã¯ã€ŒHadoop's Life in Enterprise Syste
Arison 2011/11/10
ã“ã„ã¤ãã€æ°—ã«ãªã‚‹ã€‚

hadoop
ãƒªãƒ³ã‚¯
Hadoopã®ç•°ç«¯ã•ãŒé¢ç™½ã„ - wyukawa's diary
Hadoopã¯ã»ã‚“ã¨ãƒ–ãƒ¼ãƒ ã§ã™ã€‚ãƒãƒ–ãƒ«ã ã¨è¨€ã£ã¦ã„ã„æ°—ãŒã—ã¾ã™ã€‚å„ç¨®ã‚»ãƒŸãƒŠãƒ¼ã¯ã™ãã«åŸ‹ã¾ã‚Šã¾ã™ã—ã€å®Ÿéš›ã«èžãã«è¡Œãã¨ä¼šå ´ã¯æº€å“¡ã§ã™ã€‚ ã“ã®åˆ†é‡Žã¯æ—¥æœ¬ã ã¨NTTãƒ‡ãƒ¼ã‚¿ãŒå…ˆé ã‚’ãã£ãŸã‚ˆã†ã«è¦‹ãˆã¾ã™ã€‚ NTTãƒ‡ãƒ¼ã‚¿ã€Hadoopã®å•†ç”¨ãƒ‡ã‚£ã‚¹ãƒˆãƒªãƒ“ãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã€ŒCDH3ã€ã‚’è²©å£²é–‹å§‹ | æ—¥çµŒ xTECHï¼ˆã‚¯ãƒã‚¹ãƒ†ãƒƒã‚¯ï¼‰ ã¾ãŸHadoopå°‚æ¥ä¼šç¤¾ã€ŒãƒŽãƒ¼ãƒãƒ©ã‚¹ãƒ»ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã€ã¨ã„ã†ã®ã‚‚ã§ãã¾ã—ãŸã€‚ ã‚¦ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã‚ºã¨ã‚¤ãƒ¼ã‚·ãƒ¼ãƒ»ãƒ¯ãƒ³ãŒçµŒå–¶çµ±åˆã€Hadoopå°‚æ¥ä¼šç¤¾ã‚’ç«‹ã¡ä¸Šã’ | æ—¥çµŒ xTECHï¼ˆã‚¯ãƒã‚¹ãƒ†ãƒƒã‚¯ï¼‰ ã—ã‹ã—æœ€è¿‘ã§ã¯å¯Œå£«é€šã‚„IBMã‚‚Hadoopã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã‚’å±•é–‹ã—ã¦ãŠã‚Šãƒ¬ãƒƒãƒ‰ã‚ªãƒ¼ã‚·ãƒ£ãƒ³ãªæ„Ÿã˜ã§ã™ã€‚ å¯Œå£«é€šãŒãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿åˆ†æžãƒ»æ´»ç”¨å‘ã‘ã®PaaSã‚µãƒ¼ãƒ“ã‚¹ | æ—¥çµŒ xTECHï¼ˆã‚¯ãƒã‚¹ãƒ†ãƒƒã‚¯ï¼‰ æ—¥æœ¬IBMã€è¡¨è¨ˆç®—ã®ã‚ˆã†ã«åˆ†æžã§ãã‚‹Hadoopã‚½ãƒ•ãƒˆæ–°ç‰ˆã€ŒBigInsightsã€ | æ—¥çµŒ xTECHï¼ˆ
Arison 2011/09/05
hadoop

ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°
ãƒªãƒ³ã‚¯
Twitterã‚„Facebookã§ä½¿ã‚ã‚Œã¦ã„ã‚‹ã€ŒApache Hadoopã€ã®ãƒ¡ãƒªãƒƒãƒˆã‚„æ´å²ã‚’ä½œè€…è‡ªã‚‰ãŒèªžã‚‹
å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã®åˆ†æ•£å‡¦ç†ã‚’æ”¯ãˆã‚‹Javaã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã§ã‚ã‚Šã€ãƒ•ãƒªãƒ¼ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã¨ã—ã¦é…å¸ƒã•ã‚Œã¦ã„ã‚‹ã€ŒApache Hadoopã€ã€‚ãã®ä½œè€…ãƒ€ã‚°ãƒ»ã‚«ãƒ†ã‚£ãƒ³ã‚°ï¼ˆDoug Cuttingï¼‰ã•ã‚“ãŒã€ŒCloud Computing World Tokyo 2011ã€ï¼†ã€ŒNext Generation Data Center 2011ã€ã«ãŠã„ã¦ã€ŒApache Hadoop: A New Paradigm for Data Processingã€ã¨ã„ã†è¬›æ¼”ã‚’ã—ã¦ã„ãŸã®ã§èžãã«è¡Œã£ã¦ãã¾ã—ãŸã€‚ æº€å“¡ã®å®¢å¸ã€‚ çš†æ§˜ã‚’å‰ã«ã—ã¦è¬›æ¼”ã§ãã‚‹ã“ã¨ã‚’å¤§å¤‰å…‰æ „ã«æ€ã£ã¦ãŠã‚Šã¾ã™ã€‚ã€ŒApache Hadoopã€ã«ã¤ã„ã¦çš†æ§˜ã«ä¼ãˆã¦ã„ãã¾ã™ãŒã€ã“ã‚Œã¯ã¾ã•ã«ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã®æ–°ãŸãªã‚‹ãƒ‘ãƒ©ãƒ€ã‚¤ãƒ ã‚’æä¾›ã™ã‚‹ã‚‚ã®ã§ã¯ãªã„ã‹ã¨ç§ã¯æ€ã£ã¦ãŠã‚Šã¾ã™ã€‚ ã¾ãšã¯ç°¡å˜ã«è‡ªå·±ç´¹ä»‹ã‚’ã•ã›ã¦ã„ãŸã ãã¾ã—ã‚‡ã†ã€‚ç§ã¯25å¹´ã«æ¸¡ã£ã¦ã‚·ãƒªã‚³ãƒ³ãƒãƒ¬ãƒ¼ã§ä»•
Arison 2011/09/02
hadoop ã¯ã‚¹ã‚±ãƒ¼ãƒ«ã‚¢ã‚¦ãƒˆã§ã®æ€§èƒ½ã‚¢ãƒƒãƒ—ã¯è¦‹è¾¼ã‚ã‚‹ã‘ã©ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ä»¥å¤–ãªã‚‰æ™®é€šã«å‡¦ç†ã—ãŸæ–¹ãŒã„ã„ã€‚ã»ã¨ã‚“ã©ã®ä¼æ¥ã«ã¯å‘ã„ã¦ã„ãªã„ã€‚ãƒ‡ãƒ¼ã‚¿ã®æ›´æ–°ãŒã—ã«ãã„ã®ãŒãŸã¾ã«å‚·ã€‚

ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢

hadoop

Java

ãƒ“ã‚¸ãƒã‚¹

è‘—åäºº
ãƒªãƒ³ã‚¯
å¹³æˆï¼’ï¼‘å¹´åº¦ç”£å¦é€£æºã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢å·¥å¦å®Ÿè·µäº‹æ¥ï¼ˆé«˜ä¿¡é ¼ã‚¯ãƒ©ã‚¦ãƒ‰å®Ÿç¾ç”¨ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢é–‹ç™ºï¼ˆåˆ†æ•£åˆ¶å¾¡å‡¦ç†æŠ€è¡“ç‰ã«ä¿‚ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼ã®é«˜ä¿¡é ¼åŒ–ã«å‘ã‘ãŸå®Ÿè¨¼äº‹æ¥ï¼‰ï¼‰äº‹æ¥æˆæžœå ±å‘Šæ›¸
Arison 2011/08/02
åˆ†æ•£åˆ¶å¾¡å‡¦ç†æŠ€è¡“ç‰ã«ä¿‚ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼ã®é«˜ä¿¡é ¼åŒ–ã«å‘ã‘ãŸå®Ÿè¨¼äº‹æ¥ã€‚ç´ æ™´ã‚‰ã—ã„è³‡æ–™ã€‚

è³‡æ–™

google

hadoop

ã‚¯ãƒ©ã‚¦ãƒ‰
ãƒªãƒ³ã‚¯
1