[B! AWS][hadoop] msyktã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

msykt id:msykt

AWSã¨hadoopã«é–¢ã™ã‚‹msyktã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (2)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

ç¬¬8å›žã€€Amazon Elastic MapReduceã®ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ã‚’ãƒ¢ãƒ‹ã‚¿ãƒªãƒ³ã‚°ã™ã‚‹ | gihyo.jp
å‰å›žã¯Amazon Elastic MapReduceã‹ã‚‰å°‘ã—é›¢ã‚Œã¦ã€Hadoopã®åŸºç¤Žã®è¦–ç‚¹ã‹ã‚‰ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ã«ã¤ã„ã¦èª¬æ˜Žã—ã¾ã—ãŸã€‚ä»Šå›žã‹ã‚‰EMRã«ç‰¹åŒ–ã—ã¦ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ã®èª¬æ˜Žã‚’ã—ã¦ã„ãã¾ã™ã€‚ bootstrapã§Gangliaã‚’è¨å®šã—ã¦ç›£è¦–ã™ã‚‹ ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ã‚’å‡ºã™ãŸã‚ã«ã¾ãšé‡è¦ãªã®ãŒã€ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ã‚’è¨ˆæ¸¬ã™ã‚‹ã“ã¨ã§ã™ã€‚ EC2ã¨åŒæ§˜ã«ã€EMRã‚‚ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ã®ã‚¿ã‚¤ãƒ—ãŒé¸ã¹ã‚‹ã®ã§ã€CPUã‚„ãƒ¡ãƒ¢ãƒªãªã©ã®ã‚¹ãƒšãƒƒã‚¯ãŒè¶³ã‚Šã¦ã„ãªã„ã‹ã©ã†ã‹ã‚’åˆ¤æ–ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚é€†ã«ã€ŒãƒŽãƒ¼ãƒ‰æ•°20ã§èµ·å‹•ã—ã¦ã„ãŸãŒã€10ãƒŽãƒ¼ãƒ‰ã§æ¸ˆã‚€ã€ãªã©ã¨ã‚ã‹ã‚Šã€é«˜ã‚¹ãƒšãƒƒã‚¯ãªã‚‚ã®ã‚’æ”¹å–„ã™ã‚Œã°ã‚³ã‚¹ãƒˆã‚‚å‰Šæ¸›ã§ãã¾ã™ã€‚ EMRã®ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ã®ç›£è¦–ã«ã¯ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ç›£è¦–ãƒ„ãƒ¼ãƒ«ã§ã‚ã‚‹Gangliaã‚’ä½¿ã„ã¾ã™ã€‚Gangliaã¯ã€æ•°åƒãƒŽãƒ¼ãƒ‰ã¾ã§å¯¾å¿œã§ãã‚‹ã‚ˆã†ã«è¨è¨ˆã•ã‚Œã¦ã„ã¾ã™ã€‚è©³ã—ãã¯Gangliaã®ãƒšãƒ¼ã‚¸ã‚’å‚ç…§ã—ã¦ã¿ã¦ãã ã•ã„ã€‚ EM
msykt 2013/05/04
emr

hadoop

aws
ãƒªãƒ³ã‚¯
ã€Œã‚ªãƒ³ãƒ—ãƒ¬ãƒŸã‚¹ãƒ»ã‚·ã‚¹ãƒ†ãƒ ã®çµ‚ã‚ã‚Šã€ã®å§‹ã¾ã‚Šã€œAWSã§ã®ãƒŸãƒƒã‚·ãƒ§ãƒ³ã‚¯ãƒªãƒ†ã‚£ã‚«ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã®ç¨¼åƒ - æ€¥ãŒã°å›žã‚Œã€é¸ã¶ãªã‚‰è¿‘é“
å€‹äººçš„ã«ã¯å‰²ã¨å¤§å¤‰ã ã£ãŸã®ã§ã€ãã®è¾ºã‚’ã¾ã¨ã‚ã¦ãŠãã¾ã™ã€‚ ãƒ‹ãƒ¥ãƒ¼ã‚¹ãƒªãƒªãƒ¼ã‚¹ã¯ã“ã¡ã‚‰ã€‚ http://www.nautilus-techno logies.com/topics/20130409.html è¦ã™ã‚‹ã«æœ¬éƒ¨ç³»ãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰åŸºå¹¹ã‚·ã‚¹ãƒ†ãƒ ã®ã€Œä¸€å¼ã€ã®ã‚¯ãƒ©ã‚¦ãƒ‰ç§»è¡Œã§ã™ã€‚å®Œå…¨ãªãƒŸãƒƒã‚·ãƒ§ãƒ³ã‚¯ãƒªãƒ†ã‚£ã‚«ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã§ã€æ¢ã¾ã£ãŸæ®µéšŽã§æ¥å‹™ã«ç¢ºå®Ÿã«å½±éŸ¿ãŒå‡ºã¾ã™ã€‚ ã‚·ã‚¹ãƒ†ãƒ ã®æ©Ÿèƒ½æ¦‚è¦ 1.å£²ä¸Šã®ç¢ºå®šå‡¦ç†ã¨å‚µæ¨©ç®¡ç† POSãƒ‡ãƒ¼ã‚¿ã®ç›´çµã§ã™ã€‚å£²ä¸Šç¢ºå®šå‡¦ç†ã‚’è¡Œã„ã¾ã™ã€‚åŒæ™‚ã«å‚µæ¨©ç®¡ç†ã‚‚è¡Œã„ã€F/Bã‹ã‚‰ã®å…¥é‡‘ãƒ‡ãƒ¼ã‚¿ã‚’ãã®ã¾ã¾ã¤ãªãŽè¾¼ã¿ã€å…¥é‡‘å‡¦ç†ãƒ»å‚µæ¨©ã®æ¶ˆã—è¾¼ã¿å‡¦ç†ã‚’å®Ÿè¡Œã—ã¾ã™ã€‚ãƒžãƒƒãƒãƒ³ã‚°ã¯è‡ªå‹•å‡¦ç†ã§ãã‚‹ã‚‚ã®ã¯å‡¦ç†ã‚’è¡Œã„ã€ãƒ’ãƒ¥ãƒ¼ãƒªã‚¹ãƒ†ã‚£ãƒƒã‚¯ãªã‚‚ã®ã¯ãƒ¦ãƒ¼ã‚¶ãƒ¼åˆ¤æ–ã«å¾“ã„ã¾ã™ã€‚ 2.ä»•å…¥ãƒ»è²»ç”¨ã®è¨ˆä¸Šã¨ç¢ºå®šå‡¦ç†ã€ãŠã‚ˆã³æ”¯æ‰•ã„ãƒ‡ãƒ¼ã‚¿ã®ä½œæˆ è²»ç”¨ãƒ»åœ¨åº«ã®è¨ˆä¸Šç¢ºå®šå‡¦ç†ã§ã™ã€‚å½“æ™‚ã«æ”¯æ‰•ãƒ‡ãƒ¼ã‚¿ã®ç¢ºå®šå‡¦ç†ã‚’è¡Œã„ã¾ã™ã€‚EDIï¼ˆBMSï¼‰ã¨ã®
msykt 2013/04/14
aws

hadoop
ãƒªãƒ³ã‚¯
1

ãŠçŸ¥ã‚‰ã›

ã‚‚ã£ã¨èªã‚€

å…¬å¼Twitter

@hatebu
æœ€æ–°ã®äººæ°—ã‚¨ãƒ³ãƒˆãƒªãƒ¼ã®é…ä¿¡

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

jæ¬¡ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

kå‰ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

lã‚ã¨ã§èªã‚€

eã‚³ãƒ¡ãƒ³ãƒˆä¸€è¦§ã‚’é–‹ã

oãƒšãƒ¼ã‚¸ã‚’é–‹ã

è¨å®šã‚’å¤‰æ›´ã—ã¾ã—ãŸx

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

ã‚¿ã‚°

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (2)

AWSã¨hadoopã«é–¢ã™ã‚‹msyktã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (2)

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´3æœˆç¬¬3é€±ï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´3æœˆç¬¬2é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´2æœˆï¼‰

å…¬å¼Twitter

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹

ã‚¿ã‚°

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (2)

AWSã¨hadoopã«é–¢ã™ã‚‹msyktã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (2)

ç¬¬8å›žã€€Amazon Elastic MapReduceã®ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ã‚’ãƒ¢ãƒ‹ã‚¿ãƒªãƒ³ã‚°ã™ã‚‹ | gihyo.jp

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2025å¹´3æœˆç¬¬3é€±ï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2025å¹´3æœˆç¬¬2é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2025å¹´2æœˆï¼‰

å…¬å¼Twitter

ã‚­ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (2)

AWSã¨hadoopã«é–¢ã™ã‚‹msyktã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (2)

ç¬¬8å›žã€€Amazon Elastic MapReduceã®ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ã‚’ãƒ¢ãƒ‹ã‚¿ãƒªãƒ³ã‚°ã™ã‚‹ | gihyo.jp

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´3æœˆç¬¬3é€±ï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´3æœˆç¬¬2é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´2æœˆï¼‰

å…¬å¼Twitter

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹