[B! Hadoop] y-kawazã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

y-kawaz id:y-kawaz

Hadoopã«é–¢ã™ã‚‹y-kawazã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (10)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

æ—¥ã€…é€²åŒ–ã™ã‚‹Hadoopã€‚ã“ã‚Œã¾ã§ã®ãŠã•ã‚‰ã„ã¨æœ€è¿‘ã®å‹•å‘ï¼ˆå‰ç·¨ï¼‰
å¤§è¦æ¨¡ãªåˆ†æ•£å‡¦ç†ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã¨ã—ã¦HadoopãŒç™»å ´ã—ãŸã“ã¨ã«ã‚ˆã‚Šã€ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã®ãƒ–ãƒ¼ãƒ ã‚„ã€å¤§è¦æ¨¡ãªã‚½ãƒ¼ã‚·ãƒ£ãƒ«ã‚²ãƒ¼ãƒ ã§ã®ãƒã‚°è§£æžã«ã‚ˆã‚‹æ”¹å–„ã€ã‚³ãƒžãƒ¼ã‚¹ã‚µã‚¤ãƒˆã§ã®æ©Ÿæ¢°å¦ç¿’ã«ã‚ˆã‚‹ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ãªã©ã€å¤šãã®å¤‰åŒ–ãŒå¼•ãèµ·ã“ã•ã‚Œã¦ãã¾ã—ãŸã€‚ ãã—ã¦ãã®Hadoopè‡ªä½“ã‚‚ã€æ—¥ã€…é€²åŒ–ã—ç¶šã‘ã¦ã„ã¾ã™ã€‚ Hadoopã¨ã¯ã©ã†ã„ã†ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§ã‚ã‚Šã€ã„ã¾ã©ã®ã‚ˆã†ãªçŠ¶æ³ã«ãªã£ã¦ã„ã‚‹ã®ã‹ã€‚NTTãƒ‡ãƒ¼ã‚¿ã®æ¿±é‡Žè³¢ä¸€æœ—æ°ãŒã€å…ˆæ—¥è¡Œã‚ã‚ŒãŸç¬¬2å›ž NHNãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã§è¡Œã£ãŸã‚»ãƒƒã‚·ãƒ§ãƒ³ã€Œæ—¥ã€…é€²åŒ–ã™ã‚‹Hadoopã®ã€Žã„ã¾ã€ã€ã§åˆ†ã‹ã‚Šã‚„ã™ãè§£èª¬ã—ã¦ã„ã¾ã™ã€‚ ã“ã®è¨˜äº‹ã§ã¯ãã®ã‚»ãƒƒã‚·ãƒ§ãƒ³ã®å†…å®¹ã‚’ãƒ€ã‚¤ã‚¸ã‚§ã‚¹ãƒˆã§ç´¹ä»‹ã—ã¾ã—ã‚‡ã†ã€‚ æ—¥ã€…é€²åŒ–ã™ã‚‹Hadoopã®ã€Œã„ã¾ã€ NTTãƒ‡ãƒ¼ã‚¿ åŸºç›¤ã‚·ã‚¹ãƒ†ãƒ äº‹æ¥éƒ¨ æ¿±é‡Žè³¢ä¸€æœ—æ°ã€‚ NTTãƒ‡ãƒ¼ã‚¿ã¨ã„ã†ã¨ã“ã‚ã§ä»•äº‹ã‚’ã—ã¦ã„ã¾ã™ã€‚NTTãƒ‡ãƒ¼ã‚¿è‡ªä½“ã¯ã‚‚ã†5å¹´ãã‚‰ã„Hadoopã‚’ã‚„ã£ã¦ã¾ã—ã¦ã€ã
y-kawaz 2012/08/27
hadoop
ãƒªãƒ³ã‚¯
ã€ŒtagomorisãŒé¨™ã‚‹ ã¯ã˜ã‚ã¦ã®Hadoopã€ - ãŸã”ã‚‚ã‚Šã™ãƒ¡ãƒ¢
æ·±å¤œã«ã€Œã¯ã˜ã‚ã¦ã®Hadoopã€ãŒå‡ºç‰ˆã•ã‚Œã‚‹ã¨ã—ãŸã‚‰æ¬²ã—ã„ãƒã‚¿ã®ä¸€è¦§ã‚’ãªã‚“ã¨ãªãè€ƒãˆã¦ãŸã€‚Hadoopã‚¯ãƒ©ã‚¹ã‚¿ã®ã‚»ãƒƒãƒˆã‚¢ãƒƒãƒ—ã‚’æ–°è¦ã«ã‚„ã‚‹ã®ãŒäºˆå®šã«ã‚ã‚‹ã®ã§ã€ãã‚Œã‚‚å«ã‚ã¦ãƒˆãƒ”ãƒƒã‚¯ã ã‘æ›¸ãå‡ºã—ã¦ãŠã“ã†ã‹ãªã¨æ€ã£ãŸæ¬¡ç¬¬ã€‚ ã€Œåˆã‚ã¦ã®Hadoopã€ã¡ã‚‡ã£ã¨è€ƒãˆã¦ãŸãŒã€ä¾‹ãˆã°æœ€åˆã«è€ƒãˆã‚‹ã¹ãHDFSã®block sizeã¨ã‹ã§ã€ã§ã‚‚ãã‚ŒãƒŽãƒ¼ãƒ‰æ•°ã¨MRå‡¦ç†ãƒ‡ãƒ¼ã‚¿é‡ã®æœ€å¤§/å¹³å‡ã‚µã‚¤ã‚ºã¨ã€ãƒ‡ãƒ¼ã‚¿æŠ•å…¥æ™‚ã®åœ§ç¸®ã€ãã†ã„ã†ã“ã¨ã‚’ã¡ã‚ƒã‚“ã¨è€ƒãˆãªã„ã¨æ±ºã¾ã‚‰ãªã„ã‚“ã ã‚ˆãã€ãã†ã„ã†ã“ã¨ã‚’æ›¸ã„ã¦ã‚‹æœ¬ãŒãªã„ã‚ˆãã€ã¿ãŸã„ãª 2012-05-08 01:13:11 via TweetDeck è¨è¨ˆ HDFSç·å®¹é‡ã¨å‡¦ç†å¯¾è±¡ã®ãƒ‡ãƒ¼ã‚¿é‡ã«ã¤ã„ã¦ ãƒ•ã‚¡ã‚¤ãƒ«ã®å½¢å¼ã«ã¤ã„ã¦ (TextFile/SequenceFile/RCFile) ãƒ‡ãƒ¼ã‚¿ã®åœ§ç¸®ã«ã¤ã„ã¦ ãƒŽãƒ¼ãƒ‰ã‚ãŸã‚Šã®HDDå°æ•°ã€ãƒ‡ã‚£ã‚¹ã‚¯ã®é¸æŠž CPUãŠã‚ˆã³ãƒ¡ãƒ¢ãƒªã®é¸æŠž ãƒŽãƒ¼ãƒ‰æ•° H
y-kawaz 2012/05/08
hadoop
ãƒªãƒ³ã‚¯
FacebookãŒHBaseã‚’å¤§è¦æ¨¡ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ å‡¦ç†ã«åˆ©ç”¨ã—ã¦ã„ã‚‹ç†ç”±ï¼ˆå¾Œç·¨ï¼‰
Facebookã¯å¤§è¦æ¨¡ãªãƒ‡ãƒ¼ã‚¿å‡¦ç†ã®åŸºç›¤ã¨ã—ã¦HBaseã‚’åˆ©ç”¨ã—ã¦ã„ã¾ã™ã€‚ãªãœFacebookã¯HBaseã‚’ç”¨ã„ã¦ã„ã‚‹ã®ã‹ã€ã©ã®ã‚ˆã†ã«åˆ©ç”¨ã—ã¦ã„ã‚‹ã®ã§ã—ã‚‡ã†ã‹ï¼Ÿ 7æœˆ1æ—¥ã«éƒ½å†…ã§è¡Œã‚ã‚ŒãŸå‹‰å¼·ä¼šã§ã€Facebookã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã§ã‚ã‚‹ã‚¸ãƒ§ãƒŠã‚µãƒ³ãƒ»ã‚°ãƒ¬ã‚¤ï¼ˆJonathan Grayï¼‰æ°ã«ã‚ˆã‚‹è§£èª¬ãŒè¡Œã‚ã‚Œã¾ã—ãŸã€‚ ã“ã®è¨˜äº‹ã¯ã€ã€ŒFacebookãŒHBaseã‚’å¤§è¦æ¨¡ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ å‡¦ç†ã«åˆ©ç”¨ã—ã¦ã„ã‚‹ç†ç”±ï¼ˆå‰ç·¨ï¼‰ã€ã®ç¶šãã§ã™ã€‚ äº‹ä¾‹1 Titanï¼ˆFacebookãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ï¼‰ HBaseãŒFacebookã§ã©ã®ã‚ˆã†ãªã‚¢ãƒ—ãƒªã‚±ï¼ã‚·ãƒ§ãƒ³ã§ä½¿ã‚ã‚Œã¦ã„ã‚‹ã®ã‹ã‚’ç´¹ä»‹ã—ã‚ˆã†ã€‚ Facebookã®æ–°ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸æ©Ÿèƒ½ã€‚
y-kawaz 2011/07/04
è¦æ¨¡ãŒé€”æ–¹ã‚‚ãªã•ã™ãŽã¦ã‚‚ã†(^^ï¼›

Facebook

hBase

Hadoop
ãƒªãƒ³ã‚¯
ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãªHadoopï¼Ÿ ã€ŒReal-Time MapReduceã€ã‚’å®Ÿç¾ã™ã‚‹S4ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã¨ã—ã¦Yahoo!ãŒå…¬é–‹ ï¼ Publickey
ç±³Yahoo!ã¯ã€å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã®åˆ†æ•£å‡¦ç†ã‚’å®Ÿç¾ã™ã‚‹MapReduceã‚’ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ã«è¡Œã†ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã€ŒS4ã€ã‚’ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã¨ã—ã¦å…¬é–‹ã—ã¾ã—ãŸã€‚ MapReduceã‚’å®Ÿè¡Œã™ã‚‹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã¨ã—ã¦ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ã€ŒHadoopã€ãŒã‚ã‚Šã¾ã™ãŒã€Hadoopã¯ã‚ã‚‰ã‹ã˜ã‚ã‚¸ãƒ§ãƒ–ã‚’å®šç¾©ã—ã¦æŠ•å…¥ã™ã‚‹ãƒãƒƒãƒå‡¦ç†ã‚’å‰æã¨ã—ã¦ã„ã¾ã—ãŸã€‚ S4ã¯ã€ãƒ‡ãƒ¼ã‚¿ã‚’ã‚ãƒ¼ã¨ãƒãƒªãƒ¥ãƒ¼ã®ãƒšã‚¢ã§æ§‹æˆã•ã‚Œã‚‹ã‚¹ãƒˆãƒªãƒ¼ãƒ ãƒ‡ãƒ¼ã‚¿ã¨ã—ã¦éžåŒæœŸã«å—ã‘å–ã‚‹ã“ã¨ãŒã§ãã€å‡¦ç†çµæžœã‚‚ã‚ãƒ¼ãƒãƒªãƒ¥ãƒ¼ã®ãƒšã‚¢ã§æ§‹æˆã•ã‚ŒãŸã‚¹ãƒˆãƒªãƒ¼ãƒ ãƒ‡ãƒ¼ã‚¿ã¨ã—ã¦å‡ºåŠ›ã™ã‚‹ã‚ˆã†ã«ãªã£ã¦ã„ã‚‹ã¨ã®ã“ã¨ã€‚ ã“ã®éžåŒæœŸãªã‚¹ãƒˆãƒªãƒ¼ãƒ ãƒ‡ãƒ¼ã‚¿ã«ã‚ˆã‚‹å…¥å‡ºåŠ›ãŒã€ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãªMapReduceã‚’å®Ÿç¾ã™ã‚‹ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã¨ã—ã¦ã®S4ã®ç‰¹å¾´ã¨ã„ãˆã¾ã™ã€‚ ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãªMapReduceã§ä½•ãŒã§ãã‚‹ï¼Ÿ ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãªMapReduceã«ã¯ã©ã®ã‚ˆã†ãªç”¨é€”ãŒè€ƒãˆã‚‰ã‚Œã‚‹ã®ã§ã—ã‚‡ã†ã‹ï¼Ÿ S4ã®å…¬é–‹ã‚’è¡¨æ˜Žã—ãŸY
y-kawaz 2010/11/04
hadoop

yahoo

s4

mapreduce
ãƒªãƒ³ã‚¯
NTTãƒ‡ãƒ¼ã‚¿ã®Hadoopå ±å‘Šæ›¸ãŒã™ã”ã‹ã£ãŸ - ç§‘å¦ã¨éžç§‘å¦ã®è¿·å®®
æ¥ç•Œãƒˆãƒƒãƒ— ã®ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚º Hadoop ä¼æ¥ Cloudera ã«å…¥ç¤¾ã—ã¾ã—ãŸ http://www.cloudera.co.jp/ ä»Šå¹´ã®6æœˆã«ã€ã€Œå¹³æˆï¼’ï¼‘å¹´åº¦ ç”£å¦é€£æºã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢å·¥å¦å®Ÿè·µäº‹æ¥å ±å‘Šæ›¸ã€ã¨ã„ã†ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆç¾¤ãŒçµŒç”£çœã‹ã‚‰å…¬è¡¨ã•ã‚Œã¾ã—ãŸã€‚ ãã®ã†ã¡ã®ä¸€ã¤ã«ã€NTTãƒ‡ãƒ¼ã‚¿ã«å§”è¨—ã•ã‚ŒãŸHadoopã«é–¢ã™ã‚‹å®Ÿè¨¼å®Ÿé¨“ã®å ±å‘Šæ›¸ãŒã‚ã‚Šã¾ã—ãŸã®ã§ã€ä»Šæ›´ãªãŒã‚‰èªã‚“ã§ã¿ã‚‹ã“ã¨ã«ã—ã¾ã—ãŸã€‚ Hadoopç•Œéšˆã®äººã¯ã‚‚ã†ã¿ã‚“ãªã¨ã£ãã«èªã‚“ã§ã‚‹ã®ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ã‘ã©ã€‚ http://www.meti.go.jp/policy/mono_info_service/joho/downloadfiles/2010software_research/clou_dist_software.pdf ã€Œé«˜ä¿¡é ¼ã‚¯ãƒ©ã‚¦ãƒ‰å®Ÿç¾ç”¨ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢é–‹ç™ºï¼ˆåˆ†æ•£åˆ¶å¾¡å‡¦ç†æŠ€è¡“ç‰ã«ä¿‚ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼é«˜ä¿¡é ¼åŒ–ã«å‘ã‘ãŸå®Ÿè¨¼äº‹æ¥ï¼‰ã€ã¨ã„ã†
y-kawaz 2010/09/29
hadoop

ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚°

ã‚¯ãƒ©ã‚¦ãƒ‰

é‹ç”¨

ã‚ã¨ã§èªã‚€
ãƒªãƒ³ã‚¯
Hadoopã‚’ä½¿ã„ã“ãªã™(1)
ã¾ãšã€ 1 ã®å…¥åŠ›ãƒ•ã‚¡ã‚¤ãƒ«ã‚’åˆ†å‰²ã™ã‚‹æ–¹æ³•ã¯ã€InputFormatã‚¯ãƒ©ã‚¹ã®ã€getSplitsé–¢æ•°ã‚’ä¸Šæ›¸ãã™ã‚‹ã“ã¨ã§ã€ã‚«ã‚¹ã‚¿ãƒžã‚¤ã‚ºã§ãã¾ã™ã€‚ ã¾ãŸã€ 3 ã®InputSplitã‹ã‚‰ã€Keyã¨Valueã‚’æŠ½å‡ºã™ã‚‹å‡¦ç†ã‚‚ã€InputFormatã‚¯ãƒ©ã‚¹ã‚’é€šã˜ã¦ã‚«ã‚¹ã‚¿ãƒžã‚¤ã‚ºã§ãã¾ã™ã€‚ InputFormatã®getRecordReaderé–¢æ•°ã‚’é€šã˜ã¦ã€RecordReaderã‚¯ãƒ©ã‚¹ã‚’ç”Ÿæˆã™ã‚‹ã®ã§ã™ãŒã€ã“ã‚Œã«ä»»æ„ã®RecordReaderã‚¯ãƒ©ã‚¹ã‚’æŒ‡å®šã™ã‚Œã°OKã§ã™ã€‚ 2 ã®Mapå‡¦ç†ã§ã™ãŒã€ãƒ¦ãƒ¼ã‚¶ãŒæŒ‡å®šã—ãŸMapperã‚¯ãƒ©ã‚¹ã®å‡¦ç†ã‚’å®Ÿè¡Œã—ã¾ã™ã€‚ Mapperã‚¯ãƒ©ã‚¹ã¯ã€MapRunnerã‚¯ãƒ©ã‚¹ã‚’é€šã˜ã¦ã€åˆæœŸåŒ–å‡¦ç†ã€mapé–¢æ•°ã‚’ç¹°ã‚Šè¿”ã™éŽç¨‹ã€çµ‚äº†å‡¦ç†ã¨ã„ã£ãŸä¸€é€£ã®æµã‚Œã‚’å®Ÿè¡Œã—ã¾ã™ã€‚ MapRunnerã‚¯ãƒ©ã‚¹ã‚’ã‚«ã‚¹ã‚¿ãƒžã‚¤ã‚ºã™ã‚Œã°ã€ã“ã†ã—ãŸæµã‚Œã‚’åˆ¶å¾¡ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ 0.20.0ã‹ã‚‰ã®æ–°ã—ã„MapRed
y-kawaz 2010/01/26
hadoop

mapreduce

åˆ†æ•£å‡¦ç†
ãƒªãƒ³ã‚¯
Hadoopã‚’æ¥å‹™ã§ä½¿ã£ã¦ã¿ãŸè©± - ã‚¯ãƒƒã‚¯ãƒ‘ãƒƒãƒ‰é–‹ç™ºè€…ãƒ–ãƒã‚°
8æœˆã«å…¥ç¤¾ã—ãŸä½ã€…æœ¨ã§ã™ã€‚ã“ã‚“ã«ã¡ã‚ï¼ å…¥ç¤¾ã—ã¦ã‹ã‚‰ã¯Hadoopã‚’ä½¿ã†ã“ã¨ãŒå¤šãã€æ—¥ã€…ã€å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã¨æ ¼é—˜ã—ã¦ã„ã¾ã™ã€‚å¤§å¤‰ã§ã¯ã‚ã‚Šã¾ã™ãŒã€å€‹äººã§ã¯ãªã‹ãªã‹è§¦ã‚‹ã“ã¨ãŒå‡ºæ¥ãªã„ã‚ˆã†ãªå¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’è§¦ã‚Œã‚‹ã®ã¯æ¥½ã—ã„ã§ã™ã€‚ ã•ã¦ã€Hadoopã¯æœ€è¿‘è‰²ã€…ãªã¨ã“ã‚ã§ä½¿ã‚ã‚Œå§‹ã‚ã¦ãã¦ã„ã‚‹ã¨æ€ã†ã‚“ã§ã™ãŒã€å®Ÿéš›ã«åˆ©ç”¨ã—ã¦ã¿ã¦å›°ã£ãŸäº‹ã‚„tipsãªã©ã€å®Ÿè·µçš„ãªæƒ…å ±ã¯ã¾ã ã‚ã¾ã‚Šå…¬é–‹ã•ã‚Œã¦ã„ã¾ã›ã‚“ã€‚ãã®è¾ºã®æƒ…å ±ã‚’ã¿ã‚“ãªæ±‚ã‚ã¦ã„ã‚‹ã¯ãšâ€¦ï¼ï¼ ãã“ã§ã€åƒ•ãŒå®Ÿéš›ã«è§¦ã£ã¦ã¿ã¦å›°ã£ãŸäº‹ã‚„Hadoopã‚’ä½¿ã†ä¸Šã§ãƒã‚¤ãƒ³ãƒˆã ã¨æ€ã£ãŸã“ã¨ãªã©ã‚’ç¤¾å†…å‹‰å¼·ä¼šã§ç™ºè¡¨ã—ãŸã®ã§å…¬é–‹ã—ã¦ã¿ã¾ã™ã€‚Hadoopã‚’ä½¿ã£ã¦ã„ã‚‹ï¼ˆä½¿ã„ãŸã„ã¨æ€ã£ã¦ã„ã‚‹ï¼‰æ–¹ã®å‚è€ƒã«ãªã‚Œã°å¹¸ã„ã§ã™ã€‚ [slideshare id=2711363&doc=20091214tech blog-091213183529-phpapp02] Hadoopã®åˆ©ç”¨ã¯ã¾ã ã¾ã è©¦è¡ŒéŒ¯èª¤ã®é€£ç¶š
y-kawaz 2009/12/17
hadoop
ãƒªãƒ³ã‚¯
å„ªè‰¯ä¼æ¥ã¯ãªãœHadoopã«èµ°ã‚‹ã®ã‹
ã¡ãªã¿ã«ã€ã“ã®åˆ†æžã®ãŸã‚ã«å¿…è¦ã¨ã•ã‚Œã‚‹MapReduceã®ã‚³ãƒ¼ãƒ‰ã§ã‚ã‚‹ãŒã€ãã®ã‚µã‚¤ã‚ºã¯ã‚ãšã‹20ã‚¹ãƒ†ãƒƒãƒ—ã ã¨ã„ã†ã€‚Yahoo!ã®ãƒ—ãƒ¬ã‚¼ãƒ³ãƒ†ãƒ¼ã‚¿ãƒ¼ã§ã‚ã‚‹ã€ã‚¨ãƒªãƒƒã‚¯ãƒ»ãƒãƒ«ãƒ‡ã‚·ãƒ¥ãƒã‚¤ãƒ©ãƒ¼æ°ã«ã‚ˆã‚‹ã¨ã€ãŸã¨ãˆçµŒé¨“ã®æµ…ã„ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã§ã‚ã£ã¦ã‚‚ã€MapReduceã«ã‚ˆã‚‹ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ã¯å¯èƒ½ã§ã‚ã‚‹ã¨ã•ã‚Œã‚‹ã€‚ ã¾ãŸã€VISAã®ã‚¸ãƒ§ãƒ¼ãƒ»ã‚«ãƒ‹ãƒ³ã‚¬ãƒ æ°ã‹ã‚‰ã‚‚ã€è²´é‡ãªãƒ‡ãƒ¼ã‚¿ãŒæä¾›ã•ã‚Œã¦ã„ãŸã®ã§ä»¥ä¸‹ã«ç´¹ä»‹ã™ã‚‹ã€‚åŒç¤¾ã§ã¯ã€1æ—¥ã«1å„„ãƒˆãƒ©ãƒ³ã‚¶ã‚¯ã‚·ãƒ§ãƒ³ãŒç™ºç”Ÿã™ã‚‹ãŸã‚ã€2å¹´é–“ã§700å„„å¼·ã®ãƒˆãƒ©ãƒ³ã‚¶ã‚¯ã‚·ãƒ§ãƒ³ãƒã‚°ãŒè“„ç©ã•ã‚Œã€ãã®ãƒ‡ãƒ¼ã‚¿é‡ã¯36ãƒ†ãƒ©ãƒã‚¤ãƒˆã«è‡³ã‚‹ã¨ã„ã†ã€‚ã“ã†ã—ãŸã‚¹ã‚±ãƒ¼ãƒ«ã®ãƒ‡ãƒ¼ã‚¿ã‚’ã€å¾“æ¥ã®RDBã‚’ç”¨ã„ã¦åˆ†æžã™ã‚‹ã«ã¯ã€ç´„1ã‚«æœˆã®æ™‚é–“ãŒå¿…è¦ã¨ã•ã‚Œã¦ããŸãŒã€Hadoopã‚’ç”¨ã„ã‚‹ã“ã¨ã§13åˆ†ã«çŸç¸®ã•ã‚ŒãŸã¨ã„ã†ã€‚ ã“ã‚Œã¾ã§ã¯ã€Yahoo!ã«ã—ã‚VISAã«ã—ã‚ã€è†¨å¤§ãªãƒ‡ãƒ¼ã‚¿ã‚’RDBã«æŠ¼ã—è¾¼ã‚€ã»ã‹ã«æ–¹æ³•ã¯ãªãã€ãã®åˆ†æžã«æ•°åæ—¥ã‚’è¦ã™ã‚‹
y-kawaz 2009/10/16
ãã‚ãã‚è©¦ã—ã¦ã¿ã‚‹æ™‚æœŸã‹ãªãï¼ã—ã‹ã—è©¦ã™æ™‚é–“ã‚’æ»å‡ºã™ã‚‹ã®ãŒåœ§å€’çš„ã«å¤§å¤‰ã ãƒ»ãƒ»ãƒ»

hadoop

mapreduce
ãƒªãƒ³ã‚¯
Amazon Elastic MapReduceã‚’ä½¿ã£ã¦ã¿ãŸ - moratorium
Amazon Elastic MapReduceã‚’ä½¿ã£ã¦ã¿ãŸ 2009-04-03 (Fri) 3:06 Amazon EC2 é€£æ—¥ã®EC2ãƒã‚¿ã§ã™ã€‚æœ¬æ—¥ã€Amazonã‹ã‚‰Elastic MapReduceã¨ã„ã†ã‚µãƒ¼ãƒ“ã‚¹ãŒãƒªãƒªãƒ¼ã‚¹ã•ã‚Œã¾ã—ãŸã€‚å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿å‡¦ç†æŠ€è¡“ãŒä¸€æ°—ã«æ°‘é–“ã®æ‰‹ã«ä¸‹ã‚Šã¦ãã‚‹ã€ã¾ã•ã«é©å‘½çš„ãªã‚µãƒ¼ãƒ“ã‚¹ã ã¨æ€ã„ã¾ã™ã€‚ Amazon Elastic MapReduce Amazon ElasticMapReduce ç´¹ä»‹ãƒ“ãƒ‡ã‚ª With Hadoop, Amazon Adds A Web-Scale Data Processing Engine To Its Cloud Computer by techcrunch.com Elastic MapReduceã¯ã€Googleã®åŸºç›¤æŠ€è¡“ã®ä¸€ã¤ã§ã‚ã‚‹MapReduceã‚’æ™‚é–“å˜ä½èª²é‡‘ã§å®Ÿè¡Œã§ãã‚‹ã‚µãƒ¼ãƒ“ã‚¹ã§ã™ã€‚MapReduceã«ã¤ã„ã¦ã¯ä»¥
y-kawaz 2009/04/03
ã‚ã¨ã§èªã‚€

amazon

hadoop

mapreduce

webã‚µãƒ¼ãƒ“ã‚¹

ec2

ã‚ã¨ã§è©¦ã™
ãƒªãƒ³ã‚¯
Hadoopã§ã€ã‹ã‚“ãŸã‚“åˆ†æ•£å‡¦ç† (Yahoo! JAPAN Tech Blog)
ãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã¯ã€2023å¹´10æœˆ1æ—¥ã«LINEãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã«ãªã‚Šã¾ã—ãŸã€‚LINEãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã®æ–°ã—ã„ãƒ–ãƒã‚°ã¯ã“ã¡ã‚‰ã§ã™ã€‚LINEãƒ¤ãƒ•ãƒ¼ Tech Blog ã“ã‚“ã«ã¡ã¯ã€åœ°åŸŸã‚µãƒ¼ãƒ“ã‚¹äº‹æ¥éƒ¨ã®å‰ç”°ä¸€æ˜Ÿã§ã™ã€‚ ä»Šå›žã¯ã€Hadoopã«ã¤ã„ã¦ã€Yahoo! JAPANã§ã®å®Ÿéš›ã®ä½¿ç”¨ä¾‹ã‚’äº¤ãˆãªãŒã‚‰æ›¸ããŸã„ã¨æ€ã„ã¾ã™ã€‚Hadoopã¨ã¯ã€å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’æ‰‹è»½ã«è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã—ã¦å‡¦ç†ã§ãã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã§ã™ã€‚ è¤‡æ•°ã®ãƒžã‚·ãƒ³ã¸ã®åˆ†æ•£å‡¦ç†ã¯ã€ãƒ—ãƒã‚»ã‚¹é–“é€šä¿¡ã‚„ã€éšœå®³æ™‚ã¸ã®å¯¾å¿œãªã©ã‚’è€ƒãˆãªã‘ã‚Œã°ãªã‚‰ãšã€ãƒ—ãƒã‚°ãƒ©ãƒžã«ã¨ã£ã¦æ•·å±…ãŒé«˜ã„ã‚‚ã®ã§ã™ãŒã€ Hadoopã¯ãã†ã„ã£ãŸé¢å€’ãã•ã„åˆ†æ•£å‡¦ç†ã‚’ä¸€æ‰‹ã«å¼•ãå—ã‘ã¦ãã‚Œã¾ã™ã€‚ 1å°ã§ã¯å‡¦ç†ã«ã‹ãªã‚Šæ™‚é–“ãŒã‹ã‹ã‚‹ã‚ˆã†ãªå¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚‚ã€è¤‡æ•°ãƒžã‚·ãƒ³ã«åˆ†æ•£ã•ã›ã‚‹ã“ã¨ã§ã€é©šãã¹ãã‚¹ãƒ”ãƒ¼ãƒ‰ã§å‡¦ç†ã‚’è¡Œã†ã“ã¨ãŒã§ãã¾ã™ã€‚ ä¾‹ãˆã°ã€ä»Šã¾ã§1å°ã§ã‚„ã£ã¦ã„ãŸã€ã‚ã‚‹ãƒã‚°é›†è¨ˆå‡¦ç†
y-kawaz 2009/03/04
ã‚ã¨ã§èªã‚€

è² è·åˆ†æ•£

hadoop
ãƒªãƒ³ã‚¯
1