[B! hadoop] ko-ya-maã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

ko-ya-ma id:ko-ya-ma

hadoopã«é–¢ã™ã‚‹ko-ya-maã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (15)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

åˆ†æ•£åž‹ã‚·ã‚¹ãƒ†ãƒ å¾¹åº•å…¥é–€ â€“ Part 2. | POSTD
Cassandra å…ˆã»ã©è§¦ã‚ŒãŸCassandraã¯åˆ†æ•£åž‹ã®NoSQLãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã§ã€CAPå®šç†ã®Aã¨Pï¼ˆå¯ç”¨æ€§ã¨åˆ†æ–è€æ€§ï¼‰ã®ç‰¹æ€§ã‚’åŸºæº–ã«æœ€çµ‚çš„ãªä¸€è²«æ€§ãŒç¢ºä¿ã•ã‚Œã¦ã„ã¾ã™ã€‚ãŸã ã€ã“ã®ã‚ˆã†ã«è¨€ã£ã¦ã—ã¾ã†ã¨å°‘ã—èª¤è§£ã‚’æ‹›ãã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ã€‚ã¨ã„ã†ã®ã‚‚ã€å®Ÿéš›ã®ã¨ã“ã‚Cassandraã®è¨å®šã¯éžå¸¸ã«æŸ”è»Ÿæ€§ãŒé«˜ãã€å¯ç”¨æ€§ã‚’çŠ ç‰²ã«ã—ã¦å¼·ã„ä¸€è²«æ€§ã‚’æä¾›ã™ã‚‹ã“ã¨ã‚‚ã§ãã‚‹ã‹ã‚‰ã§ã™ã€‚ã§ã™ãŒã€ãã†ã—ãŸä½¿ç”¨ã‚±ãƒ¼ã‚¹ã¯ä¸€èˆ¬çš„ã§ã¯ã‚ã‚Šã¾ã›ã‚“ã€‚ Cassandraã§ã¯ã€ ã‚³ãƒ³ã‚·ã‚¹ãƒ†ãƒ³ãƒˆãƒãƒƒã‚·ãƒ¥æ³• ã‚’ä½¿ã£ã¦ã€æ¸¡ãã†ã¨ã™ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚’ã‚¯ãƒ©ã‚¹ã‚¿ã®ã©ã®ãƒŽãƒ¼ãƒ‰ãŒç®¡ç†ã™ã‚‹ã®ã‹ã‚’æ±ºã‚ã¦ã„ã¾ã™ã€‚ãã—ã¦ãã®éš›ã¯ã€ãƒ‡ãƒ¼ã‚¿ã‚’è¤‡è£½ã™ã‚‹ãƒŽãƒ¼ãƒ‰æ•°ã‚’ç¤ºã™ ãƒ¬ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ãƒ•ã‚¡ã‚¯ã‚¿ ã‚’è¨å®šã—ã¾ã™ã€‚ æ³¨é‡ˆï¼š ãƒ¬ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ãƒ•ã‚¡ã‚¯ã‚¿ï¼3 æŒ¿å…¥ï¼ˆã‚ãƒ¼ã€å€¤ï¼‰ Cassandraã®ãƒŽãƒ¼ãƒ‰ï¼ˆã‚³ãƒ¼ãƒ‡ã‚£ãƒãƒ¼ã‚¿ï¼‰ Cassandraã®ãƒŽãƒ¼ãƒ‰ ãƒãƒƒã‚·ãƒ¥ï¼ˆã‚ãƒ¼ï¼‰ï¼2 ãƒŽãƒ¼ãƒ‰#2
ko-ya-ma 2018/07/31
distributed

dev

basic

cassandra

mongodb

hadoop
ãƒªãƒ³ã‚¯
Impala ãƒ‡ãƒ¼ã‚¿ã‚µã‚¤ã‚¨ãƒ³ãƒ†ã‚£ã‚¹ãƒˆã®ãŸã‚ã® é«˜é€Ÿå¤§è¦æ¨¡åˆ†æ•£åŸºç›¤ #tokyowebmining
Tokyo Webmining #25 ã§ç™ºè¡¨ã—ãŸã¨ãã®è³‡æ–™ã§ã™ã€‚ãƒ¡ã‚¤ãƒ³ã¯ãƒ‡ãƒ¢ã®æ–¹ã§ã™Read less
ko-ya-ma 2013/06/05
impala

hadoop

db

presentation

hive

dev
ãƒªãƒ³ã‚¯
Overview - Cloudera Support
ko-ya-ma 2013/01/21
Hadoop ã®ãƒãƒ¼ãƒãƒ£ãƒ«ãƒžã‚·ãƒ³ã‚¤ãƒ¡ãƒ¼ã‚¸ã€‚æ§˜ã€…ãªãƒãƒ¼ãƒãƒ£ãƒ«ãƒžã‚·ãƒ³ã«å¯¾å¿œã€‚ãŸã ã—ã€64bit VMã«é™ã‚‹

hadoop

vm

download

dev
ãƒªãƒ³ã‚¯
ã‚¢ã‚¯ã‚»ã‚¹è§£æžã‚·ã‚¹ãƒ†ãƒ ã®è£å´ ï¼ˆå…¬é–‹ç”¨ï¼‰
2. ç›®æ¬¡ 1. è‡ªå·±ç´¹ä»‹ 2. ãƒ¦ãƒ¼ã‚¶ãƒ¼ãƒãƒ¼ã‚«ãƒ«ã¨ã‚¢ã‚¯ã‚»ã‚¹è§£æž 3. ã‚¢ã‚¯ã‚»ã‚¹è§£æžã®åŸºç¤Ž 4. ã‚¢ã‚¯ã‚»ã‚¹è§£æžã‚·ã‚¹ãƒ†ãƒ ã®è£å´ - ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ é›†è¨ˆ - å°ãƒãƒƒãƒé›†è¨ˆ - å¤§è¦æ¨¡ãƒãƒƒãƒé›†è¨ˆ ã‚¹ãƒ©ã‚¤ãƒ‰49æžš 2 12å¹´9æœˆ23æ—¥æ—¥æ›œæ—¥ 3. è‡ªå·±ç´¹ä»‹ â€¢ ä¸‰ä¸Šä¿Šè¼” â€¢ æ ªå¼ä¼šç¤¾ãƒ¦ãƒ¼ã‚¶ãƒ¼ãƒãƒ¼ã‚«ãƒ« â€¢ ä»Šå¹´ï¼“æœˆã«ç‘æ³¢å¤§å¦é™¢ã‚’å’æ¥ â€¢ å¤§å¦ã§ã¯åˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã®ç ”ç©¶ â€¢ å¦ç”Ÿã®æ™‚ã¯Cookpadã®ãƒ‡ãƒ¼ã‚¿ãƒžã‚¤ãƒ‹ãƒ³ ã‚°éƒ¨é–€ã§2ãƒ¶æœˆã»ã©ã‚¤ãƒ³ã‚¿ãƒ¼ãƒ³ 3 12å¹´9æœˆ23æ—¥æ—¥æ›œæ—¥ 4. éŽåŽ»ã®ç ”ç©¶ã€ç™ºè¡¨ â€¢ ç ”ç©¶ãƒ–ãƒã‚°ï¼šhttp://shun0102.net/ â€¢ ç™ºè¡¨ï¼šã€Œåˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ Gfarm ä¸Šã§ã®Hadoop MapReduceã€ãªã© - http://www.slideshare.net/shun0102/ 4 12å¹´9æœˆ23æ—¥æ—¥æ›œæ—¥
ko-ya-ma 2012/09/24
å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’ã„ã‹ã«ã•ã°ãã‹

log

server

dev

hadoop

mongodb

fluentd
ãƒªãƒ³ã‚¯
Hadoopã‚’Windowsä¸Šã®ä»®æƒ³ãƒžã‚·ãƒ³ã§æ‰‹è»½ã«è©¦ã™æ–¹æ³•
Hadoopã¨ã„ãˆã°å¤§è¦æ¨¡åˆ†æ•£ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã§ã‚ã‚Šã€å®Ÿè¡Œã«ã¯ãã‚Œãªã‚Šã®ã‚µãƒ¼ãƒç¾¤ã‚’æƒãˆãªã‘ã‚Œã°ãªã‚‰ãªã„ã€ã¨æ€ã‚ã‚ŒãŒã¡ã€‚ ã—ã‹ã—Hadoopã§ã‚‚ã£ã¨ã‚‚æœ‰åãªãƒ‡ã‚£ã‚¹ãƒˆãƒªãƒ“ãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã‚’æä¾›ã™ã‚‹Clouderaã¯ã€PCä¸Šã®ä»®æƒ³ãƒžã‚·ãƒ³ã§æ‰‹è»½ã«Hadoopã‚’å®Ÿè¡Œã§ãã‚‹ä»®æƒ³ãƒžã‚·ãƒ³ã‚¤ãƒ¡ãƒ¼ã‚¸ã€ŒCloudera's Hadoop Demo VM for CDH4ã€ã‚’ç„¡å„Ÿå…¬é–‹ã—ã¦ã„ã¾ã™ã€‚ VMware Playerã€KVMã€VirtualBoxãªã©å¹…åºƒã„ä»®æƒ³ãƒžã‚·ãƒ³ã«å¯¾å¿œã€‚å€‹äººã®PCã‚’ä½¿ã£ã¦ã€ä¾‹ãˆã°Windowsã®ä¸Šã§ã‚‚ç°¡å˜ã«Hadoopã‚’è©¦ã™ã“ã¨ãŒã§ãã¾ã™ã€‚ ä»®æƒ³ãƒžã‚·ãƒ³ã‚’ä½¿ã£ãŸHadoopã®å®Ÿè¡Œæ‰‹é †ã‚’è©³ã—ãè§£èª¬
ko-ya-ma 2012/08/31
hadoop

vm

dev
ãƒªãƒ³ã‚¯
Hadoopã«ã‚ˆã‚‹ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã®ç²¾åº¦ã‚’ä¸Šã’ã‚‹2ã¤ã®ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ
Hadoopã«ã‚ˆã‚‹ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã®ç²¾åº¦ã‚’ä¸Šã’ã‚‹2ã¤ã®ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ï¼šãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã§å§‹ã‚ã‚‹å®Ÿè·µHadoopæ´»ç”¨ï¼ˆæœ€çµ‚å›žï¼‰ï¼ˆ1/3 ãƒšãƒ¼ã‚¸ï¼‰ Hadoopã¨ã¯ä½•ã‹ã‚’è§£èª¬ã—ã€å®Ÿéš›ã«Hadoopã‚’ä½¿ã£ã¦å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’å¯¾è±¡ã«ã—ãŸãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã‚’è¡Œã„ã¾ã™ã€‚ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã‚’è¡Œã†ã‚µãƒ³ãƒ—ãƒ«ãƒ—ãƒã‚°ãƒ©ãƒ ã®ä½œæˆã‚’é€šã˜ã¦ã€Hadoopã®ä½¿ã„æ–¹ã‚„ã€ã©ã®ã‚ˆã†ã«æ´»ç”¨ã§ãã‚‹ã®ã‹ã‚’è§£èª¬ã—ã¾ã™ Passive-Aggressiveã¨ãƒã‚¸ã‚¹ãƒ†ã‚£ãƒƒã‚¯å›žå¸°ã§ç²¾åº¦å‘ä¸Š å‰å›žã®ã€Œå®Ÿè·µï¼ ã€ŒMapReduceã§ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã€å¾¹åº•è§£èª¬ã€ã§ã¯ã€ã€Œé’ç©ºæ–‡åº«ã€ã®ä½œå“ã‹ã‚‰å¦ç¿’ã‚’è¡Œã„ã€ãƒ†ã‚ã‚¹ãƒˆãƒ‡ãƒ¼ã‚¿ã‹ã‚‰è‘—è€…ã®å¯¿å‘½ã‚’æŽ¨å®šã™ã‚‹MapReduceãƒ—ãƒã‚°ãƒ©ãƒ ã‚’ä½œæˆã—ã¾ã—ãŸã€‚ ä»Šå›žã¯ã€å‰å›žã®ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’å°‘ã—å¤‰æ›´ã™ã‚‹ã ã‘ã§ã€ç²¾åº¦ãŒä¸ŠãŒã‚‹ã€ŒPassive-Aggressiveã€ã¨ã„ã†ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã‚’å®Ÿè£…ã—ã¾ã™ã€‚ã¾ãŸã€ãƒ†ã‚ã‚¹ãƒˆåˆ†é¡žã®ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã¨
ko-ya-ma 2012/08/20
hadoop

analysis

dev

math

mapreduce

algorithm
ãƒªãƒ³ã‚¯
å®Ÿè·µï¼ ã€ŒMapReduceã§ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã€å¾¹åº•è§£èª¬
ã€Œé’ç©ºæ–‡åº«ã€ã‚’ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ï¼ å‰å›žã®ã€Œã„ã¾ã•ã‚‰èžã‘ãªã„Hadoopã¨ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°å…¥é–€ã€ã§ã¯ã€Hadoopã¨ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã®æ¦‚è¦ã‚„æ§‹æˆã€MapReduceã®ä»•çµ„ã¿ã€Hadoopã®æ´»ç”¨å ´é¢ãªã©ã‚’è§£èª¬ã—ã€Hadoopã®å®Ÿè¡Œç’°å¢ƒã‚’æ§‹ç¯‰ã—ã¾ã—ãŸã€‚ä»Šå›žã‹ã‚‰ã€Hadoopã‚’ä½¿ã„ã€ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã®MapReduceãƒ—ãƒã‚°ãƒ©ãƒ ã‚’ä½œæˆã—ã¦ã„ãã¾ã™ã€‚ ã€Œé’ç©ºæ–‡åº«ã€ã¨ã„ã†ã‚µã‚¤ãƒˆã‚’ã”å˜ã˜ã§ã—ã‚‡ã†ã‹ã€‚é’ç©ºæ–‡åº«ã¯ã€è‘—ä½œæ¨©ãŒåˆ‡ã‚ŒãŸæ—¥æœ¬ã®æ–‡å¦ä½œå“ã‚’æŽ²è¼‰ã—ã¦ã„ã‚‹Webã‚µã‚¤ãƒˆã§ã€é’ç©ºæ–‡åº«ã®å…¨ãƒ‡ãƒ¼ã‚¿ã‚’DVDã‚„ã€BitTorrentã«ã‚ˆã‚‹é…ä¿¡ã§å…¥æ‰‹ã§ãã¾ã™ã€‚ä»Šå›žã¯ã€ã“ã®ãƒ‡ãƒ¼ã‚¿ã‚’ä½¿ã£ã¦ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã‚’è¡Œã„ã¾ã—ã‚‡ã†ã€‚ å‰å›žã€ãƒ†ã‚ã‚¹ãƒˆåˆ†é¡žã§ã€è‘—è€…ã®æ€§åˆ¥ã€å¹´é½¢ã€åœ°åŸŸã€è·æ¥ãªã©ã®å±žæ€§ã‚‚æŽ¨å®šã§ãã‚‹ã¨æ›¸ãã¾ã—ãŸãŒã€é’ç©ºæ–‡åº«ã¯ã€ä»–ã®ãƒ‡ãƒ¼ã‚¿ã«ã¯ãªã„ã€è‘—è€…å±žæ€§ãŒã‚ã‚Šã¾ã™ã€‚é’ç©ºæ–‡åº«ã®ä½œå“ã¯ã€è‘—ä½œæ¨©ãŒåˆ‡ã‚Œã¦ã€ä½œè€…ãŒãªããªã£ã¦ã„ã‚‹å ´
ko-ya-ma 2012/08/20
æ•°å¦çš„ãªç†å±ˆã®èª¬æ˜Žã¨ãã‚Œã‚’ã©ã†MapReduceã«è½ã¨ã—ã“ã‚€ã‹ã®è§£èª¬ã€‚

mapreduce

hadoop

math

analysis

sample
ãƒªãƒ³ã‚¯
ã„ã¾ã•ã‚‰èžã‘ãªã„Hadoopã¨ãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°å…¥é–€
ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿æ™‚ä»£ã®æ•‘ä¸–ä¸»ã€ŒHadoopã€ã¨ã¯ ã€ŒApache Hadoopã€ã¯ä»Šã€æœ€ã‚‚æ³¨ç›®ã‚’é›†ã‚ã¦ã„ã‚‹æŠ€è¡“ã®1ã¤ã§ã™ã€‚Hadoopã¨ã¯ã€å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’æ‰‹è»½ã«è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã—ã¦å‡¦ç†ã§ãã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã§ã™ã€‚ Hadoopã‚’æ´»ç”¨ã—ã¦ã„ã‚‹ä¼æ¥ã¯å¹´ã€…å¢—ãˆç¶šã‘ã¦ã„ã¦ã€ä¸å¯æ¬ ãªæŠ€è¡“ã«ãªã‚Šã¤ã¤ã‚ã‚‹ã¨ã„ãˆã‚‹ã§ã—ã‚‡ã†ã€‚ æœ¬é€£è¼‰ã§ã¯ã€Hadoopã¨ã¯ä½•ã‹ã€HadoopãŒã©ã†æ´»ç”¨ã§ãã‚‹ã®ã‹ã¨ã„ã†ã“ã¨ã‚’ã€ã€Œãƒ†ã‚ã‚¹ãƒˆãƒžã‚¤ãƒ‹ãƒ³ã‚°ã€ã«ç„¦ç‚¹ã‚’å½“ã¦ã¦è§£èª¬ã—ã¦ã„ããŸã„ã¨æ€ã„ã¾ã™ã€‚ é‡ã„å‡¦ç†ã‚’è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã•ã›ã‚‹ è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«å‡¦ç†ã‚’åˆ†æ•£ã•ã›ã‚‹ã«ã¯ã€ãƒ—ãƒã‚»ã‚¹åŒå£«ã®é€šä¿¡ã€ç›£è¦–ã€éšœå®³æ™‚ã®å¯¾å¿œãªã©ã‚’è€ƒãˆãªã‘ã‚Œã°ãªã‚‰ãšã€ãƒ—ãƒã‚°ãƒ©ãƒžã«ã¨ã£ã¦ãƒãƒ¼ãƒ‰ãƒ«ãŒé«˜ã„ã‚‚ã®ã§ã™ã€‚ã—ã‹ã—ã€Hadoopã¯ãã†ã„ã£ãŸé¢å€’ãã•ã„å‡¦ç†ã‚’ä¸€æ‰‹ã«å¼•ãå—ã‘ã¦ãã‚Œã€ãƒ—ãƒã‚°ãƒ©ãƒžã¯ã€ã‚„ã‚ŠãŸã„å‡¦ç†ã ã‘ã«é›†ä¸ã§ãã¾ã™ã€‚ ä¾‹ãˆã°ã€Hadoopã‚’ä½¿ã†ã¨ã€1
ko-ya-ma 2012/08/20
Hadoop åŸºç¤Žã®åŸºç¤Žã€‚

hadoop

server

dev

basic

tutorial
ãƒªãƒ³ã‚¯
ãƒªã‚¯ãƒ«ãƒ¼ãƒˆå¼Hadoopã®ä½¿ã„æ–¹
ãƒªã‚¯ãƒ«ãƒ¼ãƒˆå¼Hadoopã®ä½¿ã„æ–¹ - Presentation Transcript ãƒªã‚¯ãƒ«ãƒ¼ãƒˆå¼Hadoopã®ä½¿ã„æ–¹ æ ªå¼ä¼šç¤¾ãƒªã‚¯ãƒ«ãƒ¼ãƒˆMIT ã‚·ã‚¹ãƒ†ãƒ åŸºç›¤æŽ¨é€²å®¤ã‚¤ãƒ³ãƒ•ãƒ©ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã‚°ãƒ«ãƒ¼ãƒ—çŸ³å· ä¿¡è¡Œ ã¯ã˜ã‚ã«ãƒ»ãƒ»ãƒ» â–¡åå‰ çŸ³å·ã€€ä¿¡è¡Œ ï¼ˆã€€ã€€ã€€ground_beetleï¼‰ â–¡å‡ºèº« ç¦å³¶çœŒã€€ã„ã‚ãå¸‚ â–¡çµŒæ´ ãƒ»2009å¹´ãƒªã‚¯ãƒ«ãƒ¼ãƒˆæ–°å’å…¥ç¤¾ ãƒ»å–¶æ¥æ”¯æ´ã‚·ã‚¹ãƒ†ãƒ ã®ã‚³ãƒ¼ãƒ€ãƒ¼ï¼ˆjavaï¼‰ã€DBAã¨ã—ã¦å‚åŠ ã€‚ ãƒ»Javascriptã®Libã§ã‚ã‚‹Senchaã‚’ç”¨ã„ãŸã‚¹ãƒžãƒ›ã‚µã‚¤ãƒˆé–‹ç™º ãƒ»ç¾HadoopæŽ¨é€²æ‹…å½“ â–¡è¶£å‘³ ãƒ»å¤–å›½ç”£ã‚«ãƒ–ãƒˆè™«é£¼è‚² ãƒ»ã‚¹ã‚ãƒ¥ãƒ¼ãƒãƒ€ã‚¤ãƒ“ãƒ³ã‚° ãƒ»æµ·æ°´éšé£¼è‚² ãƒªã‚¯ãƒ«ãƒ¼ãƒˆã®çµ„ç¹”ä½“åˆ¶ã«ã¤ã„ã¦ æ—…è¡ŒC å–¶æ¥ ä¼ç”» è‡ªå‹•è»ŠC å–¶æ¥ ä¼ç”» ä½å®…C å–¶æ¥ ä¼ç”» MITã€€United äº‹æ¥æ‹…å½“MITã€€ äº‹æ¥æ‹…å½“MITã€€ äº‹æ¥æ‹…å½“MITã€€ ãƒ»ãƒžãƒ¼ã‚±ãƒ†ã‚£ãƒ³ã‚°ãƒ»åˆ†æžãƒãƒ¼ãƒ ã€€ ãƒ»ã‚¤ãƒ³ãƒ•ãƒ©åŸºç›¤ãƒãƒ¼ãƒ ã€€ã€€
ko-ya-ma 2012/08/20
ãƒ‡ãƒ¼ã‚¿è§£æžãŒé«˜é€ŸåŒ–ã™ã‚‹ã“ã¨ã«ã‚ˆã‚Šã€Tryï¼†Errorã®ã‚µã‚¤ã‚¯ãƒ«ã‚’é«˜é€Ÿã§å›žã›ã‚‹ã‚ˆã†ã«ãªã‚‹ã€ã¨ã„ã†ã®ã¯ãƒŠãƒ«ãƒ›ãƒ‰ã€‚

hadoop

presentation

analysis

dev
ãƒªãƒ³ã‚¯
æ—¥ã€…é€²åŒ–ã™ã‚‹Hadoopã® ã€Œã„ã¾ã€
1. ç¬¬2å›ž NHNãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ ï¼ˆ2012å¹´8æœˆ18æ—¥ï¼‰ æ—¥ã€…é€²åŒ–ã™ã‚‹Hadoopã® ã€Œã„ã¾ã€ æ ªå¼ä¼šç¤¾NTTãƒ‡ãƒ¼ã‚¿ ï¼ æ—¥æœ¬Hadoopãƒ¦ãƒ¼ã‚¶ãƒ¼ä¼š æ¿±é‡Ž è³¢ä¸€æœ— Copyright Â© 2012 NTT DATA Corporation 2. è‡ªå·±ç´¹ä»‹ ï® æ¿±é‡Ž è³¢ä¸€æœ— ï¼ˆã¯ã¾ã® ã‘ã‚“ã„ã¡ã‚ã†ï¼‰ @hamaken ï¬ æ ªå¼ä¼šç¤¾NTTãƒ‡ãƒ¼ã‚¿ åŸºç›¤ã‚·ã‚¹ãƒ†ãƒ äº‹æ¥æœ¬éƒ¨ ã‚·ãƒ‹ã‚¢ã‚¨ã‚ã‚¹ãƒ‘ãƒ¼ãƒˆ â€¢ ã€ŽBizXaaS Hadoopæ§‹ç¯‰ãƒ»é‹ç”¨ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã€ ã€ŽCDH Hadoopã‚µãƒãƒ¼ãƒˆã‚µãƒ¼ãƒ“ã‚¹ã€ ã®ä¸ã®äºº ï¬ æ—¥æœ¬Hadoopãƒ¦ãƒ¼ã‚¶ãƒ¼ä¼š ï¬ ç¿”æ³³ç¤¾ ã€ŽHadoopå¾¹åº•å…¥é–€ã€ ç›£ä¿®è€… ï¬ è©±é¡Œã«ãªã£ãŸçµŒç”£çœã®Hadoopå ±å‘Šæ›¸ã®PM â€¢ çµŒæ¸ˆç”£æ¥çœ ã€Žåˆ†æ•£åˆ¶å¾¡å‡¦ç†æŠ€è¡“ç‰ã«ä¿‚ã‚‹ ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼é«˜ä¿¡é ¼åŒ–ã«å‘ã‘ãŸå®Ÿè¨¼äº‹æ¥ã€ â€¢ http://www.meti.go.jp/policy/mono
ko-ya-ma 2012/08/20
hadoop

dev

presentation

basic
ãƒªãƒ³ã‚¯
Amazon Elastic MapReduceã§PHPã‚‚ä½¿ãˆã‚‹ã‹è©¦ã—ã¦ã¿ãŸ - Stellaqua - ï¼´ï¼¯ï¼ã®æŠ€è¡“æ—¥è¨˜
AmazonãŒEC2ä¸Šã§Hadoopã«ã‚ˆã‚‹MapReduceã‚’å®Ÿè¡Œã§ãã‚‹ã‚µãƒ¼ãƒ“ã‚¹ã‚’å‡ºã—ã¦ããŸã‚ˆã†ã§ã™ãã€‚ â†’Amazon EMR - Amazon Web Services â†’http://kzk9.net/blog/2009/04/reviewing_amazon_elastic_map_reduce.html å‰å›žã®è¨˜äº‹ã§ã¯ã€EC2ä¸Šã§Hadoopç”¨ã®ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ã‚’è‡ªåˆ†ã§å‹•ä½œã•ã›ã¦ã€ãƒ•ã‚¡ã‚¤ãƒ«ã®è»¢é€ã‚‚äº‹å‰ã«ã‚„ã£ã¦â€¦ã¨è‰²ã€…ä¸‹æº–å‚™ãŒå¿…è¦ã ã£ãŸã‚“ã§ã™ãŒã€ã“ã®ã‚µãƒ¼ãƒ“ã‚¹ã‚’ä½¿ãˆã°ãƒãƒ¼ã‚«ãƒ«ã®ç’°å¢ƒã‹ã‚‰ã„ããªã‚Šã‚³ãƒžãƒ³ãƒ‰ä¸€ç™ºã§MapReduceã‚’å®Ÿè¡Œã™ã‚‹äº‹ãŒã§ãã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã—ãŸã€‚ ãã‚“ãªã®ã‚’èžã„ãŸã‚‰ã‚„ã£ã¦ã¿ãŸããªã‚‹ã‚ˆãã€ã¨ã„ã†äº‹ã§ã€PHPã®Mapper/ReducerãŒä½¿ãˆã‚‹ã‹è©¦ã—ã¦ã¿ãŸã‹ã£ãŸã®ã§ã€æ—©é€Ÿä½¿ã£ã¦ã¿ã‚‹äº‹ã«ã—ã¾ã—ãŸã€‚ å¤šæ®µéšŽã®MapReduceã¯é¢å€’ãªã®ã§ã€ä»Šå›žã¯ä»¥å‰ã®è¨˜äº‹ã§ä½¿ã£ãŸå˜èªžã‚«ã‚¦ãƒ³ãƒˆã®
ko-ya-ma 2012/08/20
amazon

hadoop

server

php

dev
ãƒªãƒ³ã‚¯
Amazon EMRï¼ˆHadoopãªã©ã®ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã‚’ç°¡å˜ã«å®Ÿè¡Œï¼‰| AWS
Amazon EMR Apache Sparkã€Hiveã€Prestoã€ãã®ä»–ã®ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ãƒ¯ãƒ¼ã‚¯ãƒãƒ¼ãƒ‰ã‚’ç°¡å˜ã«å®Ÿè¡Œã—ã¦ã‚¹ã‚±ãƒ¼ãƒ«ã™ã‚‹
ko-ya-ma 2012/08/20
æ‰‹è»½ã«MapReduce !

amazon

server

hadoop
ãƒªãƒ³ã‚¯
MapReduceã§ãã‚‹10å€‹ã®ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ - ãƒ‡ãƒ¼ã‚¿ã‚µã‚¤ã‚¨ãƒ³ãƒ†ã‚£ã‚¹ãƒˆä¸ŠãŒã‚Šã®DXå‚è¬€ãƒ»èµ·æ¥å®¶
Hadoopã¨Mahoutã«ã‚ˆã‚Šã€ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã§ã‚‚æ©Ÿæ¢°å¦ç¿’ã‚’è¡Œã†ã“ã¨ãŒã§ãã¾ã™ã€‚Mahoutã§å®Ÿè£…ã•ã‚Œã¦ã„ã‚‹æ‰‹æ³•ã¯ã€å…¨ã¦åˆ†æ•£å‡¦ç†ã§ãã‚‹ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã¨ã„ã†ã“ã¨ã«ãªã‚Šã¾ã™ã€‚Mahoutã§å®Ÿè£…ã•ã‚Œã¦ã„ã‚‹ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã¯ã€ã“ã“ã«åˆ—æŒ™ã•ã‚Œã¦ã„ã¾ã™ã€‚è«–æ–‡ã¨ã—ã¦ã‚‚ã€2006å¹´ã«ã€ŒMap-Reduce for Machine Learning on Multicoreã€ã¨ã—ã¦ã„ãã¤ã‹ã®ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ãŒç´¹ä»‹ã•ã‚Œã¦ã„ã¾ã™ã€‚ ãã“ã§ä»Šå›žã¯ã€ï¼ˆä½•ç•ªç…Žã˜ã‹åˆ†ã‹ã‚Šã¾ã›ã‚“ãŒè‡ªåˆ†ã®ç†è§£ã®ãŸã‚ã«ã‚‚ï¼‰ã“ã®è«–æ–‡ã§ç´¹ä»‹ã•ã‚Œã¦ã„ã‚‹ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã¨ã€ã©ã†ã‚„ã£ã¦åˆ†æ•£å‡¦ç†ã™ã‚‹ã®ã‹ã‚’ç°¡å˜ã«ãƒ¡ãƒ¢ã—ã¦ãŠããŸã„ã¨æ€ã„ã¾ã™ã€‚è¨ˆç®—ã™ã‚‹ã¹ãçµ±è¨ˆé‡ãŒã€summation formï¼ˆè¶³ã—ç®—ã§è¡¨ç¾ã§ãã‚‹å½¢ï¼‰ã«ãªã£ã¦ã„ã‚‹ã‹ã©ã†ã‹ãŒã€é‡è¦ãªãƒã‚¤ãƒ³ãƒˆã§ã™ã€‚ãªã£ã¦ãªã„å ´åˆã¯ã€â€ã†ã¾ãâ€MapReduceã®å½¢ã«ãƒãƒ©ã™å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚ â€»ä¾‹ã«ã‚ˆã£ã¦ã€é–“é•ã„ãŒã‚ã£ãŸå ´åˆã¯éšæ™‚
ko-ya-ma 2012/05/28
ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã§ã‚‚æ©Ÿæ¢°å¦ç¿’ã‚’ã—ã‚ˆã†ï¼

hadoop

algorithm

mapreduce

math

mahout
ãƒªãƒ³ã‚¯
Hadoopã®ç•°ç«¯ã•ãŒé¢ç™½ã„ - wyukawa's diary
Hadoopã¯ã»ã‚“ã¨ãƒ–ãƒ¼ãƒ ã§ã™ã€‚ãƒãƒ–ãƒ«ã ã¨è¨€ã£ã¦ã„ã„æ°—ãŒã—ã¾ã™ã€‚å„ç¨®ã‚»ãƒŸãƒŠãƒ¼ã¯ã™ãã«åŸ‹ã¾ã‚Šã¾ã™ã—ã€å®Ÿéš›ã«èžãã«è¡Œãã¨ä¼šå ´ã¯æº€å“¡ã§ã™ã€‚ ã“ã®åˆ†é‡Žã¯æ—¥æœ¬ã ã¨NTTãƒ‡ãƒ¼ã‚¿ãŒå…ˆé ã‚’ãã£ãŸã‚ˆã†ã«è¦‹ãˆã¾ã™ã€‚ NTTãƒ‡ãƒ¼ã‚¿ã€Hadoopã®å•†ç”¨ãƒ‡ã‚£ã‚¹ãƒˆãƒªãƒ“ãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã€ŒCDH3ã€ã‚’è²©å£²é–‹å§‹ | æ—¥çµŒ xTECHï¼ˆã‚¯ãƒã‚¹ãƒ†ãƒƒã‚¯ï¼‰ ã¾ãŸHadoopå°‚æ¥ä¼šç¤¾ã€ŒãƒŽãƒ¼ãƒãƒ©ã‚¹ãƒ»ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã€ã¨ã„ã†ã®ã‚‚ã§ãã¾ã—ãŸã€‚ ã‚¦ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã‚ºã¨ã‚¤ãƒ¼ã‚·ãƒ¼ãƒ»ãƒ¯ãƒ³ãŒçµŒå–¶çµ±åˆã€Hadoopå°‚æ¥ä¼šç¤¾ã‚’ç«‹ã¡ä¸Šã’ | æ—¥çµŒ xTECHï¼ˆã‚¯ãƒã‚¹ãƒ†ãƒƒã‚¯ï¼‰ ã—ã‹ã—æœ€è¿‘ã§ã¯å¯Œå£«é€šã‚„IBMã‚‚Hadoopã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã‚’å±•é–‹ã—ã¦ãŠã‚Šãƒ¬ãƒƒãƒ‰ã‚ªãƒ¼ã‚·ãƒ£ãƒ³ãªæ„Ÿã˜ã§ã™ã€‚ å¯Œå£«é€šãŒãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿åˆ†æžãƒ»æ´»ç”¨å‘ã‘ã®PaaSã‚µãƒ¼ãƒ“ã‚¹ | æ—¥çµŒ xTECHï¼ˆã‚¯ãƒã‚¹ãƒ†ãƒƒã‚¯ï¼‰ æ—¥æœ¬IBMã€è¡¨è¨ˆç®—ã®ã‚ˆã†ã«åˆ†æžã§ãã‚‹Hadoopã‚½ãƒ•ãƒˆæ–°ç‰ˆã€ŒBigInsightsã€ | æ—¥çµŒ xTECHï¼ˆ
ko-ya-ma 2011/09/05
Hadoop

dev
ãƒªãƒ³ã‚¯
Twitterã‚„Facebookã§ä½¿ã‚ã‚Œã¦ã„ã‚‹ã€ŒApache Hadoopã€ã®ãƒ¡ãƒªãƒƒãƒˆã‚„æ´å²ã‚’ä½œè€…è‡ªã‚‰ãŒèªžã‚‹
å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã®åˆ†æ•£å‡¦ç†ã‚’æ”¯ãˆã‚‹Javaã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã§ã‚ã‚Šã€ãƒ•ãƒªãƒ¼ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã¨ã—ã¦é…å¸ƒã•ã‚Œã¦ã„ã‚‹ã€ŒApache Hadoopã€ã€‚ãã®ä½œè€…ãƒ€ã‚°ãƒ»ã‚«ãƒ†ã‚£ãƒ³ã‚°ï¼ˆDoug Cuttingï¼‰ã•ã‚“ãŒã€ŒCloud Computing World Tokyo 2011ã€ï¼†ã€ŒNext Generation Data Center 2011ã€ã«ãŠã„ã¦ã€ŒApache Hadoop: A New Paradigm for Data Processingã€ã¨ã„ã†è¬›æ¼”ã‚’ã—ã¦ã„ãŸã®ã§èžãã«è¡Œã£ã¦ãã¾ã—ãŸã€‚ æº€å“¡ã®å®¢å¸ã€‚ çš†æ§˜ã‚’å‰ã«ã—ã¦è¬›æ¼”ã§ãã‚‹ã“ã¨ã‚’å¤§å¤‰å…‰æ „ã«æ€ã£ã¦ãŠã‚Šã¾ã™ã€‚ã€ŒApache Hadoopã€ã«ã¤ã„ã¦çš†æ§˜ã«ä¼ãˆã¦ã„ãã¾ã™ãŒã€ã“ã‚Œã¯ã¾ã•ã«ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã®æ–°ãŸãªã‚‹ãƒ‘ãƒ©ãƒ€ã‚¤ãƒ ã‚’æä¾›ã™ã‚‹ã‚‚ã®ã§ã¯ãªã„ã‹ã¨ç§ã¯æ€ã£ã¦ãŠã‚Šã¾ã™ã€‚ ã¾ãšã¯ç°¡å˜ã«è‡ªå·±ç´¹ä»‹ã‚’ã•ã›ã¦ã„ãŸã ãã¾ã—ã‚‡ã†ã€‚ç§ã¯25å¹´ã«æ¸¡ã£ã¦ã‚·ãƒªã‚³ãƒ³ãƒãƒ¬ãƒ¼ã§ä»•
ko-ya-ma 2011/09/03
æ¿ƒã„ã€‚éžå¸¸ã«æ¿ƒã„è¨˜äº‹ã€‚

hadoop

dev

db
ãƒªãƒ³ã‚¯
1