[B! hadoop] hiromarkã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

æ—¥æœ¬ä¼æ¥ã‹ã‚‰åˆã®Apache Hadoopã®ã‚³ãƒŸãƒƒã‚¿ï¼ˆä¸»è¦é–‹ç™ºè€…ï¼‰å°±ä»»

æ—¥æœ¬é›»ä¿¡é›»è©±æ ªå¼ä¼šç¤¾ï¼ˆæ±äº¬éƒ½åƒä»£ç”°åŒºã€ä»£è¡¨å–ç· å½¹ç¤¾é•·ï¼šéµœæµ¦ åšå¤«ã€ä»¥ä¸‹ï¼šNTTï¼‰ãŠã‚ˆã³æ ªå¼ä¼šç¤¾NTTãƒ‡ãƒ¼ã‚¿ï¼ˆæœ¬ç¤¾ï¼šæ±äº¬éƒ½æ±Ÿæ±åŒºã€ä»£è¡¨å–ç· å½¹ç¤¾é•·ï¼šå²©æœ¬ æ•ç”·ã€ä»¥ä¸‹ï¼šNTTãƒ‡ãƒ¼ã‚¿ï¼‰ã‹ã‚‰ã€å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’å¯¾è±¡ã¨ã—ãŸä¸¦åˆ—åˆ†æ•£å‡¦ç†ã‚’å®Ÿç¾ã™ã‚‹ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢Apache Hadoopï¼ˆä»¥ä¸‹ï¼šHadoopï¼‰ãŠã‚ˆã³ãã®é–¢é€£ã®ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã®ã‚³ãƒŸãƒƒã‚¿ã«ã€2014å¹´12æœˆ18æ—¥ã€å°æ²¢ å¥å²ï¼ˆNTTã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¤ãƒŽãƒ™ãƒ¼ã‚·ãƒ§ãƒ³ã‚»ãƒ³ã‚¿ï¼‰ã€é¯µå‚ æ˜Žã€å²©å´Ž æ£å‰›ï¼ˆNTTãƒ‡ãƒ¼ã‚¿ åŸºç›¤ã‚·ã‚¹ãƒ†ãƒ äº‹æ¥æœ¬éƒ¨ï¼‰ã®3åãŒå°±ä»»ã™ã‚‹ã“ã¨ã«ãªã‚Šã¾ã—ãŸã€‚ ã‚³ãƒŸãƒƒã‚¿ã¨ã¯ã€Hadoopã®é–‹ç™ºã‚„ãƒ¡ãƒ³ãƒ†ãƒŠãƒ³ã‚¹ã«ãŠã„ã¦ã€ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’æ›¸ãæ›ãˆã‚‹æ¨©é™ï¼ˆã‚³ãƒŸãƒƒãƒˆæ¨©ï¼‰ã‚’æŒã¤ä¸»è¦é–‹ç™ºè€…ã®ã“ã¨ã§ã€ç¾åœ¨ã€Hadoopã®é–‹ç™ºã«é–¢ä¸Žã—ã¦ã„ã‚‹å…¨ä¸–ç•Œã§ç´„3,000åã®ã†ã¡ã€ã‚³ãƒŸãƒƒã‚¿ã¯ã”ãä¸€éƒ¨ï¼»ç´„100åï¼ˆ2014å¹´12æœˆï¼‰ï¼½ã«é™ã‚‰ã‚Œã¦ã„ã¾ã™ã€‚Hadoopã«ãŠã„ã¦ã¯ã€

hiromark 2014/12/18

hadoop

ãƒªãƒ³ã‚¯

NECã€ç±³Clouderaã¨ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿æ´»ç”¨ã®å¤§è¦æ¨¡åˆ†æ•£å‡¦ç†åŸºç›¤åˆ†é‡Žã§å”æ¥

æ—¥æœ¬é›»æ°—(NEC)ã¯10æœˆ14æ—¥ã€ç±³Clouderaã¨ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿æ´»ç”¨ã«ãŠã‘ã‚‹å¤§è¦æ¨¡åˆ†æ•£å‡¦ç†åŸºç›¤ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã®åˆ†é‡Žã§å”æ¥ã«åˆæ„ã—ãŸã¨ç™ºè¡¨ã—ãŸã€‚ Clouderaã¯ã€å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’åŠ¹çŽ‡çš„ã«åˆ†æ•£å‡¦ç†ãƒ»ç®¡ç†ã™ã‚‹ãŸã‚ã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ãƒ»ãƒŸãƒ‰ãƒ«ã‚¦ã‚§ã‚¢ã€ŒApache Hadoopã€ã®ãƒ‡ã‚£ã‚¹ãƒˆãƒªãƒ“ãƒ¥ãƒ¼ã‚¿ã€‚ã€ŒApache Hadoopã€ã®åŠ¹çŽ‡çš„ãªå°Žå…¥ã¨å®‰å®šç¨¼å‹•ã‚’å®Ÿç¾ã™ã‚‹ãŸã‚ã€Hadoopãƒ‡ã‚£ã‚¹ãƒˆãƒªãƒ“ãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã€ŒCloudera Enterpriseã€ã‚’æä¾›ã™ã‚‹ã€‚ åŒãƒ‡ã‚£ã‚¹ãƒˆãƒªãƒ“ãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã¯ã€ã€ŒApache Hadoopã€ã®å°Žå…¥ã‚„é‹ç”¨ã‚’å®¹æ˜“ã«ã™ã‚‹ã‚»ãƒƒãƒˆãƒ¢ãƒ‡ãƒ«ã§ã€å¿…è¦ãªä¿®æ£ãƒ‘ãƒƒãƒã®é©ç”¨ã‚„ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢é–“ã®ç›¸æ€§ã«ã¤ã„ã¦å‹•ä½œæ¤œè¨¼ã—ãŸã€ŒCDH(Cloudera's Distribution including Apache Hadoop)ã€ã‚„ã€ç®¡ç†ã‚½ãƒ•ãƒˆã€ŒCloudera Managerã€ãªã©ã®ãƒ„ãƒ¼ãƒ«ç¾¤ã€ã‚µãƒãƒ¼ãƒˆã‚µãƒ¼ãƒ“

hiromark 2014/10/16

ãƒªãƒ³ã‚¯

ãƒãƒƒãƒã®æœªæ¥ã€ã©ã†ã™ã‚‹Hadoop - ã²ã—ã ã¾ã®å¤‰æ›´å±¥æ´

ã²ã—ã ã¾ï¼¨ï¼°ã®æ›´æ–°å±¥æ´ã€‚ ä¸»ã«ï¼´ï¼²ï¼°ï¼§ãƒªãƒ—ãƒ¬ã‚¤ã®å…ƒãƒã‚¿é›†ã€ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°æŠ€è¡“ãƒ¡ãƒ¢ã¨è‡ªä½œã‚½ãƒ•ãƒˆã€å¥½ããªã‚²ãƒ¼ãƒ ã‚„éŸ³æ¥½ã§ã™ã€‚ ITproã®ã€ŽDBã®æœªæ¥ã€ã©ã†ã™ã‚‹Hadoopã€ã®ã‚¿ã‚¤ãƒˆãƒ«ã«é‡£ã‚‰ã‚Œã¦ã¿ãŸï½— ï¼ˆä»¥ä¸‹é•·ã€…æ›¸ã„ãŸã‘ã©ã€çµå±€è¨€ã„ãŸã„ã“ã¨ã¯ã€DBã¨Hadoopã¯é–¢ä¿‚ç„¡ã„ã£ã¦ã“ã¨ã¨ã€ã‚¿ã‚¤ãƒˆãƒ«ã«ã¤ã„ã¦ä½•ã‹å‹˜é•ã„ã—ãŸã£ã½ã„ã¨ã„ã†ã“ã¨ã ã‘ã ã£ãŸï¼¾ï¼¾ï¼›ï¼‰ åƒ•ã®æ„è¦‹ã§ã¯ã€Hadoopã¯ãƒãƒƒãƒå‡¦ç†ã‚’åˆ†æ•£ã—ã¦å®Ÿè¡Œã™ã‚‹åŸºç›¤ã§ã‚ã‚‹ã€‚ãƒ‡ãƒ¼ã‚¿ã‚’æºœã‚ã‚‹ã®ã¯å‰¯æ¬¡çš„ãªåŠ¹æžœã«éŽãŽãªã„ã€‚ï¼ˆæš´è«–ï½—ï¼‰ ã‚‚ã¡ã‚ã‚“ã€ãã‚‚ãã‚‚åˆ†æ•£å‡¦ç†ã‚’è¡Œã†å¿…è¦ãŒã‚ã‚‹ã®ã¯å‡¦ç†å¯¾è±¡ãƒ‡ãƒ¼ã‚¿ãŒå¤§é‡ã ã‹ã‚‰ãªã®ã§ã€ãƒ‡ãƒ¼ã‚¿ã®æºœã‚æ–¹ã‚‚å¿…é ˆãƒã‚¤ãƒ³ãƒˆã ã—ã€HadoopãŒåˆ†æ•£å‡¦ç†ã™ã‚‹åŽŸç†ã‚‚å¯†æŽ¥ã«çµã³ã¤ã„ã¦ã„ã‚‹ã®ã ãŒã€‚ ã‚ã‚‰ã‹ã˜ã‚æ–ã£ã¦ãŠãã¨ã€è‡ªåˆ†ã¯éžæ§‹é€ åŒ–ãƒ‡ãƒ¼ã‚¿ã¨ã‹åˆ†æžã¨ã‹æ©Ÿæ¢°å¦ç¿’ã«ã¯èˆˆå‘³ãŒç„¡ã„ã€‚ è‡ªåˆ†ãŒHadoopã«èˆˆå‘³ã‚’æŒã£ãŸã®ã¯ã€è‡ªåˆ†ãŒæ‹…å½“ã—ã¦ã„ãŸâ€œRDBã‚’å¯¾è±¡ã«ã—ãŸ

hiromark 2014/09/15

hadoop

ãƒªãƒ³ã‚¯

MapReduceã¯ã€Œã‚†ã£ãã‚Šæ»ã‚“ã§ã„ãã€ã€Hadoopé–‹ç™ºè€…ã®ã‚«ãƒƒãƒ†ã‚£ãƒ³ã‚°æ°

ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚¨ã‚¢ï¼ˆOSSï¼‰ã®åˆ†æ•£ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã‚½ãƒ•ãƒˆã€ŒHadoopã€ãŒã€å¤§ããªå¤‰è²Œã‚’é‚ã’å§‹ã‚ã¦ã„ã‚‹ã€‚ãƒãƒƒãƒå‡¦ç†ã ã‘ã§ãªãã€SQLã‚¯ã‚¨ãƒªãƒ¼ã‚’ä½¿ã£ãŸã‚¤ãƒ³ã‚¿ãƒ©ã‚¯ãƒ†ã‚£ãƒ–åˆ†æžã‚„ã‚¤ãƒ³ãƒ¡ãƒ¢ãƒªãƒ¼å‡¦ç†ã€æ©Ÿæ¢°å¦ç¿’å‡¦ç†ãªã©ã¸ã¨é©ç”¨é ˜åŸŸã‚’åºƒã’ã¦ã„ã‚‹ã‹ã‚‰ã ã€‚Hadoopã®ã‚ªãƒªã‚¸ãƒŠãƒ«é–‹ç™ºè€…ã§ã‚ã‚‹ãƒ€ã‚°ãƒ»ã‚«ãƒƒãƒ†ã‚£ãƒ³ã‚°æ°ã¯ã€ã€Œæ–°ã—ã„æ™‚ä»£ãŒå§‹ã¾ã£ãŸã€ã¨èªžã‚‹ã€‚ ç¾åœ¨ã®Hadoopã®çŠ¶æ³ã‚’ã©ã®ã‚ˆã†ã«è¦‹ã¦ã„ã‚‹ã‹ï¼Ÿ åŒã˜ã‚ˆã†ãªæ©Ÿèƒ½ã‚’å‚™ãˆãŸã‚³ãƒ³ãƒãƒ¼ãƒãƒ³ãƒˆãŒè¤‡æ•°ææ¡ˆã•ã‚Œã‚‹ãªã©é‡è¤‡ã¯ã‚ã‚‹ãŒã€æŠ€è¡“é–‹ç™ºã¯éžå¸¸ã«é«˜é€Ÿã«é€²ã‚“ã§ã„ã‚‹ã€‚ï¼ˆç±³Apacheã‚½ãƒ•ãƒˆã‚¦ã‚¨ã‚¢è²¡å›£ãŒ2013å¹´10æœˆã«æ£å¼ç‰ˆã‚’ãƒªãƒªãƒ¼ã‚¹ã—ãŸï¼‰ã‚¹ã‚±ã‚¸ãƒ¥ãƒ¼ãƒ©ãƒ¼ã®ã€ŒYARNã€ã«ã‚ˆã£ã¦ã€ï¼ˆHadoopã®ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚·ã‚¹ãƒ†ãƒ ã§ã‚ã‚‹ï¼‰ã€ŒHDFSã€ã®ä¸Šã«ã€æ§˜ã€…ãªãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚’å…±å˜ã§ãã‚‹ã‚ˆã†ã«ãªã£ãŸã“ã¨ãŒå¤§ãã„ã€‚ç§ãŒç‰¹ã«é©šã„ã¦ã„ã‚‹ã®ã¯ã€ï¼ˆDAGï¼šDirected Acyclic Graphï¼æœ‰å‘

hiromark 2014/08/05

ãƒªãƒ³ã‚¯

IBM Developer

IBM Developer is your one-stop location for getting hands-on training and learning in-demand skills on relevant techno logies such as generative AI, data science, AI, and open source.

hiromark 2014/05/21

hadoop
sql

ãƒªãƒ³ã‚¯

Hadoopã‚’ä½¿ã£ãŸãƒã‚°åˆ†æžã‚·ã‚¹ãƒ†ãƒ ã«ãŠã‘ã‚‹é–‹ç™ºã€ãƒ‡ãƒ—ãƒã‚¤ã®ãƒ•ãƒãƒ¼ã«ã¤ã„ã¦ - wyukawa's diary

Hadoopã‚’ä½¿ã£ãŸãƒã‚°åˆ†æžã‚·ã‚¹ãƒ†ãƒ ã£ã¦ã„ã†ã®ã‚’ä½•å›žã‹çµŒé¨“ã—ã¦ã¦ã€ãã†ã„ãˆã°é–‹ç™ºã€ãƒ‡ãƒ—ãƒã‚¤ã®ãƒ•ãƒãƒ¼ãŒã‚ã‚“ã¾ã‚Šã†ã¾ãå›žã›ãªã‹ã£ãŸã‚ˆãªã‚ã¨æ€ã£ãŸã®ã§ãã®ã‚ãŸã‚Šã«ã¤ã„ã¦ä»Šæ—¥ã¯æ›¸ããŸã„ã¨æ€ã„ã¾ã™ã€‚ ã¾ãšãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯å‘¨ã‚Šã®å‰æã‹ã‚‰æ›¸ãã¾ã™ã€‚ ã‚µãƒ¼ãƒãƒ¼ã«ãƒã‚°ã‚¤ãƒ³ã™ã‚‹ã«ã¯è¸ã¿å°ã‚’çµŒç”±ã—ãªã‘ã‚Œã°ãªã‚Šã¾ã›ã‚“ã€‚ ãªã®ã§ã€ã¾ã‚ä¾‹ãˆã°Hadoopã‚¯ãƒ©ã‚¹ã‚¿ã‚’æ§‹ç¯‰ã—ã¦ã¦ã€betaã¨realã®2ã¤ç’°å¢ƒãŒã‚ã£ãŸã‚‰ä»¥ä¸‹ã®ã‚ˆã†ã«ãƒã‚°ã‚¤ãƒ³ã™ã‚‹ã“ã¨ã«ãªã‚Šã¾ã™ã€‚ã¾ã‚ã‚ˆãã‚ã‚‹è©±ã§ã™ã‚ˆãã€‚ ãƒãƒ¼ã‚«ãƒ«PC -> è¸ã¿å° -> betaç’°å¢ƒ ãƒãƒ¼ã‚«ãƒ«PC -> è¸ã¿å° -> realç’°å¢ƒ ã§ã‚‚ã£ã¦ãƒãƒ¼ã‚«ãƒ«PCã¨beta,realç’°å¢ƒã¨ã®é–“ã®é€šä¿¡ã¯åˆ¶é™ã•ã‚Œã¦ã„ã¾ã™ã€‚ã“ã‚Œã‚‚ã‚ˆãã‚ã‚‹ãƒ‘ã‚¿ãƒ¼ãƒ³ã ã¨æ€ã„ã¾ã™ã€‚ beta,realç’°å¢ƒã‹ã‚‰ã‚¤ãƒ³ã‚¿ãƒ¼ãƒãƒƒãƒˆã«å‡ºã‚Œãªã„å ´åˆãªã‚“ã‹ã¯ã€ãƒãƒ¼ã‚«ãƒ«PCã‹ã‚‰ã‚¤ãƒ³ã‚¿ãƒ¼ãƒãƒƒãƒˆã«ã‚¢ã‚¯ã‚»ã‚¹ã—ã¦tar ballã¨ã‹rpmã‚’æŒã£

hiromark 2014/05/18

ãƒªãƒ³ã‚¯

Private Site

hiromark 2014/03/03

mysql
hadoop

ãƒªãƒ³ã‚¯

ãƒ‡ãƒ–ã‚µãƒŸ2014ã€Œã‚°ãƒªãƒ¼ã‚’æ”¯ãˆã‚‹ãƒ‡ãƒ¼ã‚¿åˆ†æžåŸºç›¤ã®éŽåŽ»ã¨ç¾åœ¨ã€è¬›æ¼”ãƒ¡ãƒ¢ #devsumi - å…ƒRX-7ä¹—ã‚Šã®é©å½“ãªæ—¥ã€…

ã©ã“ã‚‚ãã‚Œãªã‚Šã«è‹¦åŠ´ãƒ»å·¥å¤«ã—ã¦ã„ã‚‹ã‚ˆãªãã¨ã€èˆˆå‘³æ·±ãèžã‹ã›ã¦ã„ãŸã ãã¾ã—ãŸã€‚ ã€Œã‚°ãƒªãƒ¼ã‚’æ”¯ãˆã‚‹ãƒ‡ãƒ¼ã‚¿åˆ†æžåŸºç›¤ã®éŽåŽ»ã¨ç¾åœ¨ã€ æ©‹æœ¬ æ³°ä¸€ æ° ã‚°ãƒªãƒ¼ 10å¹´ã»ã©æ±å·¥å¤§ã§åŠ©æ‰‹ãƒ»ç‰¹ä»»å‡†æ•™æŽˆã—ãŸå¾Œã€2012å¹´ã«ã‚°ãƒªãƒ¼ã«ã‚¸ãƒ§ã‚¤ãƒ³ éŽåŽ»ã®è©±(2011å¹´) Webã‚µãƒ¼ãƒã‹ã‚‰ãƒã‚°ã‚’rsyncã§ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã¸ ãƒãƒƒãƒå‡¦ç†ã§é›†è¨ˆã—ã¦DBã¸(MySQL) ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚‚DBã‚‚ãƒãƒ¼ãƒ‰ã‚¦ã‚§ã‚¢ã¯Solaris Sun Fire X4540 ã ã‚“ã ã‚“å›°ã£ã¦ããŸ ãƒ‡ãƒ¼ã‚¿ãŒã»ã—ã„äººãŒå¢—ãˆã¦ããŸ ã‚µãƒ¼ãƒ“ã‚¹ã‚„äººãŒå¢—ãˆã¦ããŸ ãƒ‡ãƒ¼ã‚¿æä¾›ãŒæ£ç›´ã—ã‚“ã©ããªã£ã¦ããŸ ä»Šã®è©±: ã‚³ãƒ³ã‚»ãƒ—ãƒˆ Accessability ã ã‚Œã§ã‚‚è‡ªç”±ã« Scalability ã©ã‚Œã ã‘è²¯ã‚ã“ã‚“ã§ã‚‚ ã‚°ãƒªãƒ¼ã®ãƒ‡ãƒ¼ã‚¿åˆ†æžåŸºç›¤ ã‚²ãƒ¼ãƒ Treasure Data ãƒ™ãƒ¼ã‚¹ ã‚²ãƒ¼ãƒ ã¸ã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚° GREE Platform Hadoopãƒ™ãƒ¼ã‚¹ ã‚²ãƒ¼ãƒ ã‹ã‚‰APIã¸ã®ãƒã‚°

hiromark 2014/02/16

hadoop
gree

ãƒªãƒ³ã‚¯

asahi.comï¼ˆæœæ—¥æ–°èžç¤¾ï¼‰ï¼šã‚¤ãƒ³ãƒ†ãƒƒã‚¯ã€åˆ†æ•£å‡¦ç†ã‚½ãƒ•ãƒˆã€ŒHadoopã€ã§ã‚²ãƒŽãƒ ãƒ‡ãƒ¼ã‚¿ã‚’é«˜é€Ÿã«åˆ†æ•£ãƒ»ä¸¦åˆ—å‡¦ç†ã™ã‚‹ã‚·ã‚¹ãƒ†ãƒ ã‚’é–‹ç™º - e-ãƒ“ã‚¸ãƒã‚¹æƒ…å ±ï¼ˆæä¾›ï¼šï¼¢ï¼£ï¼®ï¼‰ - ãƒ‡ã‚¸ã‚¿ãƒ«

å°åˆ· ã€€ITãƒ›ãƒ¼ãƒ«ãƒ‡ã‚£ãƒ³ã‚°ã‚¹ã‚°ãƒ«ãƒ¼ãƒ—ã®ã‚¤ãƒ³ãƒ†ãƒƒã‚¯ï¼ˆé‡‘å²¡å…‹å·±ç¤¾é•·ï¼‰ã¯ã€éºä¼åè§£æžæŠ€è¡“ã‚’é–‹ç™ºã™ã‚‹ç†ç ”ã‚¸ã‚§ãƒã‚·ã‚¹ã¨å”åŠ›ã—ã€ã‚¯ãƒ©ã‚¦ãƒ‰ç’°å¢ƒã‚’ç”¨ã„ã¦ã€å€‹äººã®ã‚²ãƒŽãƒ ï¼ˆéºä¼æƒ…å ±ã‚»ãƒƒãƒˆï¼‰ã‚’æ–‡å—åˆ—ã¨ã—ã¦èªã¿å‡ºã™ã€Œãƒ’ãƒˆå…¨ã‚²ãƒŽãƒ ã‚·ãƒ¼ã‚±ãƒ³ã‚·ãƒ³ã‚°ã€ã®ãƒ‡ãƒ¼ã‚¿è§£æžã‚·ã‚¹ãƒ†ãƒ ã‚’é–‹ç™ºã—ãŸã€‚ ã€€è§£æžã‚·ã‚¹ãƒ†ãƒ ã¯ã€ãƒ•ãƒªãƒ¼ã‚¦ã‚§ã‚¢ã®åˆ†æ•£å‡¦ç†ã‚½ãƒ•ãƒˆã€ŒHadoopï¼ˆãƒãƒ‰ã‚¥ãƒ¼ãƒ—ï¼‰ã€ã‚’æ´»ç”¨ã—ã¦ã€ãƒ’ãƒˆã‚²ãƒŽãƒ ãƒ‡ãƒ¼ã‚¿ã‚’åˆ†æ•£ãƒ»ä¸¦åˆ—å‡¦ç†ã—ã€é«˜é€Ÿã«è§£æžã‚’è¡Œã†ã‚‚ã®ã€‚åˆ†æ•£ãƒ»ä¸¦åˆ—åŒ–ã®å®Ÿç¾ã«ã‚ˆã£ã¦ã€ä¸€èˆ¬çš„ãªã‚¯ãƒ©ã‚¦ãƒ‰ç’°å¢ƒã®åˆ©ç”¨ãŒå¯èƒ½ã¨ãªã‚Šã€å®‰ä¾¡ã«è§£æžã‚’è¡Œã†ã“ã¨ãŒã§ãã‚‹ã€‚ ã€€ã‚¤ãƒ³ãƒ†ãƒƒã‚¯ã¯ã“ã®ã‚·ã‚¹ãƒ†ãƒ ã‚’ã‚‚ã¨ã«ã€ãƒ’ãƒˆã‚²ãƒŽãƒ ã ã‘ã§ãªãã€å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿è§£æžã‚µãƒ¼ãƒ“ã‚¹ã®æä¾›ã‚’æ¤œè¨Žã—ã¦ã„ã‚‹ã€‚ã¾ãŸã€ç†ç ”ã‚¸ã‚§ãƒã‚·ã‚¹ã¯ã€ã€Œãƒ’ãƒˆå…¨ã‚²ãƒŽãƒ ã‚·ãƒ¼ã‚±ãƒ³ã‚·ãƒ³ã‚°ã€ã®å—è¨—ã‚µãƒ¼ãƒ“ã‚¹ã«æœ¬ã‚·ã‚¹ãƒ†ãƒ ã‚’åˆ©ç”¨ã™ã‚‹äºˆå®šã ã€‚ï¼ˆã‚¼ãƒ³ãƒ• ãƒŸã‚·ãƒ£ï¼‰ é–¢é€£è¨˜äº‹ã€ˆCNET Japanã€‰NTTãƒ‡ãƒ¼ã‚¿ãŒã€ŒHadoopã€æˆ¦ç•¥ã®æœ€æ–°å‹•å‘ã‚’

hiromark 2011/12/03

ãƒªãƒ³ã‚¯

MeCabã§æ—¥æœ¬èªžWordCount on Hadoop - è‡ªç„¶è¨€èªžå‡¦ç† on Mac

Hadoopã«ã¯WordCountã®ã‚µãƒ³ãƒ—ãƒ«ãŒã¤ã„ã¦ãã¾ã™ãŒã€è‹±èªžãƒ†ã‚ã‚¹ãƒˆç”¨ã§ã™ã€‚æ—¥æœ¬èªžã‚’å¯¾è±¡ã«ã™ã‚‹å ´åˆã€MeCabã‚’ä½¿ã£ã¦å˜èªžåˆ†å‰²ã‚’è¡Œã„ãŸã„ã¨ã“ã‚ã§ã™ã€‚ MeCabã«ã¯SWIGã®Javaãƒã‚¤ãƒ³ãƒ‡ã‚£ãƒ³ã‚°ãŒç”¨æ„ã•ã‚Œã¦ã„ã¦ã€JNIçµŒç”±ã§MeCabã®æ©Ÿèƒ½ã‚’ä½¿ãˆã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã™ã€‚ã“ã®ã¨ãã®MeCabã®ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã¯UTF-8ãŒå‰æã¨ãªã‚Šã¾ã™ã€‚ http://mecab.sourceforge.net/bindings.html ã“ã®mecab-javaã®MacPortsã‚’ç¾åœ¨ç™»éŒ²ç”³è«‹ä¸ã§ã™ã€‚ã“ã‚Œã‚’ä½¿ã†ã¨ã€/opt/local/lib/libmecab-java.dylib ã¨ /opt/local/share/java/mecab.jar ãŒã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã•ã‚Œã‚‹ã“ã¨ã«ãªã‚Šã¾ã™ã€‚ $ sudo port selfupdate $ sudo port install mecab +utf8 $ su

hiromark 2011/06/05

mecab
hadoop

ãƒªãƒ³ã‚¯

MongoDBã§ä½œã‚‹ã‚½ãƒ¼ã‚·ãƒ£ãƒ«ãƒ‡ãƒ¼ã‚¿æ–°è§£æžåŸºç›¤

Loadingâ€¦ Flash Player 9 (or above) is needed to view presentations. We have detected that you do not have it on your computer. To install it, go here.

hiromark 2011/05/17

ãƒªãƒ³ã‚¯

ç¬¬1å›žã€€â€œãƒ‡ãƒ¼ã‚¿è§£æžè«‹è² äººâ€â”€æ–°è¦é–‹ç™ºå±€ ã‚·ã‚¹ãƒ†ãƒ ã‚¯ãƒªã‚¨ã‚¤ãƒ†ã‚£ãƒ–ã‚°ãƒ«ãƒ¼ãƒ— ç¦ç”°ä¸€éƒŽ | gihyo.jp

ã“ã†ã—ãŸæ•°å¤šãã®é…åŠ›çš„ãªã‚µãƒ¼ãƒ“ã‚¹ã‚’æ”¯ãˆã‚‹ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã¯ã©ã†ã„ã£ãŸäººãŸã¡ãªã®ã§ã—ã‚‡ã†ã‹ã€‚ä»Šå›žã¯ã€ã‚µã‚¤ãƒãƒ¼ã‚¨ãƒ¼ã‚¸ã‚§ãƒ³ãƒˆ æ–°è¦é–‹ç™ºå±€ ã‚·ã‚¹ãƒ†ãƒ ã‚¯ãƒªã‚¨ã‚¤ãƒ†ã‚£ãƒ–ã‚°ãƒ«ãƒ¼ãƒ—ã®ç¦ç”°ä¸€éƒŽæ°ã«ãŠè©±ã‚’ä¼ºã„ã¾ã—ãŸã€‚ ä»Šå¾Œå¿…è¦ã«ãªã‚‹ã‚·ã‚¹ãƒ†ãƒ ã‚’è¦‹æ¥µã‚ã€è‡ªã‚‰ã®ææ¡ˆã§å®Ÿç¾ã—ã¦ã„ã â€•â€•ç¾åœ¨ã©ã®ã‚ˆã†ãªåˆ†é‡Žã‚’æ‹…å½“ã•ã‚Œã¦ã„ã‚‹ã®ã§ã—ã‚‡ã†ã‹ã€‚ ã€Œç§ãŸã¡ã®ãƒãƒ¼ãƒ ã§ã¯ã€ã€Žâ Amebaã€ã‚µãƒ¼ãƒ“ã‚¹ã®ãƒ‡ãƒ¼ã‚¿è§£æžåŸºç›¤ã®æ§‹ç¯‰ãªã©ã‚’æ‹…å½“ã—ã¦ã„ã¾ã™ã€‚ç›´æŽ¥ãƒ¦ãƒ¼ã‚¶ã®ç›®ã«è§¦ã‚Œã‚‹éƒ¨åˆ†ã§ã¯ã‚ã‚Šã¾ã›ã‚“ãŒã€ãƒ¦ãƒ¼ã‚¶èª²é‡‘ã‚’è¡Œã†ã‚µãƒ¼ãƒ“ã‚¹ï¼ˆå›³1ï¼‰ãŒå¢—ãˆã¦ã„ã‚‹ã“ã¨ã‚‚ã‚ã‚Šã€å„ã€…ã®ã‚µãƒ¼ãƒ“ã‚¹ãŒã©ã®ã‚ˆã†ãªçŠ¶æ³ã«ã‚ã‚‹ã®ã‹ãªã©ã‚’å…·ä½“çš„ãªãƒ‡ãƒ¼ã‚¿ã§æŠŠæ¡ã§ãã‚‹ã‚ˆã†ãªã—ãã¿ã‚’æ§‹ç¯‰ã—ã¦ã„ã¾ã™ã€‚ã“ã†ã„ã£ãŸãƒ‡ãƒ¼ã‚¿è§£æžåŸºç›¤ã®æ§‹ç¯‰ã¯ã€ä»Šå¾Œã®ã‚µãƒ¼ãƒ“ã‚¹é–‹ç™ºã«ãŠã„ã¦ã‚‚éžå¸¸ã«é‡è¦ãªå½¹å‰²ã‚’æ‹…ã£ã¦ã„ãã¨è€ƒãˆã¦ã„ã¾ã™ã€ â€•â€•ç‰¹å®šã®ã‚µãƒ¼ãƒ“ã‚¹ã‚’å¯¾è±¡ã¨ã—ã¦ã„ã‚‹ã®ã§ã¯ãªãã€ã€ŒAmebaã€ã®ã‚µãƒ¼ãƒ“ã‚¹å…¨ä½“ã§ä½¿ã†ãƒ‡ãƒ¼ã‚¿è§£æžåŸºç›¤ã¨ã„

hiromark 2011/05/11

hadoop

ãƒªãƒ³ã‚¯

overlasting.net

overlasting.net 2019 Copyright. All Rights Reserved. The Sponsored Listings displayed above are served automatically by a third party. Neither the service provider nor the domain owner maintain any relationship with the advertisers. In case of trademark issues please contact the domain owner directly (contact information can be found in whois). Privacy Policy

hiromark 2011/04/20

ã‚ã¨ã§è¿½ã†ã€‚

ãƒªãƒ³ã‚¯

Hadoopã®æœ¬è³ªã¯åˆ†æ•£I/Oã«ã‚ã‚Šï½žã‚¯ãƒ©ã‚¦ãƒ‰æ™‚ä»£ã®éžåŒæœŸå‡¦ç† - ãƒ—ãƒã‚°ãƒ©ãƒžã®æ€ç´¢

Hadoopå‘ã‘åŸºå¹¹ãƒãƒƒãƒåˆ†æ•£å‡¦ç†ã‚½ãƒ•ãƒˆã€ŒAsakusaã€ã®è¨˜äº‹ãŒã¨ã¦ã‚‚ç´ æ™´ã‚‰ã—ã„ã®ã§ãƒ¡ãƒ¢ã€‚ ã€å…ƒãƒã‚¿ã€‘ ç¬¬1å›žã€€åˆ†æ•£å‡¦ç†ã‚’éš è”½ã—ã€å¤§è¦æ¨¡é–‹ç™ºã‚’å¯èƒ½ã« - Hadoopå‘ã‘åŸºå¹¹ãƒãƒƒãƒåˆ†æ•£å‡¦ç†ã‚½ãƒ•ãƒˆã€ŒAsakusaã€ã®å…¨è²Œï¼šITpro ç¬¬3å›žã€€æ¥å‹™ã®å¢ƒç•Œã‚„ä¸¦åˆ—æ€§ã‚’è¦‹æ¥µã‚å‡¦ç†ã‚’åˆ†å‰² - Hadoopå‘ã‘åŸºå¹¹ãƒãƒƒãƒåˆ†æ•£å‡¦ç†ã‚½ãƒ•ãƒˆã€ŒAsakusaã€ã®å…¨è²Œï¼šITpro åŸºå¹¹ãƒãƒƒãƒå†æ§‹ç¯‰ã®ãƒ‹ãƒ¼ã‚ºã¯å¤§ãã„ã€Hadoopã®èª²é¡Œã‚’Asakusaã§è§£æ±ºã™ã‚‹ - ã‚¤ãƒ³ã‚¿ãƒ“ãƒ¥ãƒ¼ï¼šITpro Twitter / @akipii: Asakusaã®æœ¬è³ªã¯åˆ†æ•£I/Oã€‚ãƒ‡ã‚£ã‚¹ã‚¯ã®å…¥å‡ºåŠ›ãŒãƒãƒƒãƒå‡¦ç†ã®ãƒœãƒˆãƒ«ãƒãƒƒã‚¯ã€‚ã‚¯ãƒ©ã‚¦ãƒ‰æ™‚ä»£ã®éžåŒæœŸå‡¦ç†ã®è¨è¨ˆæŠ€æ³•ã¯ã€ã‚¸ãƒ§ãƒ–ãƒ•ãƒãƒ¼ã‹ã‚‰ãƒãƒƒãƒå‡¦ç†ã‚’DSLã§è‡ªå‹•ç”Ÿæˆã™ã‚‹ã“ã¨ã«ã‚ã‚Šã€‚ Cobolã‚„PLSQLã§æ›¸ã‹ã‚ŒãŸå¤è‡ã„ãƒãƒƒãƒå‡¦ç†ã¯ã€å…¨ã¦Hadoopã§ä»£ç”¨ã§ããªã„ã‚‚ã®ã‹ï¼Ÿ Cobolã®ç”Ÿç”£æ€§ã®

hiromark 2011/04/02

hadoop

ãƒªãƒ³ã‚¯

Facebookã®æ–°ã—ã„ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ è§£æžã‚·ã‚¹ãƒ†ãƒ ã¨ã¯ï¼Ÿ - nokunoã®æ—¥è¨˜

Facebookã®æ–°ã—ã„ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ è§£æžã®ã‚·ã‚¹ãƒ†ãƒ ã§ã¯ã€HBaseã§1æ—¥200å„„ä»¶ã®ã‚¤ãƒ™ãƒ³ãƒˆã‚’å‡¦ç†ã—ã¦ã„ã‚‹ãã†ã§ã™ã€‚ä»¥ä¸‹ã®è¨˜äº‹ã®ç¿»è¨³ã§ã™ã€‚High Scalability - High Scalability - Facebookâ€™s New Realtime Analytics System: HBase to Process 20 Billion Events PerÂ DayFacebookãŒã¾ãŸã‚„ã£ã¦ãã‚ŒãŸã€‚å½¼ã‚‰ã¯å·¨å¤§ãªãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãƒ‡ãƒ¼ã‚¿ã®ã‚¹ãƒˆãƒªãƒ¼ãƒ ã‚’å‡¦ç†ã™ã‚‹ã‚‚ã†1ã¤ã®ã‚·ã‚¹ãƒ†ãƒ ã‚’æ§‹ç¯‰ã—ãŸã®ã ã€‚ä»¥å‰ã«ã‚‚Facebookã¯ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãªãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚·ã‚¹ãƒ†ãƒ ã‚’HBaseã§æ§‹ç¯‰ã—ã¦ã„ã‚‹(http://highscalability.com/blog/2010/11/16/facebooks-new-real-time-messaging-system-hbase-to-store-135.ht

hiromark 2011/03/27

ãƒªãƒ³ã‚¯

ã·ã‚‰ã£ã¨ã¨PFIã€ã€ŒHadoopã€ã®ã‚¢ã‚»ã‚¹ãƒ¡ãƒ³ãƒˆã‚µãƒ¼ãƒ“ã‚¹æä¾›--æ§‹ç¯‰å¾Œã‚‚æ”¯æ´ - builder by ZDNet Japan

A Business New Era ã‚ã‚‰ã‚†ã‚‹ãƒ¢ãƒŽãƒ»ã‚³ãƒˆãŒå¤‰åŒ–ã—ã¦ã„ã‚‹ä»Š ãƒ‡ã‚¸ã‚¿ãƒ«ã§ãƒ“ã‚¸ãƒã‚¹ã¯ç”Ÿã¾ã‚Œå¤‰ã‚ã‚‹ ã‚ªãƒªã‚¸ãƒŠãƒ«ã‚³ãƒ³ãƒ†ãƒ³ãƒ„ãŒæº€è¼‰ï¼ æ„å¤–ã¨çŸ¥ã‚‰ãªã„Nutanix HCI ã®æƒ…å ±ã‚’é›†ç´„ èªã‚ã°ã‚ã‹ã‚‹ï¼ã„ã¾HCIãŒæ³¨ç›®ã•ã‚Œã‚‹ç†ç”± ãƒ“ã‚¸ãƒã‚¹ã®æŽ¨é€²ã«ã¯å¿…é ˆï¼ ZDNetÃ—ãƒžã‚¤ã‚¯ãƒã‚½ãƒ•ãƒˆãŒè´ˆã‚‹ç‰¹åˆ¥ä¼ç”» ä»Šã€å¿…è¦ãªæˆ¦ç•¥çš„ã‚»ã‚ãƒ¥ãƒªãƒ†ã‚£ã¨ã‚¬ãƒãƒŠãƒ³ã‚¹ è†¨å¤§ãªã‚¢ã‚¯ã‚»ã‚¹ã‚’æ”¯ãˆã‚‹å±‹å°éª¨ é«˜ã„å®‰å®šæ€§ã¨ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ã‚’ä¸¡ç«‹ ZOZOTOWNãŒé¸ã‚“ã ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸åŸºç›¤ã‚’è§£èª¬ é«˜ã„å¾“æ¥å“¡æº€è¶³åº¦ã¨å®‰å¿ƒãƒ»å®‰å…¨ æ–°æ™‚ä»£ã«ã‚€ã‘ãŸç†æƒ³ã®æ¥å‹™ç’°å¢ƒã“ã Anywhere WorkspaceãŒç›®æŒ‡ã™æœªæ¥ å‹ã¤ãŸã‚ã®ã‚¯ãƒ©ã‚¦ãƒ‰æ´»ç”¨è¡“ New Value on Azure ãƒ“ã‚¸ãƒã‚¹ã‚’æ¬¡ã®ã‚¹ãƒ†ãƒ¼ã‚¸ã¸ï¼ ã‚³ãƒžãƒ¼ã‚¹åºƒå‘Šã®å¤§å¤‰å‹• ãƒ—ãƒ©ã‚¤ãƒã‚·ãƒ¼ä¿è·ã¨ãƒ‘ãƒ¼ã‚½ãƒŠãƒ©ã‚¤ã‚ºã®ç‹é–“ã§ ãƒžãƒ¼ã‚±ãƒ†ã‚£ãƒ³ã‚°ã®åŠ¹æžœã‚’æœ€å¤§åŒ–ã™ã‚‹ãŸã‚ã«ã¯ å¹´é–“5,000ä»¶ã®å•ã„åˆã‚ã›ã«å¯¾å¿œ

hiromark 2011/03/04

hadoop
pfi

ãƒªãƒ³ã‚¯

ã‚‚ã†ã™ãæ˜¥ã§ã™ãã€‚èŠ±ç²‰ã•ãˆé£›ã°ãªã‘ã‚Œã°æœ€é«˜ãªã®ã«ã€‚å²¡é‡ŽåŽŸã§ã™ã€‚ å…ˆæ—¥ã€Hadoop Conference Japan 2011ã§ã€â€MapReduceã«ã‚ˆã‚‹å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’åˆ©ç”¨ã—ãŸæ©Ÿæ¢°å¦ç¿’â€ã¨ã„ã†ã‚¿ã‚¤ãƒˆãƒ«ã§ç™ºè¡¨ã—ã¾ã—ãŸã€‚ ç™ºè¡¨å†…å®¹ã¯ä¸‰éƒ¨æ§‹æˆã«ãªã£ã¦ã„ã¾ã™ã€‚ æœ€åˆã«ã€æ©Ÿæ¢°å¦ç¿’ã®åŸºæœ¬ã¨ã€ãã‚ŒãŒMapReduceã¨ã©ã®ã‚ˆã†ãªé–¢ä¿‚ã«ã‚ã‚‹ã‹ã‚’ç´¹ä»‹ã—ã¾ã—ãŸã€‚ãã®ä¸ã§Hadoopä¸Šã§å‹•ãæ©Ÿæ¢°å¦ç¿’ãƒ©ã‚¤ãƒ–ãƒ©ãƒªMahoutã®ç°¡å˜ãªç´¹ä»‹ã‚’ã—ã¾ã—ãŸã€‚ æ¬¡ã«ã€æ©Ÿæ¢°å¦ç¿’ã®æœ€å‰ç·šã§ã¯ã©ã®ã‚ˆã†ãªå•é¡ŒãŒè§£ã‹ã‚Œã¦ã„ã‚‹ã‹ã‚’ç´¹ä»‹ã—ã€ã‚°ãƒ©ãƒ•ã‚£ã‚«ãƒ«ãƒ¢ãƒ‡ãƒ«ã®ä¾‹ã€ä¸€èˆ¬ã®æœ€é©åŒ–ï¼ˆæ•™å¸«ä»˜ãå¦ç¿’ã«ãŠã‘ã‚‹ãƒ‘ãƒ©ãƒ¡ãƒ¼ã‚¿å¦ç¿’ï¼‰ã®åˆ†æ•£ä¸¦åˆ—åŒ–ã«ã¤ã„ã¦ã®è©±é¡Œã‚’ã—ã¾ã—ãŸã€‚ æœ€å¾Œã«ã€MapReduceã®è£œå®Œã¨ã—ã¦ä½¿ãˆã‚‹ã‚ˆã†ãªã‚·ã‚¹ãƒ†ãƒ ã®ä¾‹ã¨ã—ã¦dremelã‚’ç´¹ä»‹ã—ã¾ã—ãŸã€‚ã“ã®ã‚·ã‚¹ãƒ†ãƒ ã¯MapReduceãŒãƒãƒƒãƒåž‹å‡¦ç†ã§ã€å…¨ãƒ‡ãƒ¼ã‚¿ãŒå‡¦ç†å¯¾è±¡ã®å ´åˆãŒå¾—æ„ãªã®ã«å¯¾ã—ã€ä¸€

åˆ†æ•£ä¸¦åˆ—ç’°å¢ƒã«ãŠã‘ã‚‹æ©Ÿæ¢°å¦ç¿’ - Preferred Networks Research & Development

hiromark 2011/02/25

ãƒªãƒ³ã‚¯

ãã‚“ãŒã‚“ã® Hadoopå¾¹åº•å…¥é–€ ã‚’æ‰‹ã«å…¥ã‚ŒãŸãžï¼ - nokunoã®æ—¥è¨˜

ã¨ã„ã†ã‚ã‘ã§å±Šã„ãŸã®ã§ã–ã£ã¨èªã¿ã¾ã—ãŸã€‚ã¨ã‚‚ã«Hadoopã‚’å®Ÿéš›ã«æ´»ç”¨ã™ã‚‹ãŸã‚ã«å¿…è¦ãªæƒ…å ±ã‚’ã‚³ãƒ¼ãƒ‰ã‚’ç¤ºã—ãªãŒã‚‰èª¬æ˜Žã—ã¦ã„ã‚‹ãŸã‚ã€è±¡æœ¬Hadoopã¨ã‹ã¶ã£ã¦ã„ã‚‹éƒ¨åˆ†ã‚‚ã‚ã‚Šã¾ã™ãŒã€ã„ãã¤ã‹ã®ç‚¹ã§ç•°ãªã£ã¦ã„ã‚‹ã®ã§ãã®ç‚¹ã‚’æŒ™ã’ã¦ã¿ãŸã„ã¨æ€ã„ã¾ã™ã€‚ Hadoop0.21ç³»ã®æƒ…å ±ãŒã‚ã‚‹ 0.21ç³»ã¯ä½¿ã£ãŸã“ã¨ãŒãªã„ã®ã§ã€hdfsã‚³ãƒžãƒ³ãƒ‰ãŒåˆ†é›¢ã•ã‚ŒãŸã“ã¨ãªã©ã¯åˆã‚ã¦çŸ¥ã‚Šã¾ã—ãŸã€‚ åˆ©ç”¨è€…ã®ç›®ç·šã§æ›¸ã‹ã‚Œã¦ã„ã‚‹ è±¡æœ¬ãŒé–‹ç™ºè€…ã®ç›®ç·šã§æ›¸ã‹ã‚Œã¦ã„ã‚‹ã®ã«å¯¾ã—ã€åˆ©ç”¨è€…ã®è¦–ç‚¹ã§æ›¸ã‹ã‚Œã¦ã„ã¾ã™ã€‚ ã‚³ãƒžãƒ³ãƒ‰ã‚ªãƒ—ã‚·ãƒ§ãƒ³ã‚„ãƒã‚°ãƒ•ã‚¡ã‚¤ãƒ«ã®ç®¡ç†æ–¹æ³•ãªã©ãŒåˆ†ã‹ã‚Šã‚„ã™ã„ã¨æ€ã„ã¾ã—ãŸã€‚ MapReduceã®ãƒ¦ãƒ‹ãƒƒãƒˆãƒ†ã‚¹ãƒˆ(MRUnit)ã‚„ãƒ‡ãƒãƒƒã‚°ã®æ–¹æ³•ã¯éžå¸¸ã«å½¹ã«ç«‹ã¡ã¾ã™ã€‚ Hiveã«ã¤ã„ã¦è©³ã—ã„ ç§ã¯ä½¿ã£ãŸã“ã¨ãŒãªã„ã®ã§ã™ãŒã€Java MapReduceã®æ¬¡ã«1ç« ã‚’å‰²ã„ã¦Hiveã«ã¤ã„ã¦èª¬æ˜Žã•ã‚Œã¦ã„ã¾ã™ã€‚ ã€ŒSQLã«ä¼¼ã¦ã„ã‚‹ã€ã¨ã„ã†ã“

hiromark 2011/02/08

hadoop
book

ãƒªãƒ³ã‚¯

Hadoopã¯ã€ã‚°ãƒ¼ã‚°ãƒ«ãŒæ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ç”¨ã«é–‹ç™ºã—ãŸãƒãƒƒãƒå‡¦ç†ã‚·ã‚¹ãƒ†ãƒ ã‚’åŸºã«é–‹ç™ºã•ã‚ŒãŸã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã ã€‚ã‚°ãƒ¼ã‚°ãƒ«ãŒé–‹ç™ºã—ãŸåˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã€ŒGoogle File Systemï¼ˆGFSï¼‰ã€ã‚’æ¨¡ã—ãŸã€ŒHadoop Distributed File Systemï¼ˆHD FSï¼‰ã€ã¨ã€ãƒ‡ãƒ¼ã‚¿å‡¦ç†æ©Ÿæ§‹ã€ŒMapReduceã€ã‚’æ¨¡ã—ãŸã€ŒHadoop MapReduceã€ã§æ§‹æˆã™ã‚‹ã€‚ ç±³å›½ã§ã¯ç±³VISAã‚„ç±³JPãƒ¢ãƒ«ã‚¬ãƒ³ãƒ»ãƒã‚§ãƒ¼ã‚¹ã®ã‚ˆã†ãªå¤§æ‰‹é‡‘èžæ©Ÿé–¢ãŒã€ãƒãƒƒãƒå‡¦ç†ã«Hadoopã‚’ä½¿ç”¨ã™ã‚‹ã€‚ ãã®HadoopãŒã„ã‚ˆã„ã‚ˆã€æ—¥æœ¬ä¼æ¥ã§ã‚‚ä½¿ã‚ã‚Œå§‹ã‚ãŸã€‚ä¾‹ãˆã°æ¥½å¤©ã¯ã€ã‚ã‚‹å•†å“ã«å¯¾ã™ã‚‹ãŠè–¦ã‚å•†å“ã‚’ãƒªã‚¹ãƒˆã‚¢ãƒƒãƒ—ã™ã‚‹ã€Œãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‰å‡¦ç†ã€ã«Hadoopã‚’ä½¿ç”¨ã™ã‚‹ã€‚NTTãƒ‡ãƒ¼ã‚¿ã¯ã€å…¨å›½ã®æ¸‹æ»žæƒ…å ±ã‚’ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ã«å¯è¦–åŒ–ã™ã‚‹ã‚·ã‚¹ãƒ†ãƒ ã®æ§‹ç¯‰ã«Hadoopã‚’æŽ¡ç”¨ã—ãŸã€‚ä¸‰è±UFJã‚¤ãƒ³ãƒ•ã‚©ãƒ¡ãƒ¼ã‚·ãƒ§ãƒ³ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚‚Hadoopã‚’ä½¿ã£

ã‚°ãƒ¼ã‚°ãƒ«ç™ºã€ŒHadoopã€ã€æ—¥æœ¬ä¼æ¥ã‚‚åˆ©ç”¨ã¸

hiromark 2011/01/18

hadoop

ãƒªãƒ³ã‚¯

Tatsuya Kawano @tatsuya6502 Apache Hadoopã‚³ãƒŸãƒƒã‚¿ãƒ¼ã®ã»ã¨ã‚“ã©ãŒç±³Yahoo!ç¤¾å“¡ã§æ§‹æˆã•ã‚Œã¦ã„ã‚‹çŠ¶æ³ã¯ã€ã„ã¾ã§ã¯ã‹ãªã‚Šå±é™ºã«ãªã£ã¦ãã¦ã‚‹ã‹ã‚‚ã€‚ã‚‚ã†ã€Hadoopã®é–‹ç™ºã¨ã‚µãƒãƒ¼ãƒˆã«å·¥æ•°ã‚’å‰²ãã“ã¨ã¯ã€ä¼šç¤¾ã‹ã‚‰ã»ã¨ã‚“ã©è¨±ã•ã‚Œã¦ãªã„ã‚ˆã†ãªé›°å›²æ°—ãŒã‚ã‚‹ã‚ˆã†ãª...ã€‚ 2011-01-08 12:38:15 Agile Cat @Agile_Cat ãŸã ã€MS ã¸ã®æŠ€è¡“ä¾›ä¸Žã¨å¼•æ›ã«ã‚ãƒ£ãƒƒã‚·ãƒ¥ãŒå…¥ã£ã¦ãã‚‹ã¯ãšãªã®ã§ã€ç¶šãã®ã§ã¯ãªã„ã‹ã¨ã€æœŸå¾…ã—ã¦ã„ã‚‹ã®ã§ã™ãŒã€‚ã€‚ã€‚ RT @tatsuya6502: Apache Hadoopã‚³ãƒŸãƒƒã‚¿ãƒ¼ã®ã»ã¨ã‚“ã©ãŒç±³Yahoo!ç¤¾å“¡ã§æ§‹æˆã•ã‚Œã¦ã„ã‚‹çŠ¶æ³ã¯ã€ã„ã¾ã§ã¯ã‹ãªã‚Šå±é™ºã«ãªã£ã¦ãã¦ã‚‹ã‹ã‚‚ã€‚ 2011-01-08 12:41:41 Shinpei Ohtani @shot6 @tatsuya6502 ã¯ã„ã€‚ãã†ãªã‚“ã§ã™ã‚ˆã€‚ä»Šå¹´ã¯ç›¸

hiromark 2011/01/14

hadoop

ãƒªãƒ³ã‚¯

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

ã‚¿ã‚°

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (34)

hadoopã«é–¢ã™ã‚‹hiromarkã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (48)

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2024å¹´12æœˆç¬¬1é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2024å¹´11æœˆï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2024å¹´11æœˆç¬¬5é€±ï¼‰

å…¬å¼Twitter

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹

ã‚¿ã‚°

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (34)

hadoopã«é–¢ã™ã‚‹hiromarkã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (48)

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2024å¹´12æœˆç¬¬1é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2024å¹´11æœˆï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2024å¹´11æœˆç¬¬5é€±ï¼‰

å…¬å¼Twitter

ã‚­ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (34)

hadoopã«é–¢ã™ã‚‹hiromarkã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (48)

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2024å¹´12æœˆç¬¬1é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2024å¹´11æœˆï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2024å¹´11æœˆç¬¬5é€±ï¼‰

å…¬å¼Twitter

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹