EMR上ã§Zeppelinã¨Sparkを使ã£ã¦ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ | DevelopersIOAWS Big Data Blog㧠Building a Recommendation Engine with Spark ML on Amazon EMR using Zeppelinã¨ã„ã†ã‚¨ãƒ³ãƒˆãƒªãƒ¼ãŒã‚ã£ãŸã®ã§ã€ãã¡ã‚‰ã‚’実際ã«è©¦ã—ã¦ã¿ãŸãƒ¬ãƒãƒ¼ãƒˆã«ãªã‚Šã¾ã™ã€‚ 内容ã¨ã—ã¦ã¯MovieLensã®ãƒ‡ãƒ¼ã‚¿ã‚’使ã£ã¦ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ã‚¨ãƒ³ã‚¸ãƒ³ã‚’作るã¨ã„ã†ã‚‚ã®ã§ã™ã€‚Spark Summit 2014ã«Advanced Apache Spark Workshopã¨ã„ã†ã‚‚ã®ãŒã‚ã£ãŸã‚ˆã†ã§ã€ãã¡ã‚‰ã®MLlibã®ãƒãƒ³ã‚ºã‚ªãƒ³ã‚’EMR上ã§Zeppelinを使ã£ã¦ã‚„ã£ã¦ã¿ã‚‹ã¨ã„ã†ã‚‚ã®ã§ã—ãŸã€‚ ãªãŠã€Spark Summit 2014ã®ãƒãƒ³ã‚ºã‚ªãƒ³ã¨AMP Camp 5 - big data bootcampをベースã«æ—¥æœ¬èªžåŒ–ã—ãŸã‚µã‚¤ãƒˆãŒã‚ã‚Šã¾ã—ãŸã€‚今回ã®ã‚¨ãƒ³ãƒˆãƒªãƒ¼ã«å¯¾å¿œã™ã‚‹ã®ã¯4. MLlib(機械å¦ç¿’)ã«ãªã‚Šã¾ã™
Amazon Elastic MapReduce(AWS EMR)を触るã ã‘触ã£ãŸãƒ¡ãƒ¢ - ã†ã•ã ã®ãƒ–ãƒã‚°è·¡åœ°
ã¯ã˜ã‚ã¦ã®EMRï¼fluentdã§S3ã«ã‚¢ãƒƒãƒ—ãƒãƒ¼ãƒ‰ã—ãŸãƒã‚°ã‚’Elastic MapReduceã§æ¤œç´¢ãƒ»é›†è¨ˆã™ã‚‹ | DevelopersIO
http://blog.yoslab.com/entry/2015/01/29/225938
Amazon EMR 4.0.0ã§å§‹ã‚ã‚‹ Apache Spark 1.4.1 | DevelopersIO
{{#tags}}- {{label}}
{{/tags}}