AWS Solutions Architect ブãƒã‚°Apache Sparkã¨Amazon DSSTNEを使ã£ãŸã€Amazonè¦æ¨¡ã®ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‡ãƒ¼ã‚·ãƒ§ãƒ³ç”Ÿæˆ Amazonã®ãƒ‘ーソナライゼーションã§ã¯ã€ãŠå®¢æ§˜æ¯Žã®è£½å“レコメンデーションを生æˆã™ã‚‹ãŸã‚ã«ãƒ‹ãƒ¥ãƒ¼ãƒ©ãƒ«ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ã‚’使ã£ã¦ã„ã¾ã™ã€‚Amazonã®è£½å“ã‚«ã‚¿ãƒã‚°ã¯ã€ã‚ã‚‹ãŠå®¢æ§˜ãŒè³¼å…¥ã—ãŸè£½å“ã®æ•°ã«æ¯”較ã—ã¦éžå¸¸ã«å·¨å¤§ãªã®ã§ã€ãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆã¯æ¥µç«¯ã«ç–Žã«ãªã£ã¦ã—ã¾ã„ã¾ã™ã€‚ãã—ã¦ã€ãŠå®¢æ§˜ã®æ•°ã¨è£½å“ã®æ•°ã¯ä½•å„„ã«ã‚‚ã®ã¼ã‚‹ãŸã‚ã€æˆ‘々ã®ãƒ‹ãƒ¥ãƒ¼ãƒ©ãƒ«ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ã®ãƒ¢ãƒ‡ãƒ«ã¯è¤‡æ•°ã®GPUã§åˆ†æ•£ã—ãªã‘ã‚Œã°ã€ç©ºé–“や時間ã®åˆ¶ç´„を満ãŸã™ã“ã¨ãŒã§ãã¾ã›ã‚“。 ãã®ãŸã‚ã€GPU上ã§å‹•ä½œã™ã‚‹DSSTNE (the Deep Scalable Sparse Tensor Neural Engine)を開発ã—オープンソースã«ã—ã¾ã—ãŸã€‚我々ã¯DSSTNEを使ã£ã¦ãƒ‹ãƒ¥ãƒ¼ãƒ©ãƒ«ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ã‚’å¦ç¿’ã—レコメンデーションを生æˆã—ã¦ã„ã¦ã€ECã®ã‚¦ã‚§ãƒ–サイト
[翻訳] Spark Architecture: Shuffle - Qiita![[翻訳] Spark Architecture: Shuffle - Qiita](https://cdn-ak-scissors.b.st-hatena.com/image/square/96402372010a6931b881c9342b1697e9354d4356/height=288;version=1;width=512/https%3A%2F%2Fqiita-user-contents.imgix.net%2Fhttps%253A%252F%252Fqiita-user-contents.imgix.net%252Fhttps%25253A%25252F%25252Fcdn.qiita.com%25252Fassets%25252Fpublic%25252Farticle-ogp-background-afbab5eb44e0b055cce1258705637a91.png%253Fixlib%253Drb-4.0.0%2526w%253D1200%2526blend64%253DaHR0cHM6Ly9xaWl0YS11c2VyLXByb2ZpbGUtaW1hZ2VzLmltZ2l4Lm5ldC9odHRwcyUzQSUyRiUyRnFpaXRhLWltYWdlLXN0b3JlLnMzLmFtYXpvbmF3cy5jb20lMkYwJTJGNjQxMCUyRnByb2ZpbGUtaW1hZ2VzJTJGMTQ3MzY4Mjg1NT9peGxpYj1yYi00LjAuMCZhcj0xJTNBMSZmaXQ9Y3JvcCZtYXNrPWVsbGlwc2UmZm09cG5nMzImcz01NTQxOWJlN2JlMTBlZmRiODQ2NDhhMWIwNzE3ZmI2Nw%2526blend-x%253D120%2526blend-y%253D467%2526blend-w%253D82%2526blend-h%253D82%2526blend-mode%253Dnormal%2526s%253Da5fb8088c77cd275c5ab373ceb8ecfb0%3Fixlib%3Drb-4.0.0%26w%3D1200%26fm%3Djpg%26mark64%3DaHR0cHM6Ly9xaWl0YS11c2VyLWNvbnRlbnRzLmltZ2l4Lm5ldC9-dGV4dD9peGxpYj1yYi00LjAuMCZ3PTk2MCZoPTMyNCZ0eHQ9JTVCJUU3JUJGJUJCJUU4JUE4JUIzJTVEJTIwU3BhcmslMjBBcmNoaXRlY3R1cmUlM0ElMjBTaHVmZmxlJnR4dC1hbGlnbj1sZWZ0JTJDdG9wJnR4dC1jb2xvcj0lMjMxRTIxMjEmdHh0LWZvbnQ9SGlyYWdpbm8lMjBTYW5zJTIwVzYmdHh0LXNpemU9NTYmdHh0LXBhZD0wJnM9ZmE2NTlhMDAzNTRlMGVhMGFiYTEzMDk1ODNhYzY0NTU%26mark-x%3D120%26mark-y%3D112%26blend64%3DaHR0cHM6Ly9xaWl0YS11c2VyLWNvbnRlbnRzLmltZ2l4Lm5ldC9-dGV4dD9peGxpYj1yYi00LjAuMCZ3PTgzOCZoPTU4JnR4dD0lNDBnaXdhJnR4dC1jb2xvcj0lMjMxRTIxMjEmdHh0LWZvbnQ9SGlyYWdpbm8lMjBTYW5zJTIwVzYmdHh0LXNpemU9MzYmdHh0LXBhZD0wJnM9NGE2YTk2NjhkMzI4ZTk0ZWI2NjE5ZWIwNjI2YzNkNzk%26blend-x%3D242%26blend-y%3D480%26blend-w%3D838%26blend-h%3D46%26blend-fit%3Dcrop%26blend-crop%3Dleft%252Cbottom%26blend-mode%3Dnormal%26s%3D73d44a4b354f306cfd2b242a2290c637)
Sparkå†…éƒ¨æ§‹é€ è§£èª¬ãƒ‰ã‚ュメントã®ãƒªãƒ³ã‚¯é›† - Qiita
MySQLã§ã¯ã§ããªã„ã“ã¨ãŒã§ãるデータベース(広義)é”
DeNAã®åˆ†æžã‚’支ãˆã‚‹åˆ†æžåŸºç›¤
Spark ã® MLlib を使ã£ãŸ Dataproc ã§ã®ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‰ã‚·ã‚¹ãƒ†ãƒ ã®å®Ÿè£… - Qiita
『Sparkã«ã‚ˆã‚‹å®Ÿè·µãƒ‡ãƒ¼ã‚¿è§£æžã€ã¨ã„ã†æœ¬ã®ä»˜éŒ²ã‚’執ç†ã—ã¾ã—㟠- ã»ãã笑む
Cloudera Blog
Sparkã«ã‚ˆã‚‹å®Ÿè·µãƒ‡ãƒ¼ã‚¿è§£æž
Spark and YARN - Qiita
ã“ã¨ã‚ŠéšŠå…¥è·æƒ…å ±ã‚’Sparkã§åˆ†æžã—ã¦Tableauã§å¯è¦–化ã™ã‚‹
「Apache Zeppelinã€ã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«æ–¹æ³•ã¾ã¨ã‚ - Qiita
Spark を使ã†ã«ã‚ãŸã‚Š Google Cloud Dataproc を利用ã™ã‚‹ï¼•ã¤ã®ãƒ¡ãƒªãƒƒãƒˆã¨æ³¨æ„点 - Qiita
æ ªå¼ä¼šç¤¾D2C｜データマーケティングカンパニー
æ ªå¼ä¼šç¤¾D2C｜データマーケティングカンパニー
1.Spark1.5ã§SparkStreaming開発 [ã“ã¨å§‹ã‚ç·¨] - Qiita![1.Spark1.5ã§SparkStreaming開発 [ã“ã¨å§‹ã‚ç·¨] - Qiita](https://cdn-ak-scissors.b.st-hatena.com/image/square/0ddd03f9001c41e749000c986e228a7cf969d710/height=288;version=1;width=512/https%3A%2F%2Fqiita-user-contents.imgix.net%2Fhttps%253A%252F%252Fqiita-user-contents.imgix.net%252Fhttps%25253A%25252F%25252Fcdn.qiita.com%25252Fassets%25252Fpublic%25252Fadvent-calendar-ogp-background-7940cd1c8db80a7ec40711d90f43539e.jpg%253Fixlib%253Drb-4.0.0%2526w%253D1200%2526blend64%253DaHR0cHM6Ly9xaWl0YS11c2VyLXByb2ZpbGUtaW1hZ2VzLmltZ2l4Lm5ldC9odHRwcyUzQSUyRiUyRnMzLWFwLW5vcnRoZWFzdC0xLmFtYXpvbmF3cy5jb20lMkZxaWl0YS1pbWFnZS1zdG9yZSUyRjAlMkYyNjk5NyUyRmQ4OWE3Yjc3YTc2ODk5NTQ2ZjZiMTBiMmEzY2MyMWE0YzcxYjFjN2IlMkZ4X2xhcmdlLnBuZyUzRjE3MDA2MjUwMzE_aXhsaWI9cmItNC4wLjAmYXI9MSUzQTEmZml0PWNyb3AmbWFzaz1lbGxpcHNlJmZtPXBuZzMyJnM9ZWQ1ZjZiYTQ1NGQ0ZTk5OTZlNzJlYjU1YWZiNTU5YzA%2526blend-x%253D120%2526blend-y%253D467%2526blend-w%253D82%2526blend-h%253D82%2526blend-mode%253Dnormal%2526s%253D53df3f44e0ba7ed014bf515e246459ae%3Fixlib%3Drb-4.0.0%26w%3D1200%26fm%3Djpg%26mark64%3DaHR0cHM6Ly9xaWl0YS11c2VyLWNvbnRlbnRzLmltZ2l4Lm5ldC9-dGV4dD9peGxpYj1yYi00LjAuMCZ3PTk2MCZoPTMyNCZ0eHQ9MS5TcGFyazEuNSVFMyU4MSVBN1NwYXJrU3RyZWFtaW5nJUU5JTk2JThCJUU3JTk5JUJBJTIwJTVCJUUzJTgxJTkzJUUzJTgxJUE4JUU1JUE3JThCJUUzJTgyJTgxJUU3JUI3JUE4JTVEJnR4dC1hbGlnbj1sZWZ0JTJDdG9wJnR4dC1jb2xvcj0lMjMzQTNDM0MmdHh0LWZvbnQ9SGlyYWdpbm8lMjBTYW5zJTIwVzYmdHh0LXNpemU9NTYmdHh0LXBhZD0wJnM9YzUzOTM4MDdlM2M0YjQ2YWMyZmZkM2I3NmEzMzdhYmM%26mark-x%3D120%26mark-y%3D112%26blend64%3DaHR0cHM6Ly9xaWl0YS11c2VyLWNvbnRlbnRzLmltZ2l4Lm5ldC9-dGV4dD9peGxpYj1yYi00LjAuMCZ3PTgzOCZoPTU4JnR4dD0lNDBrYXozMjg0JnR4dC1jb2xvcj0lMjMzQTNDM0MmdHh0LWZvbnQ9SGlyYWdpbm8lMjBTYW5zJTIwVzYmdHh0LXNpemU9MzYmdHh0LXBhZD0wJnM9MGY1ZDVkY2RlZGQ3ZGY4NmNjMmVmZTViMzM0MjI4MzM%26blend-x%3D242%26blend-y%3D454%26blend-w%3D838%26blend-h%3D46%26blend-fit%3Dcrop%26blend-crop%3Dleft%252Cbottom%26blend-mode%3Dnormal%26txt64%3DaW4gVW5pcG9z5qCq5byP5Lya56S-%26txt-x%3D242%26txt-y%3D539%26txt-width%3D838%26txt-clip%3Dend%252Cellipsis%26txt-color%3D%25233A3C3C%26txt-font%3DHiragino%2520Sans%2520W6%26txt-size%3D28%26s%3D949ad65b7a77d72afd437502add03cf2)
Apache Spark ã®ç´¹ä»‹ï¼ˆå‰åŠï¼šSparkã®ã‚ホン）
{{#tags}}- {{label}}
{{/tags}}