Prestoã¨ã‹Ansibleã¨ã‹ãã®è¾ºã®è©±ã‚’軽ã書ã„ã¦ã¿ã‚‹ - wyukawa's diary今日ã¯Prestoã¨ã‹Ansibleã¨ã‹ãã®è¾ºã®è©±ã‚’軽ã書ã„ã¦ã¿ã‚ˆã†ã¨æ€ã„ã¾ã™ã€‚çªã£è¾¼ã‚“ã 話ãŒå‡ºæ¥ã‚‹ã‚ã‘ã§ã¯ãªã„ã®ã§ã‚ã—ã‹ã‚‰ãšã€‚ 僕ã®ã¨ã“ã‚ã®ç’°å¢ƒã§ã¯Prestoを使ã£ã¦ã„ã¦ã€Prestoã¯DataNodeã‚„NodeManagerã¨åŒå±…ã—ã¦ã¾ã™ã€‚主ãªãƒ¦ãƒ¼ã‚¹ã‚±ãƒ¼ã‚¹ã¯ã‚¢ãƒ‰ãƒ›ãƒƒã‚¯ã‚¯ã‚¨ãƒªã®å®Ÿè¡Œã§ã™ã€‚ã¨ã‚るレãƒãƒ¼ãƒˆã‚’作りãŸã„ã£ã¦ãªã£ãŸã¨ãã«ãƒ‡ãƒ¼ã‚¿ã®ä¸èº«ã‚’ãƒã‚§ãƒƒã‚¯ã™ã‚‹ã®ã«ä½¿ã„ã¾ã™ã€‚従æ¥ã ã¨ã“ã‚ŒãŒHiveã ã£ãŸã®ã§ã™ãŒã€Hiveã ã¨MapReduceã«ãªã£ã¦é…ã„ã®ã§ï¼ˆãƒãƒ¼ã‚«ãƒ«ãƒ¢ãƒ¼ãƒ‰ã§æ¸ˆã‚€å ´åˆã‚‚ã‚ã‚‹ã‘ã©ï¼‰ã€ãã®ç‚¹Prestoã¯æ—©ãã¦ã„ã„ã§ã™ã€‚ãŸã ã“ã‚Œã¯åƒ•ã®ç’°å¢ƒãŒã‚¹ãƒ¢ãƒ¼ãƒ«ãƒ‡ãƒ¼ã‚¿ã ã‹ã‚‰ã£ã¦ã„ã†ã®ã‚‚ã‚ã£ã¦ã€åœ§ç¸®æ¸ˆã¿æ•°ç™¾GBã®ãƒ‡ãƒ¼ã‚¿ã«å¯¾ã—ã¦selectã‹ã‘ã‚‹ã¨ã‹ã ã¨Prestoã¨ã„ãˆã©ã‚‚é…ããªã‚‹ã¨æ€ã„ã¾ã™ã€‚ã‚ã¨ãªã«ã’ã«è‰¯ã„ã®ãŒPresto CLI経由ã ã¨ã‚«ãƒ©ãƒ åãŒè¡¨ç¤ºã•ã‚Œã‚‹ã®ã§ã©ã®ãƒ‡ãƒ¼ã‚¿ãŒã©ã®ã‚«ãƒ©ãƒ ãªã®ã‹ã™ã分ã‹
Hadoopã®SQL対応分散クエリエンジン「Cloudera Impalaã€ã€‚ClouderaãŒã‚ªãƒ¼ãƒ—ンソースã§å…¬é–‹
ã€17-E-3】Hadoop：黄色ã„象使ã„ã¸ã®é“ ～「Hadoop徹底入門ã€ã‚ˆã‚Šï½ž
Hortonworks Documentation
CDH3 Installation - Cloudera Support
Cloudera Blog
https://www.gemini-bigdata.com/2011/03/flume-cassandra-log-processing-system.html
GitHub - cloudera/flume: WE HAVE MOVED to Apache Incubator. https://cwiki.apache.org/FLUME/ . Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexib
Flume ドã‚ュメント (v0.9.5-SNAPSHOT)
『Hadoop/Hiveを用ã„ãŸãƒã‚°è§£æžåŸºç›¤ã®æ§‹ç¯‰ã€
Flume cassandra real time log processing (日本語）
{{#tags}}- {{label}}
{{/tags}}