CDH3 Installation - Cloudera Support
Ways To Install CDH3 You can install CDH3 in any of the following ways: Automated method using SCM Express; instructions here. Service and Configuration Manager Express Edition (SCM Express) automates the installation and configuration of CDH3 on an entire cluster (up to 50 nodes), requiring only that you have root SSH access to your cluster's machines. SCM Express is not supported on 32-bit Red
Cloudera Blog
We are excited to announce the acquisition of Octopai, a leading data lineage and catalog platform that provides data discovery and governance for enterprises to enhance their data-driven decision making. Cloudera’s mission since its inception has been to empower organizations to transform all their data to deliver trusted, valuable, and predictive insights. With AI and […] Read blog post
GitHub - cloudera/flume: WE HAVE MOVED to Apache Incubator. https://cwiki.apache.org/FLUME/ . Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexib
h1. Welcome to Flume! NOTE: We have moved to the Apache Incubator. https://cwiki.apache.org/FLUME/ Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and rec
Flume ドã‚ュメント (v0.9.5-SNAPSHOT)
Flume ã¯ã€å¤§é‡ã®ãƒã‚°ãƒ‡ãƒ¼ã‚¿ã‚’効率的ã«åŽé›†ã€é›†ç´„ã€ç§»å‹•ã™ã‚‹ã“ã¨ã‚’目的ã«é–‹ç™ºã•ã‚ŒãŸã€é«˜ã„ä¿¡é ¼æ€§ã¨å¯ç”¨æ€§ã‚’æŒã¤åˆ†æ•£åž‹ã®ã‚µãƒ¼ãƒ“スã§ã™ã€‚Flume を使ãˆã°ã€ã‚¯ãƒ©ã‚¹ã‚¿å†…ã®å„マシンã®ãƒã‚°ãƒ•ã‚¡ã‚¤ãƒ«ã‚’åŽé›†ã—ã€ã“れらã®ãƒã‚°ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ Hadoop Distributed File System (HDFS) ãªã©ã®ä¸å¤®ã®æ°¸ç¶šçš„ストアã«é›†ç´„ã™ã‚‹ãƒã‚®ãƒ³ã‚°ã‚·ã‚¹ãƒ†ãƒ を構築ã§ãã¾ã™ã€‚
『Hadoop/Hiveを用ã„ãŸãƒã‚°è§£æžåŸºç›¤ã®æ§‹ç¯‰ã€
ã“ã‚“ã«ã¡ã¯ã€‚Amebaã®ãƒã‚°è§£æžåŸºç›¤ã‚’担当ã—ã¦ã„ã‚‹ICHIROã§ã™ã€‚ 今回ã¯æ§‹ç¯‰ãƒ»é‹ç”¨ä¸ã®ãƒã‚°è§£æžåŸºç›¤ã€ŒPatriotã€ã«ã¤ã„ã¦æ›¸ããŸã„ã¨æ€ã„ã¾ã™ã€‚ Webサービスをé‹å–¶ã—ã¦ã„ã‚‹ã¨æ—¥ã€…大é‡ã®ãƒã‚°ãƒ‡ãƒ¼ã‚¿ã‚„ユーザデータãŒè“„ç©ã•ã‚Œã¾ã™ã€‚ 今ã¾ã§ã¯PV（ページビュー）やUU（ユニークユーザ）ãªã©ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ãªã©ã‹ã‚‰å–れるã€å¤§æž ã®æŒ‡æ¨™ã®ã¿ã‚’見るã“ã¨ãŒã»ã¨ã‚“ã©ã§ã—ãŸã€‚ ページビューã«åˆã‚ã›ã¦ã‚·ã‚¹ãƒ†ãƒ を増強ã™ã‚‹ãªã©ã€ã‚·ã‚¹ãƒ†ãƒ å´ã¨ã—ã¦ã¯å分ã¨ã‚‚言ãˆã‚‹æŒ‡æ¨™ã§ã™ãŒã€åºƒå‘Šã‚„課金サービスã¨ã„ã†è¦–点ã‹ã‚‰è¦‹ã‚‹ã¨å分ã¨ã¯è¨€ãˆã¾ã›ã‚“。 今ã¾ã§ã¯Ameba内ã®å€‹ã€…ã®ã‚µãƒ¼ãƒ“ス担当者ãŒå¿…è¦ã¨ã™ã‚‹æŒ‡æ¨™ã‚’出ã™ãŸã‚ã«ã‚¢ãƒ—リエンジニアやDBエンジニアã«éƒ½åº¦ä¾é ¼ã‚’ã™ã‚‹å½¢ã§ãƒ‡ãƒ¼ã‚¿ã‚’抽出ã—ã¦ã„ã¾ã—ãŸã€‚ 今後ã®èª²é‡‘サービスã®ç™ºå±•ãŒè¦‹è¾¼ã¾ã‚Œã€ã‚ˆã‚Šãƒ‡ãƒ¼ã‚¿åˆ†æžã®é‡è¦æ€§ãŒé«˜ã¾ã‚‹ã¨è€ƒãˆãŸç§ã¯ã€ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã§ãªã„サービス担当者（主ã«ãƒ—ãƒãƒ‡ãƒ¥ãƒ¼ã‚µï¼‰ãŒã‚ˆã‚Šç°¡å˜
Flume cassandra real time log processing (日本語）
2. æ¦‚è¦ 1. ãƒã‚°åŽé›†ã€ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã¸ã®æ ¼ç´ ãƒã‚°åŽé›†ã€ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã¸ã®æ ¼ç´ åŽé›† • 複数ã®ã‚¢ãƒ—リケーション・ノードã‹ã‚‰ã®ã€ Flumeã«ã‚ˆã‚‹ä¿¡é ¼æ€§ã‚„効率ã®é«˜ã„ãƒã‚°åŽé›†ã€‚ • Cassandraデータベースã¸ã®ç”Ÿãƒã‚°ã‚„処ç†æ¸ˆã¿ãƒã‚°ã®æ ¼ç´ã€‚ 2. リアルタイムã€ã‚ªãƒ³ãƒ‡ãƒžãƒ³ãƒ‰ã®ãƒ¬ãƒãƒ¼ãƒˆ リアルタイム〠• ウェブGUIã‹ã‚‰Cassandraã¸ã®ã‚¯ã‚¨ãƒªãƒ¼ã€‚ （例）1秒当ãŸã‚Šãƒˆãƒ©ãƒ³ã‚¶ã‚¯ã‚·ãƒ§ãƒ³å‡¦ç†ä»¶æ•°ï¼ˆTPS) VS 時間ã€ãƒ¦ãƒ¼ã‚¶ãƒ¼ã®CDR検索。 ã«ã‚ˆã‚‹ã‚µãƒžãƒªãƒ¼ãƒ¬ãƒãƒ¼ãƒˆ 3. Map-Reduceã«ã‚ˆã‚‹ã‚µãƒžãƒªãƒ¼ãƒ¬ãƒãƒ¼ãƒˆ • （例）ユーザー群毎ã®ç¨®é¡žåˆ¥ï¼ˆéŸ³å£°ã€ãƒ‡ãƒ¼ã‚¿ã€ãƒ¡ãƒ¼ãƒ«ç‰ï¼‰æœˆé–“利用 アプリケー アプリケー … アプリケー ション・ノード ション・ノード ション・ノード ãƒã‚°ãƒ» ãƒã‚°ãƒ» OA&M アグリゲータ アグリゲータ レãƒãƒ¼ãƒˆ (Web GUI) Cassandra Cassandra
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
Hortonworks Documentation
https://www.gemini-bigdata.com/2011/03/flume-cassandra-log-processing-system.html
{{#tags}}- {{label}}
{{/tags}}