[HIVE-422] Logo for Hive - ASF JIRA
Greetings fine Hadoop peoples, While working on a few projects here at Cloudera we found ourselves wanting for some sort of icon for both the JobTracker and for Hive. After checking on the project page for Hive (the JobTracker doesn't really have one) and finding that these items have no icons, we rolled up our sleeves and made some. We'd like to contribute these to the project, so if you want 'em
Hive/Pigを使ã£ãŸKDD'12 track2ã®åºƒå‘Šã‚¯ãƒªãƒƒã‚¯çŽ‡äºˆæ¸¬
1. Hive/Pigを使ã£ãŸKDD'12 track2 ã®åºƒå‘Šã‚¯ãƒªãƒƒã‚¯çŽ‡äºˆæ¸¬ 油井 èª m.yui@aist.go.jp 産æ¥æŠ€è¡“ç·åˆç ”究所 æƒ…å ±æŠ€è¡“ç ”ç©¶éƒ¨é–€ Twitter ID: @myui スライド http://www.slideshare.net/myui/dsirnlp-myuilt 1 http://goo.gl/Ulf3A 2. KDDcup 2012 track2 • 検索ãƒã‚°ã‚’基ã«ã€æ¤œç´¢ã‚¨ãƒ³ã‚¸ãƒ³ã®åºƒå‘Šã®ã‚¯ãƒªãƒƒã‚¯ 率(Click-Through Rate)を推定ã™ã‚‹ã‚¿ã‚¹ã‚¯ – ä¸å›½ã®3大検索エンジンã®ä¸€ã¤soso.comã®å®Ÿãƒ‡ãƒ¼ã‚¿ • 検索語ãªã©ã¯Hash値ãªã©ã‚’利用ã—ã¦ã™ã¹ã¦æ•°å€¤åŒ–ã•ã‚Œã¦ã„ ã‚‹ – Trainingデータ(ç´„10GB+2.2GB, 15億レコード） – Testデータ（約1.3GB, 2億レコード） • å¦ç¿’データã®1.33割ãŒè©•ä¾¡ç”¨ãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆ –
Hive Beer を楽ã—む会 (2014/03/24 19:00〜)
新機能 イベントå‚åŠ è€…é™å®šã®æ‡‡è¦ªä¼šã‚„ミニイベント開催ã«å¯¾å¿œã—ãŸã€Œã‚µãƒ–イベント機能ã€ã‚’リリースã—ã¾ã—ãŸã€‚ イベントé‹å–¶ã‚’ç°¡ç´ åŒ–ã—ã€å‚åŠ è€…ã®ç™»éŒ²æ¼ã‚Œã‚„確èªæ¼ã‚Œã‚’防ãã®ã«ã”活用ãã ã•ã„。 主催ã®æ–¹ã¯ã‚µãƒ–イベントを作æˆã™ã‚‹ã‹ã‚‰ã€å‚åŠ è€…ã®æ–¹ã¯ã‚µãƒ–イベントãŒè¨å®šã•ã‚Œã¦ã„るイベントã«å‚åŠ ã™ã‚‹ã‹ã‚‰è©³ç´°ã‚’ã”確èªã„ãŸã ã‘ã¾ã™ã€‚ 新機能 connpass APIã«æ–°ã—ã„æ©Ÿèƒ½ã‚’è¿½åŠ ã—ã¾ã—ãŸã€‚「発表イベント一覧APIã€ã‚’è¿½åŠ ã—ã¾ã—ãŸã€‚「イベント一覧APIã€ã«éƒ½é“府県ã§ã®çµžã‚Šè¾¼ã¿æ©Ÿèƒ½ã‚’è¿½åŠ ã—ã¾ã—ãŸã€‚ã¾ãŸã€Œã‚¤ãƒ™ãƒ³ãƒˆä¸€è¦§APIã€ãŠã‚ˆã³ã€Œå‚åŠ ã‚¤ãƒ™ãƒ³ãƒˆAPIã€ã§ç”»åƒURLをレスãƒãƒ³ã‚¹ã§è¿”å´ã™ã‚‹ã‚ˆã†ã«æ‹¡å……ã—ã¾ã—ãŸã€‚詳細ãªä»•æ§˜ã‚„利用方法ã¯ã€APIリファレンスをã”確èªãã ã•ã„。API利用を希望ã•ã‚Œã‚‹æ–¹ã¯ã€connpassã®API利用ã«ã¤ã„ã¦ã‚’ã”覧ãã ã•ã„。
RPCメソッド一覧ã‹ã‚‰è¦‹ã‚‹hiveserverã¨hiveserver2ã®é•ã„ (ã¨ã€ã¤ã„ã§ã«Presto) - ãŸã”ã‚‚ã‚Šã™ãƒ¡ãƒ¢
手元ã§ã„ã„ã‹ã’ã‚“hiveserver2ã«ç§»è¡Œã—よã†ã¨æ€ã„ã¾ã—ã¦ã€ç§»è¡Œã™ã‚‹ãŸã‚ã«ã¯ shib ã‚’hiveserver2ã«å¯¾å¿œã•ã›ãªãゃãªã‚‰ã‚“ã€ã¨ã„ã†ã“ã¨ã«ãªã‚‹ã‚ã‘ã§ã™ã€‚ ã§ã€å®Ÿè£…ã™ã‚‹å‰ã«ã©ã†ã›èª¿ã¹ã‚‹ã‹ã‚‰ã€ã¨ã„ã†ã“ã¨ã§hiveserverã¨hivesever2ã¯ä½•ãŒé•ã†ã®ã‹ã‚’RPC APIメソッドã®ä¸€è¦§ã‹ã‚‰è¦‹ã¦ã¿ã‚ˆã†ã¨æ€ã„ã¾ã—ãŸã€‚ã‚«ã‚¸ãƒ¥ã‚¢ãƒ«ï¼ hiveserver å¤ãよãhiveserverã¯Thriftã§æŽ¥ç¶šã—ã¦APIã‚’å©ãã¾ã™ã€‚*.thrift ファイルãŒã‚„ãŸã‚‰å¤šã„ã®ãŒæ°—ã«ãªã‚Šã¾ã™ãŒã€ãˆã„ã‚„ã¨ã‚³ãƒ¼ãƒ‰ç”Ÿæˆã—ã¦ã—ã¾ãˆã°çµæ§‹ã‚ã‹ã‚Šã‚„ã™ã„コードãŒ(ã©ã®è¨€èªžã§ã‚‚)生æˆã•ã‚Œã¾ã™ã。 メソッドã®ä¸€è¦§ã‚’出ã—ã¦ã¿ã‚‹ã¨ã“ã‚“ãªæ„Ÿã˜ã€‚ execute(query) fetchOne() fetchN(numRows) fetchAll() getSchema() getThriftSchema() getClu
RiakCSã¨mixiプライベートクラウド環境
15. RiakCSã®æ¤œè¨¼ 2 容é‡ï¼ˆã‚ªãƒ¼ãƒãƒ¼ãƒ˜ãƒƒãƒ‰) node member-Ââ€status 実際 (ç†è«–値) [email protected] 18.8% -Ââ€> 452G (441G) [email protected] 18.8% -Ââ€> 452G (441G) [email protected] 18.8% -Ââ€> 452G (441G) [email protected] 18.8% -Ââ€> 452G (441G) [email protected] 25.0% -Ââ€> 602G (586G) • nodeã«å¯¾ã—ã¦ã°ã‚‰ã¤ããŒã‚ã‚‹ã®ã¯vnodeã®æ•°ãŒ 16個ã®ãŸã‚ • • å°‘ãªã„è¿½åŠ å®¹é‡ã§ãƒ‡ãƒ¼ã‚¿ãŒæ ¼ç´ã•ã‚Œã¦ã„ã‚‹ 削除ã«é–¢ã—ã¦ã¯ãƒ•ãƒ©ã‚°ç®¡ç†ã—ã¦ã€å¾Œã»ã©å‰Šé™¤ãŒèµ°ã‚‹ã®ã§ã€ ã™ãã«æ¸›ã‚‰ãªã„ã®ã§æ°—ã‚’ã¤ã‘ã‚‹... 15
Presto: Free, Open-Source SQL Query Engine for any Data
Learn more about our active development of Presto 2.0, the C++ native engine and next-generation version of Presto. → What is Presto?Presto lets you query massive datasets across multiple data sources with sub-second performance. Whether it’s ad hoc analytics or powering real-time apps, Presto is fast, reliable, and efficient at any scale.
Blog | Cloudera
For the inaugural episode of Women Leaders in Technology on The AI Forecast, we welcomed Kari Briski – Vice President AI Software Product Management at NVIDIA. Kari shared the stories and strategies that inform her leadership style (like GSD or “getting stuff doneâ€), what it means to trust your instinct, and the advice she gives to young women embarking on a career in technology and to women furth
Hive on Tez - Apache Hive - Apache Software Foundation
This wiki is now read only. This and new content has been migrated to a new location OverviewTez is a new application framework built on Hadoop Yarn that can execute complex directed acyclic graphs of general data processing tasks. In many ways it can be thought of as a more flexible and powerful successor of the map-reduce framework. It generalizes map and reduce tasks by exposing interfaces for
Blog | Cloudera
For the inaugural episode of Women Leaders in Technology on The AI Forecast, we welcomed Kari Briski – Vice President AI Software Product Management at NVIDIA. Kari shared the stories and strategies that inform her leadership style (like GSD or “getting stuff doneâ€), what it means to trust your instinct, and the advice she gives to young women embarking on a career in technology and to women furth
Review: Instant Apache Hive Essentials How-to - ãŸã”ã‚‚ã‚Šã™ãƒ¡ãƒ¢
çªç„¶è‹±èªžã§ãƒ¡ãƒ¼ãƒ«ãŒã‚„ã£ã¦ãã¦ãƒ¬ãƒ“ューã—ã¦ãã‚Œãªã„ã‹ã¨é ¼ã¾ã‚Œã€é¢ç™½ãã†ã ã‹ã‚‰å¼•ãå—ã‘ã¦èªã‚“ã§ã¿ãŸã€‚日本語ã§ã—ã‹ãƒ¬ãƒ“ュー記事書ã‹ãªã„ã‘ã©å¤§ä¸ˆå¤«ï¼Ÿ ã¨ç¢ºèªã—ãŸã‚‰å¤§ä¸ˆå¤«ã ã¨ã„ã£ã¦é›»å書ç±ãƒ‡ãƒ¼ã‚¿ã‚’もらã„ã¾ã—ãŸã€‚ã™ã”ã„ã“ã¨ã‚„ã£ã¦ã‚‹ä¼šç¤¾ãŒã‚ã‚‹ãªã‚。イギリスã®(é›»å書ç±å°‚é–€ã®ï¼Ÿ)出版社ã¿ãŸã„ã ã‘ã©ã€‚ ãªãŠãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã¯ pdf, epub, mobi ã®ã©ã‚Œã§ã‚‚ダウンãƒãƒ¼ãƒ‰ã§ãる。ã™ã”ã„。日本ã¯ãªãœã“ã†ã˜ã‚ƒãªã„ã®ã€‚ ã§ã€èªã‚“ã 。76ページã®çŸã„本。 ã–ã£ãり言ã†ã¨ 英語ã ã‘ã©ã™ã”ãç°¡å˜ãªè‹±èªžã§æ›¸ã‹ã‚Œã¦ã¦ã€ãã‚ã‚ã¦ç°¡å˜ã«èªã‚る。manã¨ã‹æ™®é€šã«è‹±èªžã§èªã‚“ã§ã‚‹äººãªã‚‰æ¥½å‹ã ã¨æ€ã†ã€‚èªã‚ã°æ™®é€šã«å°Žå…¥ã‹ã‚‰ã„ã‚ã‚“ãªã‚¯ã‚¨ãƒªã‚’発行ã™ã‚‹ã¨ã“ã‚ã¾ã§è¡Œã‘る。リファレンスã«ã¯ä½¿ãˆãªã„*1ã‘ã©ã€ãã‚Œã¯ã¾ã‚ã€wikiを見れã°ã„ã„ã‚“ã˜ã‚ƒãªã„ã§ã™ã‹ã。 å„トピックã«ã¤ã„ã¦ã¯ã‹ãªã‚ŠçŸã„ãŒã€å¿…ãšå‰æã«ãªã‚‹ãƒ†ãƒ¼ãƒ–ルã®æº–備をã™ã‚‹ãŸã‚ã®ã‚¯ã‚¨ãƒª*2
Hiveã§LOAD粒度を自由ã«å¤‰æ›´å¯èƒ½ã«ã™ã‚‹ãƒ‘ãƒ¼ãƒ†ã‚£ã‚·ãƒ§ãƒ³æ§‹æˆ - ãŸã”ã‚‚ã‚Šã™ãƒ¡ãƒ¢
ã²ã¨ã“ã¨ã§è¨€ã†ã¨ã€Œé€šå¸¸å¿…è¦ãªãƒ‘ーティション階層ã®æ›´ã«ä¸‹ã«ã‚‚ã†ã²ã¨ã¤ãƒ‘ーティションを掘ã£ã¦ãŠã‘ã€ã ã‘。 普通ã®ãƒ‘ーティションè¨è¨ˆ ä»®ã«Webサーãƒã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚’投入ã™ã‚‹ãŸã‚ã®ãƒ†ãƒ¼ãƒ–ル accesslog ãŒã‚ã‚‹ã¨ã™ã‚‹ã€‚ã“ã®ãƒ†ãƒ¼ãƒ–ルをã€ã¾ãšã‚µãƒ¼ãƒ“スå service カラムã§ãƒ‘ーティショニングã—ã€ã•ã‚‰ã«æ—¥æ¯Žã«ãƒ‘ーティショニングã™ã‚‹ã¨ã—よã†ã€‚データã¯å¤–部ã§ã‚¿ãƒ–区切りã«parseã—ã¦ãŠãã€ãれを毎日LOADã™ã‚‹ã€‚ ã“ã®ã‚ˆã†ãªãƒ†ãƒ¼ãƒ–ルã«ãªã‚‹ã€‚ CREATE TABLE accesslog ( rhost STRING, time STRING, method STRING, path STRING, status SMALLINT, bytes BIGINT, referer STRING, useragent STRING ) PARTITIONED BY (service STRING, yy
LanguageManual UDF
In the CLI, use the commands below to show the latest documentation: SHOW FUNCTIONS; DESCRIBE FUNCTION <function_name>; DESCRIBE FUNCTION EXTENDED <function_name>; Built-in Operators Relational Operators The following operators compare the passed operands and generate a TRUE or FALSE value depending on whether the comparison between the operands holds.
CDH4+YARN+Hiveã§ãƒãƒžã£ã¦ã‚‹ - ãŸã”ã‚‚ã‚Šã™ãƒ¡ãƒ¢
検証用ã¨ã—ã¦æ–°è¦ã«ã‚»ãƒƒãƒˆã‚¢ãƒƒãƒ—ã—ãŸCDH4クラスタã€YARN使用ã§è¨å®šã—ã¦ã¿ãŸã‚“ã ã‘ã©ä»¥ä¸‹ã®ã‚ˆã†ãªçŠ¶æ…‹ã€‚完全分散モード。 CDH4ã¯tarballを展開ã™ã‚‹å½¢ã§ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ« HADOOP_MAPRED_HOME㯠hadoop/share/hadoop/mapreduce を指定 YARN㧠hadoop-mapreduce-example.jar ã¯èµ°ã‚‹ ResourceManagerã¨åŒãƒ›ã‚¹ãƒˆã‹ã‚‰ä»¥ä¸‹ã®ã‚³ãƒžãƒ³ãƒ‰ã‚’実行ã—ãŸã‚‰æˆåŠŸã™ã‚‹ hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-0.23.1-cdh4.0.0b2.jar pi 4 1000 Hiveã§MapReduceを介ã•ãªã„処ç†ã¯æˆåŠŸã™ã‚‹ 具体的ã«ã¯SHOW TABLESã‚„CREATE TABLEãŠã‚ˆã³LOADãªã© Hive
Cloudera Impala ãŒãƒªãƒªãƒ¼ã‚¹ã•ã‚Œã¾ã—㟠- 科å¦ã¨éžç§‘å¦ã®è¿·å®®
(2012/10/25 15:48 追記) Cloudera å…¬å¼ãƒ–ãƒã‚°ã§ Impala ã«ã¤ã„ã¦ã®ç´¹ä»‹è¨˜äº‹ã‚’掲載ã—ã¾ã—ãŸã€‚ã“ã®ãƒ–ãƒã‚°è¨˜äº‹ã®å®Œå…¨ä¸Šä½äº’æ›ãªã®ã§ãã¡ã‚‰ã®è¨˜äº‹ã‚’ã”å‚ç…§ãã ã•ã„。 Cloudera Impala：Apache Hadoopã§å®Ÿç¾ã™ã‚‹ã€çœŸã®ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ クエリ | Hadoopã¨ãƒ“ッグデータソリューションã®ãƒªãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã‚«ãƒ³ãƒ‘ニー | Cloudera Japan Cloudera ã‹ã‚‰ã€ãƒ‡ãƒ¼ã‚¿ã‚µã‚¤ã‚¨ãƒ³ãƒ†ã‚£ã‚¹ãƒˆã®ãŸã‚ã®ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ クエリエンジン「Impalaã€ãŒãƒªãƒªãƒ¼ã‚¹ã•ã‚Œã¾ã—ãŸã€‚Hive ã¨å®Œå…¨äº’æ›ã®ã‚¯ã‚¨ãƒªè¨€èªžã§ã€Hive より10å€ä»¥ä¸Šé€Ÿãクエリを処ç†ã§ãã¾ã™ã€‚ 概è¦åŠã³ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ã¯ã“ã¡ã‚‰ã‹ã‚‰! http://www.cloudera.com/content/cloudera/en/products/cloudera-enterprise-core/clouder
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
YSmart: Yet Another SQL-to-MapReduce Translator [pdf]
GitHub - cartershanklin/hive-testbench: Testbench for experimenting with Apache Hive at any data scale.
BecomingACommitter - Apache Hive - Apache Software Foundation
Log Analysis System And its designs in LINE Corp. 2014 early
Strata Stinger Talk October 2013
GitHub - myui/hivemall: Scalable machine learning library for Apache Hive/Spark/Pig
{{#tags}}- {{label}}
{{/tags}}