[B! hive] mfhamã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

mfham id:mfham

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (6)

ã‚¿ã‚°ã®çµžã‚Šè¾¼ã¿ã‚’è§£é™¤

hiveã«é–¢ã™ã‚‹mfhamã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (13)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Hive Hacks ãã®2 â€“ Hiveã®ãƒã‚°ã€åœ§ç¸®ãªã© â€“ OpenGroove
æ³¨1 :ã‚¹ãƒ—ãƒªãƒƒãƒˆä¸å¯ã®å½¢å¼ã¯HDFSã§æŒ‡å®šã—ãŸãƒ–ãƒãƒƒã‚¯ã‚µã‚¤ã‚ºã‚ˆã‚Šã‚‚å¤§ããªåœ§ç¸®ãƒ•ã‚¡ã‚¤ãƒ«ã‚’MapReduceã®å…¥åŠ›ã¨ã—ãŸå ´åˆã€å…¥åŠ›ãŒè¤‡æ•°ã®Mapã‚¿ã‚¹ã‚¯ã«åˆ†æ•£ã•ã‚Œãšã«å˜ä¸€ã®Mapã‚¿ã‚¹ã‚¯ã§å‡¦ç†ã•ã‚Œã¦ã—ã¾ã†ãŸã‚ã€åˆ†æ•£å‡¦ç†ã®ãƒ¡ãƒªãƒƒãƒˆãŒæãªã‚ã‚Œã¦ã—ã¾ã†ã€‚ æ³¨2 :ãƒã‚¤ãƒ†ã‚£ãƒ–ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã¯ã€CDHã®å ´åˆhadoop/lib/native/ã«ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã•ã‚Œã¦ã„ã‚‹ã€‚Hadoopã®ãƒ‡ãƒ•ã‚©ãƒ«ãƒˆã®å‹•ä½œã§ã¯è‡ªå‹•çš„ã«ã“ã®ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã‚’ãƒãƒ¼ãƒ‰ã—ã¦ä½¿ç”¨ã™ã‚‹ã€‚ MapReduceãƒ—ãƒã‚°ãƒ©ãƒ ã®å‡ºåŠ›åœ§ç¸® MapReduceã«ã¦Mapï¼ˆä¸é–“å‡ºåŠ›ï¼‰ã¨Reduceï¼ˆæœ€çµ‚å‡ºåŠ›ï¼‰ãã‚Œãžã‚Œã‚’åœ§ç¸®ã™ã‚‹ã“ã¨ãŒã§ãã‚‹ã€‚ä¸é–“ãƒ‡ãƒ¼ã‚¿åœ§ç¸®ã«ã‚ˆã‚Šæ€§èƒ½æ”¹å–„ãŒæœŸå¾…ã§ãã‚‹ã€‚ mapred.compress.map.output true:ã€€Mapã®å‡ºåŠ›ã‚’åœ§ç¸®ã™ã‚‹ï¼ˆSequenceFileã‚’ä½¿ç”¨ï¼‰ false:ã€€åœ§ç¸®ã—ãªã„ï¼ˆãƒ‡ãƒ•ã‚©ãƒ«ãƒˆï¼‰ mapred.map.o
mfham 2017/03/21
Hive
ãƒªãƒ³ã‚¯
LanguageManual UDF - Apache Hive - Apache Software Foundation
When hive.cache.expr.evaluation is set to true (which is the default) a UDF can give incorrect results if it is nested in another UDF or a Hive function. This bug affects releases 0.12.0, 0.13.0, and 0.13.1. Release 0.14.0 fixed the bug (HIVE-7314). The probl em relates to the UDF's implementation of the getDisplayString method, as discussed in the Hive user mailing list.
mfham 2017/03/09
hive
ãƒªãƒ³ã‚¯
hadooptutorial.infoÂ -Â hadooptutorial ãƒªã‚½ãƒ¼ã‚¹ãŠã‚ˆã³æƒ…å ±
This webpage was generated by the domain owner using Sedo Domain Parking. Disclaimer: Sedo maintains no relationship with third party advertisers. Reference to any specific service or trade mark is not controlled by Sedo nor does it constitute or imply its association, endorsement or recommendation.
mfham 2017/03/09
hive
ãƒªãƒ³ã‚¯
hadooptutorial.infoÂ -Â hadooptutorial ãƒªã‚½ãƒ¼ã‚¹ãŠã‚ˆã³æƒ…å ±
mfham 2017/03/09
hive
ãƒªãƒ³ã‚¯
IDCãƒ•ãƒãƒ³ãƒ†ã‚£ã‚¢ ãƒ˜ãƒ«ãƒ—ã‚µã‚¤ãƒˆ
TOP ã‚µãƒ¼ãƒ“ã‚¹ IDCFã‚¯ãƒ©ã‚¦ãƒ‰ ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ãƒˆ ã‚³ãƒ³ãƒ†ãƒŠ RDB CacheDB ã‚¯ãƒ©ã‚¦ãƒ‰ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ DNS GSLBï¼ˆåºƒåŸŸè² è·åˆ†æ•£ï¼‰ ã‚¤ãƒ³ãƒ•ã‚£ãƒ‹ãƒƒãƒˆLB CDN ã‚¤ãƒ¡ãƒ¼ã‚¸ã‚ªãƒ—ãƒ†ã‚£ãƒžã‚¤ã‚¶ãƒ¼ é€£æºã‚µãƒ¼ãƒ“ã‚¹ ãƒ—ãƒ©ã‚¤ãƒ™ãƒ¼ãƒˆã‚¯ãƒ©ã‚¦ãƒ‰ NSXã‚ªãƒ—ã‚·ãƒ§ãƒ³ ãƒ™ã‚¢ãƒ¡ã‚¿ãƒ«ã‚µãƒ¼ãƒãƒ¼ ãƒ‘ãƒ¼ãƒˆãƒŠãƒ¼ã‚µãƒ¼ãƒ“ã‚¹ Fastly CDN Fastly æ¬¡ä¸–ä»£ WAF SiteGuard Server Edition Google Cloud æ§‹æˆä¾‹ äº‹ä¾‹ æ–™é‡‘ã‚·ãƒŸãƒ¥ãƒ¬ãƒ¼ã‚·ãƒ§ãƒ³ ã‚¦ã‚§ãƒ“ãƒŠãƒ¼é–‹å‚¬æƒ…å ± ä»Šå¾Œã®æ©Ÿèƒ½å¼·åŒ–äºˆå®š English
mfham 2017/03/09
hive
ãƒªãƒ³ã‚¯
TreasureDataã§Hiveã‚¯ã‚¨ãƒªã‚’æ›¸ãã¨ã - TD_TIME_FORMAT,TD_TIME_PARSE,TD_DATE_TRUNC - Qiita
Deleted articles cannot be recovered. Draft of this article would be also deleted. Are you sure you want to delete this article?
mfham 2017/03/09
hive
ãƒªãƒ³ã‚¯
Hadoopã‚¢ãƒ‰ãƒ™ãƒ³ãƒˆã‚«ãƒ¬ãƒ³ãƒ€ãƒ¼2011 17æ—¥ç›® - Hive 0.8 ã«ã¤ã„ã¦ -
ã¾ãŸJIRAã®ãƒã‚±ãƒƒãƒˆã«ã‚ˆã‚‹ã¨ã€datetimeã«é–¢ã™ã‚‹æ§˜ã€…ãªUDFãŒtimestampã‚’ã‚µãƒãƒ¼ãƒˆã—ãŸã‚ˆã†ã§ã™ã€‚ ä¾‹ãˆã°ä»¥ä¸‹ã®ã‚ˆã†ãªæ“ä½œãŒã§ãã¾ã™ã€‚ ã‚µãƒ³ãƒ—ãƒ«ãƒ‡ãƒ¼ã‚¿ã‚’1ä»¶ç”¨æ„ã—ã¾ã™ã€‚æ›¸å¼ã¯yyyy-MM-dd HH:mm:ss ã‹ yyyy-MM-dd HH:mm:ss.fffffffffã®ã¿ã§ã™ã€‚ 2011-12-25 09:00:00 create table ts1(t1 timestamp); load data local inpath '/mnt/iscsi/test1/data4.txt' overwrite into table ts1; select cast(t1 as float), cast(t1 as double) from ts1 limit 1; 1.3247712E9 1.3247712E9 select cast(t1 as bigint), cast(
mfham 2017/03/09
HIVE
ãƒªãƒ³ã‚¯
SQLite + Pythonãƒ¦ãƒ¼ã‚¶å®šç¾©é–¢æ•°çµ„è¾¼ã§é€²æ—ãƒ€ãƒ¡ã˜ã‚ƒãªã„ã§ã™ã«ãªã‚Šã¾ã—ãŸ - ã‚ã‚“ã¡ã¹ï¼
æ¦‚è¦ ã“ã‚Œã¾ã§ã€ŒHiveã‹ã‚‰ãƒ‡ãƒ¼ã‚¿å–å¾—ãƒ»ç°¡å˜ãªåŠ å·¥â†’Pythonã§åŠ å·¥ãƒ»åˆ†æžã€ ã¨ã„ã†æµã‚Œã§ä½œæ¥ã—ã¦ã„ãŸã®ã§ã™ãŒã€ Hiveâ†’SQLiteâ†’Pythonã¨ã„ã†æµã‚Œã«ã—ãŸã¨ã“ã‚é€²æ—ãŒæ”¹å–„ã•ã‚ŒãŸã®ã§ã€ SQLiteã®ç°¡å˜ãªä½¿ã„æ–¹ã¨Pythonã«ã‚ˆã‚‹SQLãƒ¦ãƒ¼ã‚¶å®šç¾©é–¢æ•°ã®çµ„è¾¼æ–¹æ³• ã«ã¤ã„ã¦ãƒ¡ãƒ¢ã‚’æ®‹ã—ã¦ãŠãã¾ã™ã€‚ ç‰¹ã«ãƒ¦ãƒ¼ã‚¶å®šç¾©é–¢æ•°ã®çµ„è¾¼ã‚’è‡ªç”±ã«å‡ºæ¥ã‚‹ã¨ã€ åˆ†æžã™ã‚‹éš›ã€ç›¸å½“æ¥½ã«ãªã‚‹ã¨ã„ã†ã“ã¨ã«æ°—ä»˜ãã¾ã—ãŸã€‚ SQLiteæŒŸã‚€ã“ã¨ã§ä½•ãŒã©ã†æ”¹å–„ã•ã‚ŒãŸã®ï¼Ÿ Hiveã¯ãƒ‡ã‚«ã„ãƒ‡ãƒ¼ã‚¿ã‚’ã‚´ãƒªã‚´ãƒªå–ã£ã¦ãã‚‹åˆ†ã«ã¯ SQLã¡ã‚‡ã£ã¨æ›¸ãã ã‘ã§æ¸ˆã‚€ã®ã§å¤§å¤‰ä¾¿åˆ©ã§ã™ãŒã€ åˆå‹•é…ã„ãŸã‚ã¡ã‚‡ã“ã¡ã‚‡ã“å°ã•ã„ãƒ‡ãƒ¼ã‚¿ã‚’ä½•åº¦ã‚‚å–ã‚ã†ã¨ã™ã‚‹ã¨ã‚¹ãƒˆãƒ¬ã‚¹æºœã¾ã‚Šã¾ã™ã€‚ ãã®ãŸã‚ã€ã“ã‚Œã¾ã§ã¯ã‚ã‚‹ç¨‹åº¦ã®ãƒ‡ãƒ¼ã‚¿ã‚’ã¾ã¨ã‚ã¦Hiveã§è½ã¨ã—ã¦ãã¦ Pythonã§åŠ å·¥ã—ã¦ã‹ã‚‰åˆ†æžã™ã‚‹ã¨ã„ã†æµã‚Œã‚’å–ã£ã¦ã„ã¾ã—ãŸã€‚ ãŸã åŠ å·¥ã™ã‚‹ãŸã‚ã«ä¼¼ãŸã‚ˆã†ãªã‚³ãƒ¼ãƒ‰ä½•
mfham 2013/12/27
hive

sqlite
ãƒªãƒ³ã‚¯
OSSã§æ”¯ãˆã‚‰ã‚Œã‚‹ãƒ©ã‚¤ãƒ–ãƒ‰ã‚¢ã®å·¨å¤§ãƒã‚°é›†è¨ˆ #nhntech
1. OSSã§æ”¯ãˆã‚‰ã‚Œã‚‹ ãƒ©ã‚¤ãƒ–ãƒ‰ã‚¢ã®å·¨å¤§ãƒã‚°é›†è¨ˆ - Hiveã¨Fluentd - ç¬¬2å›ž NHNãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ 2012/08/18 TAGOMORI Satoshi (@tagomoris) 12å¹´8æœˆ18æ—¥åœŸæ›œæ—¥
mfham 2012/08/18
hadoop

fluentd

hive
ãƒªãƒ³ã‚¯
HiveServerã§ãƒ•ã‚¡ã‚¤ãƒ«ãƒ‡ã‚£ã‚¹ã‚¯ãƒªãƒ—ã‚¿ãŒãƒªãƒ¼ã‚¯ã™ã‚‹ä»¶ã«ã¤ã„ã¦
@tagomorisã•ã‚“ãŒã“ã‚“ãªäº‹ã‚’è¨€ã£ã¦ã„ãŸã®ã§ã€èª¿ã¹ã¦ã¿ã¾ã—ãŸã€‚ ã¾ãšã¯ã€.pipeoutãƒ•ã‚¡ã‚¤ãƒ«ã«ã¤ã„ã¦ã€‚ çµè«–ã‹ã‚‰è¨€ã†ã¨ã€Hiveã®ä¸å…·åˆã§ã™ã€‚ ï¼ˆï¼ˆè¿½è¨˜ 2012/06/23 14:00ï¼‰Hiveã®ãƒ—ãƒã‚°ãƒ©ãƒ ã®æ›¸ãæ–¹ã¯è‰¯ããªã„ã‚“ã ã‘ã©ã€Leakã¯ã—ã¦ã„ãªã„ã¨æ€ã‚ã‚Œã¾ã™.ï¼‰ ã“ã®.pipeoutãƒ•ã‚¡ã‚¤ãƒ«ã¯SessionStateã®startãƒ¡ã‚½ãƒƒãƒ‰ã§Openã•ã‚Œã¾ã™ã€‚startãƒ¡ã‚½ãƒƒãƒ‰ã¯HiveServerã®å ´åˆã€ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆãŒã‚³ãƒã‚¯ã‚·ãƒ§ãƒ³ã‚’ã¯ã£ãŸæ™‚ã«ã‚³ãƒ¼ãƒ«ã•ã‚Œã¾ã™ã€‚(HiveSourceCodeReadingã®ç™ºè¡¨è³‡æ–™ã«ã‚‚ã¡ã‚‡ã£ã¨ã ã‘æ›¸ã„ã¦ã‚ã‚Šã¾ã™ã€‚) .pipeoutãƒ•ã‚¡ã‚¤ãƒ«ã¯HiveServerã§ã¯pipeInã¨ã„ã†å¤‰æ•°ã«ã‚ˆã£ã¦ã€BufferedReader -> FileReaderã‚’é€šã—ã¦å‚ç…§ã•ã‚Œã¾ã™ã€‚ â†“ã®ã‚ˆã†ãªæ„Ÿã˜ã€‚ pipeIn = new BufferedRead
mfham 2012/06/22
hive
ãƒªãƒ³ã‚¯
GitHub - tagomoris/shib: WebUI for query engines: Hive and Presto
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
mfham 2012/05/31
shib

hadoop

hive
ãƒªãƒ³ã‚¯
Hive Tools in NHN Japan #hadoopreading
1. Hive Tools in NHN Japan Hadoop Source Code Reading Vol.9 2012/05/30 @tagomoris (TAGOMORI Satoshi) 12å¹´5æœˆ30æ—¥æ°´æ›œæ—¥ 3. Hive in NHN Japan Reporting of access log (not analysis) Pageviews and/or Unique Users? Accesses under speciï¬ed condition? Hey, what numbers of accesses for our new features? new bot accesses? any troubles? 12å¹´5æœˆ30æ—¥æ°´æ›œæ—¥ 4. SELECT yyyymmdd, count(is_pc(pa)) as pc, count(is_smartphone(p
mfham 2012/05/31
hive
ãƒªãƒ³ã‚¯
Hive UDFã‚’è‡ªåˆ†ã§è¿½åŠ ã™ã‚‹ã¨ãã®æ³¨æ„ç‚¹ãƒ¡ãƒ¢ - ãŸã”ã‚‚ã‚Šã™ãƒ¡ãƒ¢
ãƒ¡ãƒ¢ã€‚CDH3u2 (hive-0.7.1-cdh3u2) ã§ã®è©±ã€‚ (1/23 HiveServerã«ã¤ã„ã¦ã„ãã¤ã‹è¿½è¨˜ã—ãŸ) Hiveã§è‡ªåˆ†ã§ã¤ãã£ãŸé–¢æ•°(User Defined Function: UDF)ã‚’ä½¿ã„ãŸã„ï¼ ã¨æ€ã„è‰±é›£è¾›è‹¦ã‚’ä¹—ã‚Šè¶ŠãˆJavaã®ã‚³ãƒ¼ãƒ‰ã‚’æ›¸ãjarã«ã¾ã¨ã‚ãŸã¨ã™ã‚‹ã€‚æ›¸ãã¾ã§ã®è©±ã¯Wikiã®è©²å½“ãƒšãƒ¼ã‚¸ãªã©ã‚’ç†Ÿèªã™ã‚‹ã®ãŒã‚ˆã‚ã—ã„ã€‚ ã§ã€ã˜ã‚ƒã‚ã©ã†ã‚„ã£ã¦Hiveèµ·å‹•æ™‚ã«èªã¿è¾¼ã‚ã°ã„ã„ã®ã€ã¨ã„ã†è©±ã€‚ add jarã‚³ãƒžãƒ³ãƒ‰ hiveã‚³ãƒžãƒ³ãƒ‰ã‚’èµ·å‹•ã™ã‚‹ãƒžã‚·ãƒ³ã®é©å½“ãªãƒ‡ã‚£ãƒ¬ã‚¯ãƒˆãƒªã«jarãƒ•ã‚¡ã‚¤ãƒ«ã‚’ç½®ãã€ãã®ãƒ‡ã‚£ãƒ¬ã‚¯ãƒˆãƒªã‚’ã‚«ãƒ¬ãƒ³ãƒˆãƒ‡ã‚£ãƒ¬ã‚¯ãƒˆãƒªã¨ã—ã¦hiveã‚’èµ·å‹•ã—ã¦ä»¥ä¸‹ã®ã‚³ãƒžãƒ³ãƒ‰ã‚’å®Ÿè¡Œã™ã‚‹ã€‚ hive> add jar udfclass.jar; hive> create temporary function myfunc as 'my.package.udf.Class
mfham 2012/05/31
hive
ãƒªãƒ³ã‚¯
1