[B! sql][HIVE] monnalisasmileã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

monnalisasmile id:monnalisasmile

sqlã¨HIVEã«é–¢ã™ã‚‹monnalisasmileã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (5)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Hadoopåˆ©ç”¨è€…ãªã‚‰ãã£ã¨çŸ¥ã£ã¦ã‚‹ã€Hive/Prestoã‚¯ã‚¨ãƒªé–¢æ•°ã®æŒ™å‹•ã®é•ã„ - Qiita
HiveQLã§ã¯ã‚¹ãƒ”ãƒ¼ãƒ‰ã«é›£ã‚’æ„Ÿã˜ã¦ã„ãŸãŸã‚ã€ç§ã‚‚Prestoã‚’ä½¿ã„å§‹ã‚ã¾ã—ãŸã€‚ MySQLã‚„Hiveã§ä½¿ã£ã¦ã„ãŸã‚¯ã‚¨ãƒªã‚’ç½®ãæ›ãˆã‚‹æ™‚ã«ãƒãƒžã£ãŸTipsã‚’ã¾ã¨ã‚ã¦ã„ãã¾ã™ã€‚ AWS Athenaã§Prestoã‚’ä½¿ã£ã¦ã„ã‚‹æ–¹ã‚‚å¢—ãˆã¦ã‚‹ã¨æ€ã†ã®ã§ã€Prestoæ¨™æº–é–¢æ•°ã§ã®è¨˜è¿°ä¾‹ã‚‚æ‹¡å……ã—ã¦ã„ãã¾ã™ã€‚ Prestoã¨ã¯ Prestoã¯ã‚ªãƒ³ãƒ¡ãƒ¢ãƒªã§å‹•ãåˆ†æ•£SQLã‚¨ãƒ³ã‚¸ãƒ³ã§ã€ãã®é€²åŒ–ã¯ç›®ã‚’è¦‹å¼µã‚‹ç‰©ã§ã™ã€‚ ç™ºè¡¨ã•ã‚ŒãŸå½“æ™‚ã¯è‰²ã€…ãªæˆç´„ãŒã‚ã‚Šä½¿ã†ã“ã¨ã‚’èºŠèº‡ã—ã¦ã„ã¾ã—ãŸãŒã€2015å¹´é ƒã‹ã‚‰ã¯ã‚‚ã†ä½¿ã‚ãªã„ç†ç”±ã¯ãªããªã‚Šã¾ã—ãŸã€‚ ã‚¢ãƒ‰ãƒ›ãƒƒã‚¯ã«ä½¿ãˆã‚‹ã¨ã¦ã‚‚é«˜é€ŸãªSQLã‚¨ãƒ³ã‚¸ãƒ³ã§ã™ã®ã§ã€ãƒãƒƒãƒå‘ã‘ã®Hiveã®ã‚ˆã†ã«å®Ÿè¡Œçµæžœã‚’å¾…ã¤æ™‚é–“ã¯ã»ã¨ã‚“ã©ã‚ã‚Šã¾ã›ã‚“ã€‚ Hiveã§ã™ã¨1ã¤1ã¤ã®å®Ÿè¡Œã«æ™‚é–“ãŒæŽ›ã‹ã‚‹ã®ã§ã€ã‚¯ã‚¨ãƒªã«æ…£ã‚Œã¦ã„ãªã„æ–°å‚è€…ã«ã¯è¾›ã„ç‰©ãŒã‚ã‚Šã¾ã—ãŸã€‚ ã—ã‹ã—Prestoã§ã¯ã‚¤ãƒ³ã‚¿ãƒ©ã‚¯ãƒ†ã‚£ãƒ–ã«å®Ÿè¡Œã§ãã¾ã™ã®ã§ã€ãƒˆãƒ©ã‚¤
monnalisasmile 2015/11/05
hadoop

Presto

MySQL

ã‚ã¨ã§èªã‚€

HIVE

SELECT

SQL
ãƒªãƒ³ã‚¯
SQLæ„Ÿè¦šã§HiveQLã‚’æ›¸ãã¨ç—›ã„ç›®ã«ã‚ã†ä¾‹ - still deeper
Hadoop Advent Calendar 2013 4æ—¥ç›®ã®è¨˜äº‹ã§ã™ tl;dr explainã¨job historyã‚’èªã‚ 1 reducerã¯æ‚ª data skewã¯æ‚ª å‰æ›¸ã ã¿ã‚“ãªå¤§å¥½ãSQLã§Hadoopä¸Šã§ã®å‡¦ç†ã‚’å®Ÿè¡Œã§ãã‚‹Hiveã«ã¯ã¿ãªã•ã‚“æ™®æ®µã‹ã‚‰ãŠä¸–è©±ã«ãªã£ã¦ã„ã‚‹ã“ã¨ã§ã—ã‚‡ã†ã€‚ã¡ã‚‡ã£ã¨èª¿ã¹ç‰©ã§ã‚°ã‚°ã‚‹åº¦ã«ç›®ã«å…¥ã‚‹æ„›ã‚‰ã„ã—ã„ãƒžã‚¹ã‚³ãƒƒãƒˆãŒã€è’ã‚“ã å¿ƒã«æ¸…æ¶¼ãªé¢¨ã‚’ã¯ã“ã‚“ã§ãã‚Œã¾ã™ã€‚ ã§ã™ãŒHiveã®ã‚¯ã‚¨ãƒªè¨€èªžã¯SQLã§ã¯ãªãHiveQLã§ã™ã—ã€å®Ÿè¡Œã‚¨ãƒ³ã‚¸ãƒ³ã‚‚RDBã®ãã‚Œã¨ã¯å…¨ãç•°ãªã‚‹MapReduceã§ã™ã€‚SQLã®ã¤ã‚‚ã‚Šã§HiveQLã‚’æ›¸ã„ã¦ã„ã‚‹ã¨åœ°é›·ã‚’è¸ã‚“ã§ã—ã¾ã†ã“ã¨ãŒã¾ã‚Œã«ã‚ˆãã‚ã‚Šã¾ã™ã€‚æœ¬ã‚¨ãƒ³ãƒˆãƒªã§ã¯é™¥ã‚ŠãŒã¡ãªHiveQLã®è½ã¨ã—ç©´ã‚’2ã¤ç´¹ä»‹ã—ã¾ã™ã€‚ ä¾‹1 SELECT count(DISTINCT user_id) FROM access_log SQLã«æ…£ã‚ŒãŸæ–¹ã§ã‚ã‚Œ
monnalisasmile 2014/06/12
ã»ã»ã†ã»ã†ã»ã†

hiveql

Hadoop

data

hive

history

mapreduce

map

sql

tuning

performance
ãƒªãƒ³ã‚¯
Apache Hive
Apache Hive The Apache Hive â„¢ is a distributed, fault-tolerant data warehouse system that enables analytics at a massive scale and facilitates reading, writing, and managing petabytes of data residing in distributed storage using SQL. Github Mail Docker Community Apache Hive is a distributed, fault-tolerant data warehouse system that enables analytics at a massive scale. Hive Metastore(HMS) provid
monnalisasmile 2013/09/04
project

hive

query

data

language

Hadoop

IT

analysis

SQL

*å‹‰å¼·
ãƒªãƒ³ã‚¯
Hadoopã‚’ã‚ˆã‚Šä¾¿åˆ©ã«ä½¿ã†ï¼Hiveã§ã®MapReduceã¾ã¨ã‚ - Y's note
ç›®æ¬¡ Hiveã¨ã¯ Hiveã®è¨å®š HiveQLæ§‹æ–‡(DDL) DataBase/SCHEMAã®ä½œæˆ Database/SCHEMAã®å‰Šé™¤ Tableã®ä½œæˆ Tableã®å‰Šé™¤ Tableåå¤‰æ›´ Partitionä½œæˆ Partitionã®å‰Šé™¤ Columnã®å¤‰æ›´ Columnã®è¿½åŠ /ç½®ãæ›ãˆ Tableã®Propertyå¤‰æ›´ SerDe Propertyã®è¿½åŠ HiveQLæ§‹æ–‡(SQL) ãƒ†ãƒ¼ãƒ–ãƒ«ä¸€è¦§è¡¨ç¤º ãƒ†ãƒ¼ãƒ–ãƒ«ã®å†…å®¹ã‚’è¡¨ç¤º åŸºæœ¬çš„ãªSELECTæ–‡ WHEREå¥(æ¡ä»¶æŒ‡å®š) DISTINCT(é‡è¤‡å‰Šé™¤) ORDER BY / SORT BYå¥(ã‚½ãƒ¼ãƒˆ) GROUP BYå¥(ã‚°ãƒ«ãƒ¼ãƒ—åŒ–) HAVINGå¥(ã‚°ãƒ«ãƒ¼ãƒ—åŒ–å¾Œã®æ¡ä»¶) LIMITå¥ JOIN(ãƒ†ãƒ¼ãƒ–ãƒ«çµåˆ) æŠ½å‡ºã‚«ãƒ©ãƒ ã‚’æ£è¦è¡¨ç¾ã§æŒ‡å®š UNION(çµæžœã®çµåˆ) SUBQUERY LOAD(ãƒ‡ãƒ¼ã‚¿ã®èªã¿è¾¼ã¿) Hiveã‚’ä½¿ã† äº‹å‰æº–å‚™
monnalisasmile 2013/07/29
hive

database

MapReduce

SQL

Hadoop

query

hiveql

cheat

HQL
ãƒªãƒ³ã‚¯
Hadoop â€“ Hiveã‚»ãƒƒãƒˆã‚¢ãƒƒãƒ— â€“ OpenGroove
monnalisasmile 2013/07/27
hive

hadoop

MapReduce

sql

ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«

ã‚µãƒ¼ãƒ“ã‚¹

DB

ãƒ‡ãƒ¼ã‚¿

RDBMS

site
ãƒªãƒ³ã‚¯
1