[B! hive] Glnã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

Gln id:Gln

hiveã«é–¢ã™ã‚‹Glnã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (3)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚° Hive
æœ¬æ›¸ã¯ã€Hadoopä¸Šã§SQLãƒ©ã‚¤ã‚¯ãªã‚¯ã‚¨ãƒªæ“ä½œã‚’å¯èƒ½ã«ã™ã‚‹Hiveã«ã¤ã„ã¦ã€åŸºç¤Žã‹ã‚‰å¿œç”¨ã¾ã§ã‚’è©³ç´°ã«è§£èª¬ã—ãŸæ›¸ç±ã§ã™ã€‚ãƒ‡ãƒ¼ã‚¿åž‹ã¨ãƒ•ã‚¡ã‚¤ãƒ«ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã€ã¾ãŸHiveQLã®ãƒ‡ãƒ¼ã‚¿å®šç¾©ã€æ“ä½œãªã©ã®åŸºç¤Žçš„ãªäº‹æŸ„ã‹ã‚‰ã€é–¢æ•°ã€ã‚¹ãƒˆãƒªãƒ¼ãƒŸãƒ³ã‚°ã€Thriftã‚µãƒ¼ãƒ“ã‚¹ã€ã•ã‚‰ã«AWSã‚„HCatalogãªã©ã®å¿œç”¨ã¾ã§ã€Hiveã«ã¤ã„ã¦å¿…è¦ãªäº‹æŸ„ã‚’è±Šå¯Œãªã‚µãƒ³ãƒ—ãƒ«ã¨ã¨ã‚‚ã«ã‚ã‹ã‚Šã‚„ã™ãè§£èª¬ã—ã¾ã™ã€‚ æ—¥æœ¬èªžç‰ˆã§ã¯ã€Microsoftã®ä½è—¤ç›´ç”Ÿæ°ã«ã‚ˆã‚‹ã€ŒWindows Azure HDInsight Serviceã€ã€Clouderaã®å¶‹å†…ç¿”æ°ã«ã‚ˆã‚‹ã€ŒCloudera Impalaã€ã€ã€ŒHive 0.10 ã®æ–°æ©Ÿèƒ½ã€ã€ã€ŒHiveServer2ã€ã‚’è¿½åŠ ã€‚ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã«é–¢å¿ƒã®ã‚ã‚‹ã™ã¹ã¦ã®ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã€å¿…æºã®ä¸€å†Šã§ã™ã€‚ è¨³è€…ã¾ãˆãŒã ã¯ã˜ã‚ã« 1ç« ã€€ã‚¤ãƒ³ãƒˆãƒãƒ€ã‚¯ã‚·ãƒ§ãƒ³ 1.1ã€€Hadoopã¨MapReduceã®æ¦‚è¦ 1.1.1
Gln 2013/10/28
Hadoop

hive

book

DB
ãƒªãƒ³ã‚¯
Hadoopå¾¹åº•å…¥é–€ã‚’èªã‚“ã - boscoworks.log
åˆå¿ƒè€…ãªã‚“ã§ã€ã¨ã‚Šã‚ãˆãšãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚°ã¨ã‹ã¯ãªã—ã§ã€æ¦‚è«–çš„ãªã¨ã“ã ã‘ã€‚ å…¥é–€æ›¸ã¨ã—ã¦ã¯ã“ã‚ŒãŒä¸€ç•ªã¨å‹§ã‚ã‚‰ã‚ŒãŸã®ã§èªã‚“ã ã®ã ã‘ã©ã€ã¨ã£ã‹ã‹ã‚Šã¨ã—ã¦ã¯ãªã‹ãªã‹åˆ†ã‹ã‚Šã‚„ã™ã‹ã£ãŸã¨æ€ã†ã€‚ ã¾ãå®Ÿéš›ã«æ‰‹ã‚’å‹•ã‹ã•ãªã„ã¨ä½•ã¨ã‚‚åˆ†ã‹ã‚“ãªã„ã¨ã“ã‚ã‚ã‚‹ã‘ã©ããƒ»ãƒ»ãƒ»ã€‚ ç¬¬1ç« Hadoop ã£ã¦ãªã‚“ãŸã‚™ã‚ã†? Hadoop ã¨ã¯ å¤§è¦æ¨¡ãªãƒ†ã‚™ãƒ¼ã‚¿ã‚’å‡¦ç†ã™ã‚‹ãŸã‚ã®ä¸¦åˆ—åˆ†æ•£å‡¦ç†åŸºç›¤ ãƒ†ãƒ©ãƒã‚™ã‚¤ãƒˆãƒ»ãƒ˜ã‚šã‚¿ãƒã‚™ã‚¤ãƒˆã‚¯ãƒ©ã‚¹ã®ãƒ†ã‚™ãƒ¼ã‚¿ã«å¯¾ã—ã¦ã€åŒã—ã‚™å‡¦ç†ã‚’è¤‡æ•°ã®ã‚µãƒ¼ãƒã‚™ã¦ã‚™åŒæ™‚ã«å‡¦ç†ã¦ã‚™ãã‚‹ Hadoop ã®æ¦‚è¦ ãƒã‚¯ã‚™è§£æžã€ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ†ã‚™ãƒ¼ã‚·ãƒ§ãƒ³ã‚¨ãƒ³ã‚·ã‚™ãƒ³ã€æ¤œç´¢ã‚¨ãƒ³ã‚·ã‚™ãƒ³ãªã¨ã‚™ã¦ã‚™ç”¨ã„ã‚‰ã‚Œã‚‹ã‚±ãƒ¼ã‚¹ã‹ã‚™å¤šã„ å¤§è¦æ¨¡ãƒ†ã‚™ãƒ¼ã‚¿å¯¾è±¡ã®ãƒã‚™ãƒƒãƒå‡¦ç†å‘ã Hadoop ã‹ã‚™æä¾›ã™ã‚‹æ©Ÿèƒ½æ¦‚è¦ ãƒãƒ¼ãƒˆã‚™ãƒ†ã‚™ã‚£ã‚¹ã‚¯ãƒ»ãƒãƒ¼ãƒˆã‚™ã‚¦ã‚§ã‚¢ã‚’è¤‡æ•°ä¸¦ã¸ã‚™ã¦åŒæ™‚ã«åˆ©ç”¨ã¦ã‚™ãã‚‹ä»•çµ„ã¿ åˆ†æ•£å‡¦ç†ã¦ã‚™å…±é€šã—ã¦ä½¿ã†æ©Ÿèƒ½ Hadoop ã®é©ç”¨é ˜åŸŸ RD
Gln 2013/03/07
hadoop

hive
ãƒªãƒ³ã‚¯
Hadoop Pig ã®ä½¿ã„ã©ã“ã‚ - Tech-Sketch
ã€ŒPigã¨Hiveä½•ãŒé•ã†ã®ï¼Ÿã€ ã€ŒDifference between Pig and Hive? Why have both?(Pigã¨Hiveä½•ãŒé•ã†ã®ï¼Ÿ)ã€ ã¨ã„ã†è³ªå•ã‚’ã€å…ˆæ—¥ã€StackOverFlowã§è¦‹ã‹ã‘ã¾ã—ãŸã€‚æã‚‰ãHadoopã‚’è§¦ã‚‹ã¨ä¸€åº¦ã¯ç–‘å•ã«æ€ã†äº‹ã§ã¯ã§ã¯ãªã„ã§ã—ã‚‡ã†ã‹ã€‚ Pigã¨Hiveã¯ã€å…±ã«SQLãƒ©ã‚¤ã‚¯ãªè¨˜æ³•ã§MapReduceã‚’æ›¸ã‘ã‚‹DSLã§ã™ãŒã€åˆ©ç”¨è€…æ•°ã«ãŠã„ã¦ã¯Hiveã«è»é…ãŒä¸ŠãŒã£ã¦ã„ã‚‹ã‚ˆã†ã«ã¿ãˆã¾ã™ã€‚ ä¸€æ–¹ã§ã€ã€ŒPigã‚’ã‚‚ã£ã¨æ—©ãè©¦ã›ã°è‰¯ã‹ã£ãŸã€ã¨ã„ã†ãŠè©±ã‚’ä¼ºã†ã“ã¨ã‚‚ã‚ã‚Šã€æœ‰ç”¨ï¼ˆã‹ã‚‚ã—ã‚Œãªã„ï¼‰ãƒ„ãƒ¼ãƒ«ã§ã‚ã‚Œã°ã€æ£ã—ãç†è§£ã—ã¦ãŠã„ãŸæ–¹ãŒã‚ˆã•ãã†ã§ã™ã€‚ ã¨ã„ã†ã‚ã‘ã§ã€ã“ã“ã§ã¯Pigã®æ´»ç”¨ã‚’æŽ¢ã‚Šã¾ã™ã€‚ Pigã®æ€§èƒ½ PigãŒä»Šä¸€ã¤åˆ©ç”¨ã•ã‚Œã¦ã„ãªã„ã®ã¯ã€SQLã¨ã®è¦ªå’Œæ€§ã«åŠ ãˆã€æ€§èƒ½é¢ã§ã€ã€ŒJava MapReduceï¼žHiveï¼žPigã€ã¨ã„ã†å‚¾å‘ãŒã‚ã‚‹ã‹ã‚‰ã§
Gln 2013/03/07
Hadoop

pig

hive

æ¯”è¼ƒ
ãƒªãƒ³ã‚¯
1

ãŠçŸ¥ã‚‰ã›

ã‚‚ã£ã¨èªã‚€

å…¬å¼Twitter

@hatebu
æœ€æ–°ã®äººæ°—ã‚¨ãƒ³ãƒˆãƒªãƒ¼ã®é…ä¿¡

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

jæ¬¡ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

kå‰ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

lã‚ã¨ã§èªã‚€

eã‚³ãƒ¡ãƒ³ãƒˆä¸€è¦§ã‚’é–‹ã

oãƒšãƒ¼ã‚¸ã‚’é–‹ã

è¨å®šã‚’å¤‰æ›´ã—ã¾ã—ãŸx

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

ã‚¿ã‚°

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (6)

hiveã«é–¢ã™ã‚‹Glnã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (3)

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´1æœˆç¬¬2é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2024å¹´12æœˆï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´1æœˆç¬¬1é€±ï¼‰

å…¬å¼Twitter

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹

ã‚¿ã‚°

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (6)

hiveã«é–¢ã™ã‚‹Glnã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (3)

ãƒ—ãƒ­ã‚°ãƒ©ãƒŸãƒ³ã‚° Hive

Hadoopå¾¹åº•å…¥é–€ã‚’èª­ã‚“ã - boscoworks.log

Hadoop Pig ã®ä½¿ã„ã©ã“ã‚ - Tech-Sketch

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2025å¹´1æœˆç¬¬2é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2024å¹´12æœˆï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2025å¹´1æœˆç¬¬1é€±ï¼‰

å…¬å¼Twitter

ã‚­ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (6)

hiveã«é–¢ã™ã‚‹Glnã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (3)

ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚° Hive

Hadoopå¾¹åº•å…¥é–€ã‚’èªã‚“ã - boscoworks.log

Hadoop Pig ã®ä½¿ã„ã©ã“ã‚ - Tech-Sketch

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´1æœˆç¬¬2é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2024å¹´12æœˆï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´1æœˆç¬¬1é€±ï¼‰

å…¬å¼Twitter

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹