[B! athena] dannã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

dann id:dann

athenaã«é–¢ã™ã‚‹dannã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (13)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Very cool ã‚‰ã—ã„ AthenaCLI ã‚’è©¦ã—ã¦ã¿ãŸã‚‰ã€ã‚„ã£ã±ã‚Šã‚¯ãƒ¼ãƒ«ã ã£ãŸä»¶ | DevelopersIO
ã¯ã˜ã‚ã« Very cool ã‚‰ã—ã„ AthenaCLI ã‚’è¦‹ã¤ã‘ã¦ã—ã¾ã£ãŸã®ã§ã€æ—©é€Ÿè©¦ã—ã¦ã¿ãŸã„ã¨æ€ã„ã¾ã™ã€‚ Very cool: AthenaCLI - Command line interface to Amazon Athena - https://t.co/YAlghX2Upo (found on Awesome AWS - https://t.co/GaoWeC9Ntq) pic.twitter.com/abA2J8eMaO â€” Jeff Barr â˜ï¸ (@jeffbarr) October 18, 2018 å°Žå…¥ ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ« ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã—ãŸç’°å¢ƒã¯ã€macOS High Sierra / ãƒãƒ¼ã‚¸ãƒ§ãƒ³10.13.6ã€python3.6ã§ã™ã€‚dbcli/athenacliã«æ›¸ã„ã¦ã‚ã‚‹ã¨ãŠã‚Šã€pipã§ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã—ã¾ã™ã€‚ $ pip install athenacli Coll
dann 2018/10/20
aws

athena
ãƒªãƒ³ã‚¯
S3ã®ã‚¢ãƒƒãƒ—ãƒãƒ¼ãƒ‰ã‚¤ãƒ™ãƒ³ãƒˆã§AWS Athenaã®ãƒ‘ãƒ¼ãƒ†ã‚£ã‚·ãƒ§ãƒ³ã‚’è¨å®šã—ã¦ã¿ãŸ | DevelopersIO
ã¯ã˜ã‚ã« DIéƒ¨ã®ãŠãŠãŸãã§ã™ã€‚AWS Athenaã‚’ä½¿ã†éš›ã«S3ä¸Šã®ãƒ•ã‚¡ã‚¤ãƒ«æ•°ãŒå¤šããªã‚‹ã‚ˆã†ãªã‚‰ãƒ‘ãƒ¼ãƒ†ã‚·ãƒ§ãƒ³ã®æ©Ÿèƒ½ã¯å¿…é ˆã§ã™ã€‚ S3ã«Hiveãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã®ãƒ‘ã‚¹ã§ã‚¢ãƒƒãƒ—ãƒãƒ¼ãƒ‰ã•ã‚Œã¦ã„ã‚Œã°ãƒ‘ãƒ¼ãƒ†ã‚·ãƒ§ãƒ³ã®è¨å®šã¯ä¸è¦ã§ã™ãŒãã†ã§ãªã„å ´åˆã‚‚ã‚ã‚‹ã¨æ€ã„ã¾ã™ã€‚ ãã®å ´åˆã¯ã‚¢ãƒƒãƒ—ãƒãƒ¼ãƒ‰ã•ã‚ŒãŸãƒ‘ã‚¹ã«å¯¾ã—ã¦alter tableã§ãƒ‘ãƒ¼ãƒ†ã‚·ãƒ§ãƒ³ã‚’è¿½åŠ ã™ã‚‹å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚ ãƒ‘ãƒ¼ãƒ†ã‚·ãƒ§ãƒ³ã«ã¤ã„ã¦ã¯ã“ã¡ã‚‰ã®è¨˜äº‹ã«è©³ã—ãè¨˜è¼‰ãŒã‚ã‚‹ã®ã§å‚ç…§ã—ã¦ãã ã•ã„ã€‚ ãã“ã§ä»Šå›žã€S3ã«ãƒ•ã‚¡ã‚¤ãƒ«ãŒã‚¢ãƒƒãƒ—ãƒãƒ¼ãƒ‰ã•ã‚ŒãŸã‚¤ãƒ™ãƒ³ãƒˆã‚’ãƒˆãƒªã‚¬ãƒ¼ã«AWS Lambdaã§ãƒ‘ãƒ¼ãƒ†ã‚·ãƒ§ãƒ³ã‚’è¨å®šã™ã‚‹ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’æ›¸ã„ã¦ã¿ã¾ã—ãŸã€‚ å®Ÿè£…ã—ã¦ã¿ã‚‹ Athenaã¸ã®ã‚¢ã‚¯ã‚»ã‚¹ã¯ç™ºè¡¨å½“åˆã¯jdbcæŽ¥ç¶šã«å¯¾å¿œã—ã¦ã„ã¾ã—ãŸãŒã€ç¾åœ¨ã¯pythonã®boto3ã‹ã‚‰ã‚‚æŽ¥ç¶šå¯èƒ½ã¨ãªã£ã¦ã„ã¾ã™ã€‚ãã®ãŸã‚ä»Šå›žã¯pythonã§å®Ÿè£…ã—ã¦ã¿ã¾ã—ãŸã€‚ ã¾ãšã€ã‚¢ãƒƒãƒ—ãƒãƒ¼ãƒ‰ã™ã‚‹ãƒ•ã‚¡ã‚¤ãƒ«ã®S3
dann 2018/03/06
s3

athena

lambda
ãƒªãƒ³ã‚¯
Amazon Kinesis Firehose, Amazon Athena, Amazon QuickSightã‚’ç”¨ã„ãŸVPCãƒ•ãƒãƒ¼ãƒã‚°ã®åˆ†æž | Amazon Web Services
Amazon Web Services ãƒ–ãƒã‚° Amazon Kinesis Firehose, Amazon Athena, Amazon QuickSightã‚’ç”¨ã„ãŸVPCãƒ•ãƒãƒ¼ãƒã‚°ã®åˆ†æž å¤šãã®æ¥å‹™ã‚„é‹ç”¨ã«ãŠã„ã¦ã€é »ç¹ã«æ›´æ–°ã•ã‚Œã‚‹å¤§è¦æ¨¡ãªãƒ‡ãƒ¼ã‚¿ã‚’åˆ†æžã™ã‚‹ã“ã¨ãŒæ±‚ã‚ã‚‰ã‚Œã‚‹ã‚ˆã†ã«ãªã£ã¦ã„ã¾ã™ã€‚ä¾‹ãˆã°ãƒã‚°åˆ†æžã«ãŠã„ã¦ã¯ã€æŒ¯ã‚‹èˆžã„ã®ãƒ‘ã‚¿ãƒ¼ãƒ³ã‚’èªè˜ã—ãŸã‚Šã€ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã®ãƒ•ãƒãƒ¼åˆ†æžã‚’ã—ãŸã‚Šã€éšœå®³èª¿æŸ»ã‚’ã—ãŸã‚Šã™ã‚‹ãŸã‚ã«å¤§é‡ã®ãƒã‚°ã®å¯è¦–åŒ–ãŒå¿…è¦ã¨ã•ã‚Œã¾ã™ã€‚ VPCãƒ•ãƒãƒ¼ãƒã‚°ã¯Amazon VPCã‚µãƒ¼ãƒ“ã‚¹å†…ã®VPCã«å±žã™ã‚‹ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ã‚¤ãƒ³ã‚¿ãƒ¼ãƒ•ã‚§ãƒ¼ã‚¹ã‚’è¡Œãæ¥ã™ã‚‹IPãƒˆãƒ©ãƒ•ã‚£ãƒƒã‚¯æƒ…å ±ã‚’ã‚ãƒ£ãƒ—ãƒãƒ£ã—ã¾ã™ã€‚ã“ã®ãƒã‚°ã¯VPCå†…éƒ¨ã«æ½œã‚€è„…å¨ã‚„ãƒªã‚¹ã‚¯ã‚’èªè˜ã—ãŸã‚Šã€ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ã®ãƒˆãƒ©ãƒ•ã‚£ãƒƒã‚¯ãƒ»ãƒ‘ã‚¿ãƒ¼ãƒ³ã‚’èª¿æŸ»ã™ã‚‹ã®ã«å½¹ç«‹ã¡ã¾ã™ã€‚ãƒ•ãƒãƒ¼ãƒã‚°ã¯Amazon CloudWatchãƒã‚°ã«æ ¼ç´ã•ã‚Œã¾ã™ã€‚ã„ã£ãŸã‚“ãƒ•ãƒãƒ¼ãƒã‚°ã‚’
dann 2018/01/18
athena

aws
ãƒªãƒ³ã‚¯
Kinesis Firehose & s3 & Athenaã§ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿å‡¦ç†ï¼ - Qiita
èƒŒæ™¯ ãƒ¦ãƒ¼ã‚¶ãƒ¼ã‹ã‚‰é€ã‚‰ã‚Œã¦ããŸå¤§é‡ã®ä½ç½®æƒ…å ±ãƒã‚°ã‚’postgresqlã«ä¿å˜ã™ã‚‹ã®ãŒã¤ã‚‰ããªã£ã¦ããŸã®ã§s3ã«æŠ•ã’ã¦å‡¦åˆ†ã™ã‚‹ã‚ˆã†ã«ã—ãŸã„ã€‚ ã‘ã‚Œã©ã‚‚fluentdã‚’å…¥ã‚ŒãŸaws-ec2ã‚’ãƒã‚°ã‚¢ã‚°ãƒªã‚²ãƒ¼ã‚¿ã«ã—ã¦ã‚¹ã‚±ãƒ¼ãƒ«ã•ã›ã‚‹ã®ã¯é¢å€’ã€‚ ã‘ã‚Œã©ã‚‚ã€å®Ÿè¨¼å®Ÿé¨“ã‚„å–¶æ¥è³‡æ–™ã®ä½œæˆã®ãƒ‹ãƒ¼ã‚ºãŒå¤šã„ãŸã‚s3ã«æŠ•ã’ãŸãƒã‚°ã¯å¼•ãç¶šãRDBMSã®ã‚ˆã†ãªä½•ã‹ã§æ°—è»½ã«æ¤œç´¢ï¼†é›†è¨ˆã§ãã‚‹ã‚ˆã†ã«ã—ãŸã„ã€‚ æ§‹æˆ ä»¥ä¸‹ã®ã‚ˆã†ã«ã€ã‚µãƒ¼ãƒ“ã‚¹ã‹ã‚‰æŠ•ã’ãŸãƒã‚°ã‚’KinesisFirehoseãŒå—ã‘å–ã£ã¦s3ã«ä¿å˜ã—ã€Athenaã§æ¤œç´¢ã™ã‚‹ã‚ˆã†ã«ã—ã¾ã—ãŸã€‚ å®Ÿè£…ã¨ãƒãƒžã‚Šã©ã“ã‚ KinesisFirehose ãƒã‚°å‡¦ç†ã«ç‰¹åŒ–ã—ãŸã‚µãƒ¼ãƒ“ã‚¹ã§ã€æµã—è¾¼ã‚“ã ãƒ‡ãƒ¼ã‚¿ã‚’å¡Šã«ã—åœ§ç¸®ã—ã¦redshiftã€s3ã€elastic searchã®ã„ãšã‚Œã‹ã«æŠ•ã’ã‚‹ã“ã¨ãŒã§ãã‚‹ã€‚ç‰¹å¾´ã¯è² è·ã«å¿œã˜ãŸåŒæ™‚å®Ÿè¡Œæ•°ã‚„ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹æ•°ã®ä¸Šé™ç‰ã‚’èª¿æ•´ã™ã‚‹å¿…è¦ãŒãªãã€ä½¿ç”¨è€…ãŒã‚¹ã‚±ãƒ¼
dann 2018/01/18
athena

kinesis
ãƒªãƒ³ã‚¯
ç¾å ´ã§é‹ç”¨ã™ã‚‹è¦–ç‚¹ã‹ã‚‰è¦‹ãŸ Amazon Athena - Qiita
å€‹äººçš„ãªãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã‚‚å«ã‚ã€ã„ãã¤ã‹ã®ç¾å ´ã§ Amazon Athena ã«ã¤ã„ã¦è§¦ã‚Œã‚‹æ©Ÿä¼šãŒã‚ã£ãŸã®ã§ã€å€‹äººçš„ã«æ€ã†ã¨ã“ã‚ã«ã¤ã„ã¦è¨˜è¼‰ã—ã¾ã™ã€‚ æ•°æ™‚é–“ã§æ›¸ã„ãŸé›‘ãªæ–‡ç« ã§ã™ãŒã€ã”äº†æ‰¿ãã ã•ã„ã€‚ ãªãŠã€å…ˆæ—¥ãƒªãƒªãƒ¼ã‚¹ã•ã‚ŒãŸ Amazon Athena API ã«ã¤ã„ã¦ã¯ä»¥ä¸‹ã® Qiita ã« first impression ã‚’ã¾ã¨ã‚ã¦ã„ã‚‹ã®ã§ã€ API ä»¥å¤–ã®è©±é¡Œã«ã¤ã„ã¦æ›¸ãã¾ã™ã€‚ Amazon Athena ã® API ã‚’ä½¿ã£ã¦ã¿ãŸ (2017/05) ãƒ‡ãƒ¼ã‚¿ã®è¨è¨ˆã«ã¤ã„ã¦ Amazon Athena ã¯ managed ãª Presto ç’°å¢ƒã§ã€ äº‹å‰ã« Presto ã‚µãƒ¼ãƒãƒ¼ã®ç«‹ã¡ä¸Šã’ãªã©ãƒªã‚½ãƒ¼ã‚¹ç¢ºä¿ã‚’è¡Œã‚ãªãã¦ã‚‚è‰¯ã„ ãƒ‡ãƒ¼ã‚¿ã«ã¤ã„ã¦ã‚‚ã€S3 ã«ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ã‚¢ãƒƒãƒ—ã•ãˆã™ã‚Œã°ã€å¾Œä»˜ã§ã„ã‹ã‚ˆã†ã«ã§ã‚‚ãƒ‡ãƒ¼ã‚¿ã®è§£æžãŒå‡ºæ¥ã‚‹ ã¨ã„ã†æ‰‹è»½ã•ã‚’å£²ã‚Šã«ã•ã‚Œã¦ã„ã¾ã™ã€‚ ã“ã‚Œã¯åˆ©ç‚¹ã¨ã—ã¦ã„ã£ã•ã„é–“é•ã„ã§ã¯ãª
dann 2017/11/25
athena

aws
ãƒªãƒ³ã‚¯
Amazon Athena ã®ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚° Tips ãƒˆãƒƒãƒ— 10 | Amazon Web Services
Amazon Web Services ãƒ–ãƒã‚° Amazon Athena ã®ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚° Tips ãƒˆãƒƒãƒ— 10 2024 å¹´ 2 æœˆã«æ›´æ–°ã•ã‚ŒãŸåŽŸæ–‡ã‚’æ—¥æœ¬èªžç‰ˆã¨ã—ã¦ 9 æœˆã«åæ˜ ã—ã¾ã—ãŸï¼š ã“ã®è¨˜äº‹ã¯ã€ã‚³ã‚¹ãƒˆãƒ™ãƒ¼ã‚¹ã®æœ€é©åŒ–ã¨ã‚¯ã‚¨ãƒªçµæžœã®å†åˆ©ç”¨ã‚’å«ã‚€ Amazon Athena ã‚¨ãƒ³ã‚¸ãƒ³ãƒãƒ¼ã‚¸ãƒ§ãƒ³ 3 ã®å¤‰æ›´ã‚’åæ˜ ã™ã‚‹ãŸã‚ã«ç¢ºèªãŠã‚ˆã³æ›´æ–°ã•ã‚Œã¾ã—ãŸã€‚ Amazon Athena ã¯ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã«åŸºã¥ã„ãŸå¯¾è©±åž‹åˆ†æžã‚µãƒ¼ãƒ“ã‚¹ã§ã€æ¨™æº–ã® SQL ã‚’ä½¿ã£ã¦ Amazon Simple Storage Service (Amazon S3) ã«æ ¼ç´ã•ã‚ŒãŸã‚ªãƒ¼ãƒ—ãƒ³ãƒ†ãƒ¼ãƒ–ãƒ«ãŠã‚ˆã³ãƒ•ã‚¡ã‚¤ãƒ«å½¢å¼ã®ãƒ‡ãƒ¼ã‚¿ã‚’ç°¡å˜ã«åˆ†æžã§ãã¾ã™ã€‚Athena ã¯ã‚µãƒ¼ãƒãƒ¼ãƒ¬ã‚¹ãªã®ã§ã€ã‚¤ãƒ³ãƒ•ãƒ©ã‚¹ãƒˆãƒ©ã‚¯ãƒãƒ£ã®ç®¡ç†ã¯ä¸è¦ã§ã€å®Ÿè¡Œã—ãŸã‚¯ã‚¨ãƒªã«å¯¾ã—ã¦ã®ã¿æ–™é‡‘ã‚’æ”¯æ‰•ã„ã¾ã™ã€‚Athena ã¯ä½¿ã„ã‚„ã™ãã€Ama
dann 2017/11/10
aws

athena

performance
ãƒªãƒ³ã‚¯
AWS Solutions Architect ãƒ–ãƒã‚°
ã“ã‚“ã«ã¡ã¯ã€SAã®èˆŸå´Žã§ã™ã€‚ 2017/10/25ã«é–‹å‚¬ã•ã‚Œã¾ã—ãŸã‚ªãƒ³ãƒ©ã‚¤ãƒ³ãƒãƒ³ã‚ºã‚ªãƒ³ã€ŒAmazon Athena åˆå¿ƒè€…å‘ã‘ãƒãƒ³ã‚ºã‚ªãƒ³ã€ã®è³‡æ–™ãŒå…¬é–‹ã•ã‚Œã¾ã—ãŸã€‚å½“æ—¥å‚åŠ è€…ã®çš†æ§˜ã‹ã‚‰é ‚ã„ãŸQAã¨åˆã‚ã›ã¦ã”ç´¹ä»‹ã„ãŸã—ã¾ã™ã€‚ Q: åˆ—æ€è€ƒãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆï¼†åœ§ç¸®ã€ã®ã‚¹ãƒ©ã‚¤ãƒ‰(p17)ã®ã€Œåœ§ç¸®ã€ã¨ã¯ãƒ•ã‚¡ã‚¤ãƒ«åœ§ç¸®ã¨ã„ã†æ„å‘³ã§ã—ã‚‡ã†ã‹ï¼Ÿãã‚Œã¨ã‚‚æƒ…å ±ã®åœ§ç¸®ã¨ã„ã†æ„å‘³ã§ã—ã‚‡ã†ã‹ï¼Ÿ A: ã“ã¡ã‚‰ã¯ãƒ•ã‚¡ã‚¤ãƒ«ã®åœ§ç¸®ã¨ã„ã†æ„å‘³ã«ãªã‚Šã¾ã™ï¼Ž Q:ãƒ‘ãƒ¼ãƒ†ã‚£ã‚·ãƒ§ãƒ³ã®ä¾‹ã§ã€S3ãƒ‘ã‚¹ã‚’ã€Œ/year=2016/month=04/day=01/ã€ã¨ã„ã†å½¢å¼ã«ã—ã¦ã¾ã—ãŸãŒã€ã€Œ/2016/04/01/ã€ã¨ã„ã†å½¢å¼ã®ãƒ‘ã‚¹ã«ã¯é©ç”¨ã§ããªã„ã®ã§ã—ã‚‡ã†ã‹ï¼Ÿ A: ã“ã¡ã‚‰ã®å½¢ã§ã‚‚é©ç”¨å¯èƒ½ã§ã™ï¼Žä»¥ä¸‹ã®å…¬å¼ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã‚’ã”ç¢ºèªãã ã•ã„ http://docs.aws.amazon.com/athena/latest/ug/partitions.ht
dann 2017/11/03
aws

athena
ãƒªãƒ³ã‚¯
Amazon Athenaã®ãƒ‘ãƒ¼ãƒ†ã‚£ã‚·ãƒ§ãƒ³ã‚’ç†è§£ã™ã‚‹ #reinvent | DevelopersIO
ã‚³ãƒ³ãƒ‹ãƒãƒã€åƒè‘‰ã§ã™ã€‚Amazon Athenaã‚’åˆ©ç”¨ã™ã‚‹ä¸Šã§é‡è¦ã«ãªã£ã¦ãã‚‹ãƒ‘ãƒ¼ãƒ†ã‚£ã‚·ãƒ§ãƒ³ã«ã¤ã„ã¦æ›¸ããŸã„ã¨æ€ã„ã¾ã™ã€‚ ãƒ‘ãƒ¼ãƒ†ã‚£ã‚·ãƒ§ãƒ³ã®é‡è¦æ€§ Athenaã§ãƒ‘ãƒ¼ãƒ†ã‚£ã‚·ãƒ§ãƒ³ã‚’æŒ‡å®šã™ã‚‹ã“ã¨ã§ã€å„ã‚¯ã‚¨ãƒªã§ç‰¹å®šã®é ˜åŸŸã«å¯¾ã™ã‚‹ã‚¹ã‚ãƒ£ãƒ³ã‚’å®Ÿè¡Œã§ãã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã™ã€‚ä¾‹ãˆã°ã€S3ä¸Šã®ãƒ‡ãƒ¼ã‚¿ãŒs3://applog/YYYY/MM/DD/HHã®ã‚ˆã†ãªå½¢ã§S3ã¸ä¿å˜ã™ã‚‹ã¨ã—ã¾ã™ã€‚ ãƒ‘ãƒ¼ãƒ†ã‚£ã‚·ãƒ§ãƒ³ã‚’æŒ‡å®šã™ã‚‹ã“ã¨ã§ã€æ¤œç´¢æ™‚ã«ç‰¹å®šã®æ—¥ä»˜é…ä¸‹ã®ãƒ‡ãƒ¼ã‚¿ã ã‘ã‚¹ã‚ãƒ£ãƒ³ã™ã‚‹ã“ã¨ãŒã§ãã‚‹ã®ã§ã€ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ãŒå‘ä¸Šã—ã¾ã™ã€‚ã¾ãŸã€ã‚¹ã‚ãƒ£ãƒ³ã™ã‚‹ãƒ‡ãƒ¼ã‚¿é‡ã‚‚æ¸›ã‚‹ãŸã‚ã€ã‚³ã‚¹ãƒˆã‚‚å‰Šæ¸›ã§ãã¾ã™ã€‚ ãƒ‘ãƒ¼ãƒ†ã‚£ã‚·ãƒ§ãƒ³ã‚’è¨å®šã™ã‚‹ ãƒ‘ãƒ¼ãƒ†ã‚£ã‚·ãƒ§ãƒ³ã‚’è¨å®šã™ã‚‹ã«ã¯ã€ãƒ†ãƒ¼ãƒ–ãƒ«ä½œæˆæ™‚ã«PARTITIONED BYã‚’æŒ‡å®šã—ã¦åˆ†å‰²ã™ã‚‹ã‚ãƒ¼ã‚’æŒ‡å®šã—ã¾ã™ã€‚ãƒ‘ãƒ¼ãƒ†ã‚£ã‚·ãƒ§ãƒ³ã‚’è¿½åŠ ã™ã‚‹å ´åˆã€ä»¥ä¸‹ã®2ã¤ã®ã‚·ãƒŠãƒªã‚ªãŒã‚ã‚Šã¾ã™ã€‚ S3ä¸Šã«æ ¼ç´ã•ã‚Œã¦ã„ã‚‹ãƒ‡ãƒ¼ã‚¿ãŒæ—¢ã«Hiveãƒ•ã‚©
dann 2017/10/17
athena

aws
ãƒªãƒ³ã‚¯
å®Ÿç”¨çš„ãªALBã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ç”¨ã®AthenaDDL - Qiita
CREATE EXTERNAL TABLE IF NOT EXISTS table_name ( type string, request_timestamp string, elb_name string, client_addr string, client_port int, target_addrport string, target_addr string, target_port int, request_processing_time double, target_processing_time double, response_processing_time double, elb_status_code int, target_status_code string, received_bytes int, sent_bytes int, request_method st
dann 2017/08/21
athena
ãƒªãƒ³ã‚¯
Kinesis Firehoseã€Athenaã€QuickSightã‚’åˆ©ç”¨ã—ãŸãƒ‡ãƒ¼ã‚¿é›†ç©åŸºç›¤ã®æ§‹ç¯‰ - Speee DEVELOPER BLOG
Speeeé–‹ç™ºåŸºç›¤éƒ¨ã€å…¼ãƒŒãƒªã‚«ã‚¨ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®æ£®å²¡ã§ã™ã€‚ 2017å¹´6æœˆ2æ—¥ã«è¡Œã‚ã‚ŒãŸJAWS-UGå‹‰å¼·ä¼šã€AWS Summit Tokyo 2017ã€‘ã«ã¦ã€å¼Šç¤¾Speeeã‚ˆã‚Š hatappi ã¨ç§ãŒç™ºè¡¨ã•ã›ã¦é ‚ãã¾ã—ãŸã€‚ ç§ãŒç™ºè¡¨ã—ãŸå†…å®¹ã¯Kinesis Firehose, Athena, QuickSightã‚’ä½¿ã£ã¦ã€ãƒ‡ãƒ¼ã‚¿é›†ç©åŸºç›¤ã‚’ä½œã‚‹ã€‚ã¨ã„ã†ã‚‚ã®ã§ã™ã€‚ã‚¹ãƒ©ã‚¤ãƒ‰ã¯ã“ã¡ã‚‰ã«ãªã‚Šã¾ã™ã€‚ speakerdeck.com ä»Šå›žã¯ã€ã“ã®ç™ºè¡¨å†…å®¹ã«ã¤ã„ã¦ã€è£œè¶³æƒ…å ±ã‚’è¿½åŠ ã—ã¦ãŠè©±ã‚’ã•ã›ã¦é ‚ãã¾ã™ã€‚ Kinesis Firehoseã€Athenaã€QuickSightã‚’åˆ©ç”¨ã—ãŸãƒ‡ãƒ¼ã‚¿å¯è¦–åŒ–ãƒ„ãƒ¼ãƒ«ã®ï¼‘ã¤ã®å®Ÿè£…ä¾‹ã¨ã—ã¦è¦‹ã¦é ‚ã‘ã‚Œã°ã¨æ€ã„ã¾ã™ã€‚ æœ€åˆã« å¼Šç¤¾Speeeã§ã¯ã€ãƒŒãƒªã‚«ã‚¨ã¨ã„ã†å¤–å£å¡—è£…ã®ä¸€æ‹¬è¦‹ç©ã‚‚ã‚Šã‚µãƒ¼ãƒ“ã‚¹ã‚’é‹ç”¨ã—ã¦ã„ã¾ã™ã€‚ å¤–å£å¡—è£…ã‚’æœ›ã¾ã‚Œã¦ã„ã‚‹ãŠå®¢æ§˜ã«ãƒ’ã‚¢ãƒªãƒ³ã‚°ã‚’è¡Œã„ã€ãŠå®¢æ§˜ã®çŠ¶æ³ã«åˆã‚ã›ã¦é©
dann 2017/08/16
athena

kinesisfirehose
ãƒªãƒ³ã‚¯
GCE BigQuery vs AWS Redshift vs AWS Athena - gab.lc
Updates 7/20/17 update Following Tino Tereshko's advice (he is Big Data Lead at Google Cloud Office of CTO), I added the metrics for BigQuery standard SQL and re-calculated the data loading time (from Google Cloud Storage to BigQuery) following their recent optimizations. 7/6/17 update With Joe Harris' help (he is a Redshift Database Engineer at AWS), I measured the performance of an optimized sch
dann 2017/06/25
bigquery

athena
ãƒªãƒ³ã‚¯
ã€ç¥ã€‘Amazon Athena ãŒæ±äº¬ãƒªãƒ¼ã‚¸ãƒ§ãƒ³ã«ã‚„ã£ã¦ãã¾ã—ãŸ | DevelopersIO
ãŠã¯ã‚ˆã†ã”ã–ã„ã¾ã™ã€‚è—¤æœ¬ã§ã™ã€‚ æœ¬æ—¥ã€ã†ã‚Œã—ã„ã‚¢ãƒƒãƒ—ãƒ‡ãƒ¼ãƒˆãŒã‚ã‚Šã¾ã—ãŸã€‚ã¤ã„ã« Amazon Athena ãŒæ±äº¬ãƒªãƒ¼ã‚¸ãƒ§ãƒ³ã«ã‚„ã£ã¦ãã¾ã—ãŸã€‚æ±äº¬ãƒªãƒ¼ã‚¸ãƒ§ãƒ³ãƒªãƒªãƒ¼ã‚¹ã‚’å¾…ã£ã¦ã„ãŸæ–¹ã‚‚å¤šã„ã®ã§ã¯ãªã„ã§ã—ã‚‡ã†ã‹ï¼Ÿ Amazon Athena is now available in Asia Pacific (Singapore) and Asia Pacific (Tokyo) Amazon Athena Amazon Athena ã¯ S3 ã«ã‚ã‚‹ CSVã€JSONãªã©ã®ãƒ†ã‚ã‚¹ãƒˆãƒ•ã‚¡ã‚¤ãƒ«ã‹ã‚‰ SQL ã«ã‚ˆã£ã¦ãƒ‡ãƒ¼ã‚¿ã®æŠ½å‡ºã‚„é›†è¨ˆã‚’è¡Œãˆã‚‹ã‚µãƒ¼ãƒ“ã‚¹ã§ã™ã€‚å¼Šç¤¾ãƒ–ãƒã‚°ã§ã‚‚è‰²ã€…ãªã“ã¨ã‚’è©¦ã—ã¦ã„ã¾ã™ã®ã§æ˜¯éžã”è¦§ãã ã•ã„ã€‚ Athena â€“ ç‰¹é›†ã‚«ãƒ†ã‚´ãƒªãƒ¼ â€“ æ±äº¬ãƒªãƒ¼ã‚¸ãƒ§ãƒ³ã«ã‚„ã£ã¦ããŸã“ã¨ã§ä½•ãŒå¬‰ã—ã„ï¼Ÿ ä»Šã¾ã§ã¯ USã€ãƒ¨ãƒ¼ãƒãƒƒãƒ‘ã® 4ãƒªãƒ¼ã‚¸ãƒ§ãƒ³ã§ã‚µãƒ¼ãƒ“ã‚¹æä¾›ã•ã‚Œã¦ã„ã¾ã—ãŸã€‚Amazon Athena ã¯åˆ¥
dann 2017/06/23
aws

athena
ãƒªãƒ³ã‚¯
Private Presentation
Private content!This content has been marked as private by the uploader.
dann 2017/02/05
aws

athena

s3
ãƒªãƒ³ã‚¯
1