[B! athena] rochefortã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

rochefort id:rochefort

athenaã«é–¢ã™ã‚‹rochefortã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (6)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

S3ã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚’ã‚µãƒ¼ãƒãƒ¬ã‚¹ã«å‡¦ç†ã—ã¦Athenaã§è§£æžã—ã¦ã¿ãŸ | DevelopersIO
ã¯ã˜ã‚ã« AWSãƒãƒ¼ãƒ ã®ã™ãšãã§ã™ã€‚ APIã®ç½²åãƒãƒ¼ã‚¸ãƒ§ãƒ³æƒ…å ±ãŒãƒã‚°é …ç›®ã¨ã—ã¦è¿½åŠ ã•ã‚ŒãŸS3ã®ã‚µãƒ¼ãƒã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã€CloudTrailã‚ˆã‚Šå»‰ä¾¡ãªåˆ©ç”¨ãŒå¯èƒ½ã§ã™ãŒã€ å‡ºåŠ›ã•ã‚Œã‚‹ãƒã‚°ãƒ•ã‚¡ã‚¤ãƒ«æ•°ã®å¤šã•ã€æ£è¦è¡¨ç¾ã«ã‚ˆã‚‹ãƒã‚°ã®ãƒ‘ãƒ¼ã‚¹ã®å›°é›£ã•ãªã©ã«ã‚ˆã‚Šã€Athenaãªã©ã‚’åˆ©ç”¨ã—ãŸè§£æžãŒé›£ã—ã„èª²é¡ŒãŒã‚ã‚Šã¾ã—ãŸã€‚ ä»Šå›žã“ã®è§£æ±ºã®ãŸã‚ã€ãƒã‚°ãƒ•ã‚¡ã‚¤ãƒ«ã®ãƒ‘ãƒ¼ã‚¹ã¨é›†ç´„ã‚’Lambdaã¨Firehoseã‚’åˆ©ç”¨ã—ã¦å®Ÿæ–½ã€Athenaã«ã‚ˆã‚‹è§£æžå‡¦ç†ãŒè¡Œã„ã‚„ã™ã„ãƒã‚°å½¢å¼ã¸ã®å¤‰æ›ã‚’å®Ÿç¾ã—ã¾ã—ãŸã€‚ ã¾ãŸã€å¾Œå‡¦ç†ã®Lambdaã‚’ç”¨ã„ã¦ç½²åãƒãƒ¼ã‚¸ãƒ§ãƒ³2(SigV2)ã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã®ã¿ã‚’æŠ½å‡ºã€‚ç§»è¡Œå¯¾å¿œãŒå¿…è¦ã¨ãªã‚‹ãƒã‚°ãŒå˜åœ¨ã—ãŸå ´åˆã€ CloudWatch Logs ã§ç°¡å˜ã«ç¢ºèªå¯èƒ½ã¨ã™ã‚‹ä»•çµ„ã¿ã‚‚ç”¨æ„ã—ã¾ã—ãŸã€‚ ã“ã‚Œã‚‰ã®ä»•çµ„ã¿ã¨ã€å±•é–‹ã™ã‚‹ãƒ†ãƒ³ãƒ—ãƒ¬ãƒ¼ãƒˆã‚’ç´¹ä»‹ã•ã›ã¦é ‚ãã¾ã™ã€‚ æ§‹æˆå›³ è¨ç½®æ–¹æ³• CloudFormationå±•é–‹ AWSã‚³
rochefort 2020/07/16
aws

athena
ãƒªãƒ³ã‚¯
è»½ã‚ã®é›†è¨ˆæ“ä½œã‚’S3+Athenaã§å®Œçµã•ã›ã¦ã¿ã‚‹ | DevelopersIO
ã¯ã˜ã‚ã« ãƒ‡ãƒ¼ã‚¿é›†è¨ˆã«Athenaã‚’ç”¨ã„ã‚‹å ´åˆã€S3ã«ã‚¢ãƒƒãƒ—ã—ãŸãƒ•ã‚¡ã‚¤ãƒ«ã‚’Glueã§ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã¨ã—ã¦ä½œæˆ + Athenaã‹ã‚‰ã‚¯ã‚¨ãƒªã‚’ã‹ã‘ã‚‹ ã¨ã„ã†ã‚„ã‚Šæ–¹ãŒã‚ã‚Šã¾ã™ãŒã€ãƒ‡ãƒ¼ã‚¿é‡è‡ªä½“ãŒãã“ã¾ã§å¤§ãããªã‹ã£ãŸã‚Šã€æ‰‹è»½ãå®Ÿæ–½ã—ãŸã„å ´åˆã«ç›´æŽ¥Athenaã§S3ã®ãƒ‡ãƒ¼ã‚¿ã‚’å…ƒã«ãƒ†ãƒ¼ãƒ–ãƒ«ã‚’ä½œæˆã™ã‚‹æ‰‹æ®µã‚‚ã‚ã‚Šã¾ã™ã€‚ Amazon S3 ã®ãƒ†ãƒ¼ãƒ–ãƒ«ã®å ´æ‰€ - Amazon Athena å…¬å¼ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã«ã‚‚è©³ç´°ã¯è¨˜è¼‰ã•ã‚Œã¦ã„ã¾ã™ãŒã€å®Ÿéš›ã«ã‚„ã£ã¦ã¿ãŸå†…å®¹ã‚’å…ƒã«æ‰‹é †ã¨ã—ã¦ã¿ã¾ã—ãŸã€‚ S3ã«ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ã‚¢ãƒƒãƒ—ã™ã‚‹ ãƒ•ã‚¡ã‚¤ãƒ«ã‚¢ãƒƒãƒ—ç”¨ã®bucketã‚’è¿½åŠ ã—ã¾ã™ã€‚ % aws s3api create-bucket --bucket BUCKET-NAME --region ap-northeast-1 --create-bucket-configuration LocationConstraint=ap-northe
rochefort 2020/07/06
aws

athena
ãƒªãƒ³ã‚¯
Amazon Athena ã®ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚° Tips ãƒˆãƒƒãƒ— 10 | Amazon Web Services
Amazon Web Services ãƒ–ãƒã‚° Amazon Athena ã®ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚° Tips ãƒˆãƒƒãƒ— 10 2024 å¹´ 2 æœˆã«æ›´æ–°ã•ã‚ŒãŸåŽŸæ–‡ã‚’æ—¥æœ¬èªžç‰ˆã¨ã—ã¦ 9 æœˆã«åæ˜ ã—ã¾ã—ãŸï¼š ã“ã®è¨˜äº‹ã¯ã€ã‚³ã‚¹ãƒˆãƒ™ãƒ¼ã‚¹ã®æœ€é©åŒ–ã¨ã‚¯ã‚¨ãƒªçµæžœã®å†åˆ©ç”¨ã‚’å«ã‚€ Amazon Athena ã‚¨ãƒ³ã‚¸ãƒ³ãƒãƒ¼ã‚¸ãƒ§ãƒ³ 3 ã®å¤‰æ›´ã‚’åæ˜ ã™ã‚‹ãŸã‚ã«ç¢ºèªãŠã‚ˆã³æ›´æ–°ã•ã‚Œã¾ã—ãŸã€‚ Amazon Athena ã¯ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã«åŸºã¥ã„ãŸå¯¾è©±åž‹åˆ†æžã‚µãƒ¼ãƒ“ã‚¹ã§ã€æ¨™æº–ã® SQL ã‚’ä½¿ã£ã¦ Amazon Simple Storage Service (Amazon S3) ã«æ ¼ç´ã•ã‚ŒãŸã‚ªãƒ¼ãƒ—ãƒ³ãƒ†ãƒ¼ãƒ–ãƒ«ãŠã‚ˆã³ãƒ•ã‚¡ã‚¤ãƒ«å½¢å¼ã®ãƒ‡ãƒ¼ã‚¿ã‚’ç°¡å˜ã«åˆ†æžã§ãã¾ã™ã€‚Athena ã¯ã‚µãƒ¼ãƒãƒ¼ãƒ¬ã‚¹ãªã®ã§ã€ã‚¤ãƒ³ãƒ•ãƒ©ã‚¹ãƒˆãƒ©ã‚¯ãƒãƒ£ã®ç®¡ç†ã¯ä¸è¦ã§ã€å®Ÿè¡Œã—ãŸã‚¯ã‚¨ãƒªã«å¯¾ã—ã¦ã®ã¿æ–™é‡‘ã‚’æ”¯æ‰•ã„ã¾ã™ã€‚Athena ã¯ä½¿ã„ã‚„ã™ãã€Ama
rochefort 2017/09/04
amazon

athena

performance
ãƒªãƒ³ã‚¯
Kinesis Firehoseã€Athenaã€QuickSightã‚’åˆ©ç”¨ã—ãŸãƒ‡ãƒ¼ã‚¿é›†ç©åŸºç›¤ã®æ§‹ç¯‰ - Speee DEVELOPER BLOG
Speeeé–‹ç™ºåŸºç›¤éƒ¨ã€å…¼ãƒŒãƒªã‚«ã‚¨ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®æ£®å²¡ã§ã™ã€‚ 2017å¹´6æœˆ2æ—¥ã«è¡Œã‚ã‚ŒãŸJAWS-UGå‹‰å¼·ä¼šã€AWS Summit Tokyo 2017ã€‘ã«ã¦ã€å¼Šç¤¾Speeeã‚ˆã‚Š hatappi ã¨ç§ãŒç™ºè¡¨ã•ã›ã¦é ‚ãã¾ã—ãŸã€‚ ç§ãŒç™ºè¡¨ã—ãŸå†…å®¹ã¯Kinesis Firehose, Athena, QuickSightã‚’ä½¿ã£ã¦ã€ãƒ‡ãƒ¼ã‚¿é›†ç©åŸºç›¤ã‚’ä½œã‚‹ã€‚ã¨ã„ã†ã‚‚ã®ã§ã™ã€‚ã‚¹ãƒ©ã‚¤ãƒ‰ã¯ã“ã¡ã‚‰ã«ãªã‚Šã¾ã™ã€‚ speakerdeck.com ä»Šå›žã¯ã€ã“ã®ç™ºè¡¨å†…å®¹ã«ã¤ã„ã¦ã€è£œè¶³æƒ…å ±ã‚’è¿½åŠ ã—ã¦ãŠè©±ã‚’ã•ã›ã¦é ‚ãã¾ã™ã€‚ Kinesis Firehoseã€Athenaã€QuickSightã‚’åˆ©ç”¨ã—ãŸãƒ‡ãƒ¼ã‚¿å¯è¦–åŒ–ãƒ„ãƒ¼ãƒ«ã®ï¼‘ã¤ã®å®Ÿè£…ä¾‹ã¨ã—ã¦è¦‹ã¦é ‚ã‘ã‚Œã°ã¨æ€ã„ã¾ã™ã€‚ æœ€åˆã« å¼Šç¤¾Speeeã§ã¯ã€ãƒŒãƒªã‚«ã‚¨ã¨ã„ã†å¤–å£å¡—è£…ã®ä¸€æ‹¬è¦‹ç©ã‚‚ã‚Šã‚µãƒ¼ãƒ“ã‚¹ã‚’é‹ç”¨ã—ã¦ã„ã¾ã™ã€‚ å¤–å£å¡—è£…ã‚’æœ›ã¾ã‚Œã¦ã„ã‚‹ãŠå®¢æ§˜ã«ãƒ’ã‚¢ãƒªãƒ³ã‚°ã‚’è¡Œã„ã€ãŠå®¢æ§˜ã®çŠ¶æ³ã«åˆã‚ã›ã¦é©
rochefort 2017/08/20
è‰¯ã•ã’

aws

athena

kinesis

QuickSight
ãƒªãƒ³ã‚¯
Amazon Athenaã‚’ä½¿ã£ã¦JSONãƒ•ã‚¡ã‚¤ãƒ«ã‚’æ¤œç´¢ã—ã¦ã¿ã‚‹ | DevelopersIO
ã¯ã˜ã‚ã« æœ€è¿‘ã€Amazon Athenaã®å‹‰å¼·ã‚’ã—ã¦ã„ã‚‹ã®ã§ã™ãŒJSONã®ãƒ•ã‚¡ã‚¤ãƒ«ã¯CSVãªã©ã¨é•ã£ã¦éšŽå±¤æ§‹é€ ã«ãªã£ã¦ã„ã‚‹ã®ã§ã©ã®ã‚ˆã†ã«ã—ã¦èªã¿è¾¼ã‚€ã®ã‹æ°—ã«ãªã‚Šèª¿ã¹ã¦ã¿ã¾ã—ãŸã€‚ JSONãƒ•ã‚¡ã‚¤ãƒ«ã®ä½œæˆ ã¾ãšã¯ä»¥ä¸‹ã®ã‚ˆã†ãªJSONãƒ•ã‚¡ã‚¤ãƒ«ã‚’ä½œæˆã—S3ã«ã‚¢ãƒƒãƒ—ãƒãƒ¼ãƒ‰ã—ã¾ã—ãŸã€‚ç§ãŒè¶£å‘³ã‚„ã£ã¦ã„ã‚‹ãƒã‚±ãƒ¢ãƒ³ GOã®ãƒã‚±ãƒ¢ãƒ³ã®ãƒ‡ãƒ¼ã‚¿ã«ãªã‚Šã¾ã™ã€‚æœ€è¿‘ã€ç¬¬1ä¸–ä»£ã ã‘ã§ã™ãŒå›½å†…ã‚³ãƒ³ãƒ—ã—ã¾ã—ãŸã€‚ pokemon_go.json {"name": "ã‚«ã‚¤ãƒªãƒ¥ãƒ¼", "cp": 2666, "hp": 134, "weight": 72.34, "height": 2.21, "favorite":true, "attributes": ["ãƒ‰ãƒ©ã‚´ãƒ³" , "ã²ã“ã†"], "skill1":{"name":"ã‚Šã‚…ã†ã®ã„ã¶ã" , "attribute": "ãƒ‰ãƒ©ã‚´ãƒ³"}, "skill2":{"name":"ã¯ã‹
rochefort 2017/02/11
athena
ãƒªãƒ³ã‚¯
re:Growthã§ã€ŒAmazon Athenaã£ã¦ä½•ï¼Ÿã€ã«ã¤ã„ã¦è©±ã—ã¦ãã¾ã—ãŸï¼ #reinvent #cmdevio | DevelopersIO
ã“ã‚“ã«ã¡ã‚ã€‚å¤§é˜ªã®å¸‚ç”°ã§ã™ã€‚ 12æœˆ12æ—¥ã«é–‹å‚¬ã®AWS re:Invent 2016ã®å ±å‘Šã‚¤ãƒ™ãƒ³ãƒˆã€Œre:Growth 2016ã€ã«ã¦ã€ŒAmazon Athenaã€ã«ã¤ã„ã¦ç™»å£‡ã—ã¾ã—ãŸã€‚ ç°¡å˜ã«å§‹ã‚ã‚‰ã‚Œã‚‹ç‚¹ã‚„ã€åˆ©ç”¨ä¸Šã®æ³¨æ„ç‚¹ãªã©ã«ã¤ã„ã¦ç™ºè¡¨ã—ã¾ã—ãŸã€‚è©³ç´°ã¯ä»¥ä¸‹ã®ã‚¹ãƒ©ã‚¤ãƒ‰ã‚’è¦‹ã¦é ‚ã‘ã‚Œã°ã¨æ€ã„ã¾ã™ã€‚ ç™ºè¡¨è³‡æ–™
rochefort 2017/01/03
Gnosy, Japan Taxi

athena
ãƒªãƒ³ã‚¯
1