[B! s3] atsuizoã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

atsuizo id:atsuizo

s3ã«é–¢ã™ã‚‹atsuizoã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (6)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Kinesisã‹S3ã‹
Kinesisã‚’è§¦ã£ã¦ã¯ã¿ãŸã‚‚ã®ã®ã€ç‰¹åˆ¥ã€Œã“ã‚Œã¯ä½¿ã„ã‚„ã™ã„ï¼ã€ã¨ã„ã†å°è±¡ã§ã¯ãªã‹ã£ãŸã€‚ Kinesisã®ç”¨é€”ã¯è¦ã™ã‚‹ã« AWSã«ã‚¬ãƒ³ã‚¬ãƒ³ãƒ‡ãƒ¼ã‚¿ã‚’é€ã‚‹ AWSå´ã§ã¯ã€é€ã‚‰ã‚Œã¦ããŸãƒ‡ãƒ¼ã‚¿ã‚’ç‰‡ã£ç«¯ã‹ã‚‰å‡¦ç†ã™ã‚‹ AWSå´ã«ç€ã„ãŸãƒ‡ãƒ¼ã‚¿ã¯å‡¦ç†ã—ã‚ˆã†ãŒã—ã¾ã„ãŒä¸€å®šæœŸé–“(ç¾åœ¨ã¯24æ™‚é–“)ã§æ¶ˆãˆã‚‹ ã¨ã„ã†ã‚‚ã®ã€‚ ã—ã‹ã—ã€AWSã¸ã®é€ä¿¡ã¯å˜ç´”ã«HTTPSã®POSTãƒªã‚¯ã‚¨ã‚¹ãƒˆã§ã‚ã‚Šã€ã•ã‚‰ã«Base64ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ã•ã‚Œã¦ã„ã‚‹ã¨ã„ã†ã“ã¨ã§ç‰¹ã«åŠ¹çŽ‡çš„ãªæ–¹æ³•ã§ã¯ãªã„ã€‚ã‚€ã—ã‚åŠ¹çŽ‡ã‚’ã¾ã£ãŸãè€ƒæ…®ã—ã¦ãŠã‚‰ãšã€ã‚·ãƒ³ãƒ—ãƒ«ã•ã€æ‰±ã„ã‚„ã™ã•ã«å¾¹ã—ã¦ã„ã‚‹ã€‚ HTTPSã®POSTãƒªã‚¯ã‚¨ã‚¹ãƒˆã§ã‚ã‚‹ã«ã‚‚é–¢ã‚ã‚‰ãšã‚µã‚¤ã‚ºä¸Šé™(ç¾åœ¨ã¯50KB)ãŒãã¤ã„ã®ã§ã€å°ã•ãªãƒ‡ãƒ¼ã‚¿ã‚’é€ã‚‹ç”¨é€”ã«é™å®šã•ã‚Œã‚‹ã€‚ å€‹äººçš„ã«æ•°åï½žç™¾å°ç¨‹åº¦ã®ã‚µãƒ¼ãƒã‹ã‚‰AWSã¸ã®ãƒã‚°ã®é›†ç´„(Log Aggregation)ã‚’è¨ˆç”»ã—ã¦ã„ã‚‹ã®ã ãŒã€Kinesisã®ç”¨é€”ã«ã´ã£ãŸã‚Šã‹ï¼Ÿã¨è€ƒãˆãŸä¸€æ–¹
atsuizo 2017/08/28
kinesis

s3

AWS
ãƒªãƒ³ã‚¯
CloudWatch Logsã®S3ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆ | DevelopersIO
æ¸¡è¾ºã§ã™ã€‚ å€‹äººçš„ã«å¥½ããªAWSã®ã‚µãƒ¼ãƒ“ã‚¹ã®ã²ã¨ã¤ãŒCloudWatch Logsã§ã™ã€‚ å„ã‚µãƒ¼ãƒã«ä¿å˜ã•ã‚Œã‚‹ãƒã‚°ã‚’ä¿å˜ã™ã‚‹ã ã‘ã§ãªãã€ç°¡æ˜“æ¤œç´¢ã‚„ä¿å˜æœŸé–“ã®æŒ‡å®šãŒã§ãã‚‹ãŸã‚ã€ãƒã‚®ãƒ³ã‚°ã«é–¢ã™ã‚‹æœ€ä½Žé™ã®è¦ä»¶ã‚’æº€ãŸã™ã“ã¨ãŒã§ãã¾ã™ã€‚ åˆ©ç”¨æ–¹æ³•ã‚‚EC2ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ã§ã‚ã‚Œã°ã‚¨ãƒ¼ã‚¸ã‚§ãƒ³ãƒˆã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã™ã‚‹ã ã‘ã¨ã„ã†æ‰‹è»½ã•ã‚‚ãƒã‚¤ãƒ³ãƒˆã§ã™ãã€‚ Lambdaã‚’çµ„ã¿åˆã‚ã›ã‚Œã°ç°¡å˜ãªãƒã‚°ç›£è¦–ã‚‚ã§ãã¾ã™ã€‚ æœ¬æ—¥ã¯CloudWatch Logsã§ä¿å˜ã•ã‚ŒãŸãƒã‚°ã‚’ä»–ã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ãªã©ã§åˆ©ç”¨ã™ã‚‹æ™‚ã«ä¾¿åˆ©ãªS3ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆæ©Ÿèƒ½ã‚’ç´¹ä»‹ã—ã¾ã™ã€‚ S3ã¸ã®ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆæ©Ÿèƒ½ S3ã¸ã®ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆæ©Ÿèƒ½ã¯æ–‡å—é€šã‚Šã€ãƒã‚°ã‚’S3ã«è»¢é€ã—ã¦ä¿å˜ã—ã¾ã™ã€‚ ã“ã®æ™‚ã€ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆã™ã‚‹ãƒã‚°ã®æ™‚åˆ»ï¼ˆç¯„å›²ï¼‰ã‚’æŒ‡å®šã—ã¾ã™ã€‚ ç°¡æ˜“æ¤œç´¢ã§ãƒã‚°ã‚’çµžã‚Šè¾¼ã‚“ã§ã®ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆã¯ã‚µãƒãƒ¼ãƒˆã•ã‚Œã¦ã„ãªã„ã®ã§ã”æ³¨æ„ãã ã•ã„ã€‚ S3ãƒã‚±ãƒƒãƒˆã®æº–å‚™ ã¯ã˜ã‚ã«ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆã™ã‚‹å¯¾
atsuizo 2017/05/01
CloudWatchLogså¤§å¥½ãã§ãŠä¸–è©±ã«ãªã‚Šã¾ãã‚Šã ã‘ã©ã€ã€CloudWatchLogsè‡ªä½“ãŒS3é ˜åŸŸã«ä¿å˜ã—ã¦ã‚‹ã¯ãšãªã®ã«ã€S3ã«ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆã—ã¦ã‹ã‚‰ã˜ã‚ƒãªã„ã¨Athenaã‚„Redshift Spectrumã«é€£æºã§ããªã„ã®ãŒæ®‹å¿µã€‚

s3

AWS

cloudwatch
ãƒªãƒ³ã‚¯
Amazon S3 ã§ã®ã‚¢ã‚¯ã‚»ã‚¹ã‚³ãƒ³ãƒˆãƒãƒ¼ãƒ« - Amazon Simple Storage Service
AWS ã§ã¯ã€ãƒªã‚½ãƒ¼ã‚¹ã¯ãƒ¦ãƒ¼ã‚¶ãƒ¼ãŒæ“ä½œã§ãã‚‹ã‚¨ãƒ³ãƒ†ã‚£ãƒ†ã‚£ã§ã™ã€‚Amazon Simple Storage Service (S3) ã§ã¯ã€ãƒã‚±ãƒƒãƒˆã¨ã‚ªãƒ–ã‚¸ã‚§ã‚¯ãƒˆãŒå…ƒã® Amazon S3 ãƒªã‚½ãƒ¼ã‚¹ã§ã™ã€‚ã™ã¹ã¦ã® S3 ã®ãŠå®¢æ§˜ã®ãƒã‚±ãƒƒãƒˆã«ã¯ã€ã‚ªãƒ–ã‚¸ã‚§ã‚¯ãƒˆãŒå«ã¾ã‚Œã¦ã„ã‚‹å¯èƒ½æ€§ãŒã‚ã‚Šã¾ã™ã€‚æ–°æ©Ÿèƒ½ãŒ S3 ã«è¿½åŠ ã•ã‚Œã€ãƒªã‚½ãƒ¼ã‚¹ã‚‚ã•ã‚‰ã«è¿½åŠ ã•ã‚Œã¾ã—ãŸãŒã€ã™ã¹ã¦ã®ãŠå®¢æ§˜ãŒã“ã‚Œã‚‰ã®æ©Ÿèƒ½å›ºæœ‰ã®ãƒªã‚½ãƒ¼ã‚¹ã‚’ä½¿ç”¨ã—ã¦ã„ã‚‹ã‚ã‘ã§ã¯ã‚ã‚Šã¾ã›ã‚“ã€‚Amazon S3 ãƒªã‚½ãƒ¼ã‚¹ã®è©³ç´°ã«ã¤ã„ã¦ã¯ã€ã€ŒS3 ãƒªã‚½ãƒ¼ã‚¹ã€ã‚’å‚ç…§ã—ã¦ãã ã•ã„ã€‚ ãƒ‡ãƒ•ã‚©ãƒ«ãƒˆã§ã¯ã€ã™ã¹ã¦ã® Amazon S3 ãƒªã‚½ãƒ¼ã‚¹ã¯ãƒ—ãƒ©ã‚¤ãƒ™ãƒ¼ãƒˆã§ã™ã€‚ã•ã‚‰ã«ãƒ‡ãƒ•ã‚©ãƒ«ãƒˆã§ã¯ã€ãƒªã‚½ãƒ¼ã‚¹ã‚’ä½œæˆã—ãŸ AWS ã‚¢ã‚«ã‚¦ãƒ³ãƒˆã®ãƒ«ãƒ¼ãƒˆãƒ¦ãƒ¼ã‚¶ãƒ¼ (ãƒªã‚½ãƒ¼ã‚¹æ‰€æœ‰è€…) ã¨ã€å¿…è¦ãªã‚¢ã‚¯ã‚»ã‚¹è¨±å¯ã‚’æŒã¤ãã®ã‚¢ã‚«ã‚¦ãƒ³ãƒˆå†…ã® IAM ãƒ¦ãƒ¼ã‚¶ãƒ¼ã¯ã€ä½œæˆã—ãŸãƒªã‚½ãƒ¼ã‚¹ã«ã‚¢ã‚¯ã‚»ã‚¹ã§ãã¾ã™ã€‚ãƒªã‚½ãƒ¼ã‚¹æ‰€æœ‰è€…
atsuizo 2017/02/24
aws

s3
ãƒªãƒ³ã‚¯
RDS(mysql) general_log ã‚’Lambdaã‚’ç”¨ã„ã¦S3ã«ä¿å˜ã™ã‚‹æ–¹æ³• - Qiita
general_log ã‚’å®šæœŸçš„ã«S3ã¸ä¿ç®¡ã§ãã‚‹ã¨ä¾¿åˆ© RDSã§ã¯ã€ãƒ‘ãƒ©ãƒ¡ãƒ¼ã‚¿ã‚°ãƒ«ãƒ¼ãƒ—ã«æ¬¡ã®è¨å®šã‚’è¿½åŠ ã™ã‚‹ã ã‘ã§ general_log ãŒFILEã«ä¿ç®¡ã•ã‚Œã€ RDS APIçµŒç”±ã§å–å¾—ã§ãã‚‹ã®ã§ã€ãŸã„ã¸ã‚“ä¾¿åˆ©ã§ã™ã€‚ general_log = 1 log_output = FILE ãŸã ã—ã€1æ™‚é–“å˜ä½ã§ general_log ã¯ãƒãƒ¼ãƒ†ãƒ¼ã‚·ãƒ§ãƒ³ã•ã‚Œã€1æ—¥ä»¥ä¸ŠçµŒã£ãŸãƒã‚°ã¯æ¶ˆã•ã‚Œã¦ã—ã¾ã„ã¾ã™ã€‚ã“ã®ãŸã‚ã€ãƒã‚°ã‚’é•·æœŸä¿ç®¡ã™ã‚‹ãŸã‚ã«ã¯æ‰‹å‹•ã¾ãŸã¯ã‚¹ã‚¯ãƒªãƒ—ãƒˆç‰ã«ã¦å®šæœŸçš„ã«ãƒã‚°ã‚’ä¿ç®¡ã™ã‚‹å¿…è¦ãŒã‚ã‚Šã¾ã—ãŸã€‚ Lambda ã‚’ç”¨ã„ã¦ã€S3 ä¸Šãƒã‚°ã‚’ç°¡å˜ã«ä¿ç®¡ EC2ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ç‰ã‚’æ–°ãŸã«æ§‹ç¯‰ã›ãšãƒã‚°ã‚’å®šæœŸçš„ã«ä¿ç®¡ã™ã‚‹æ–¹æ³•ã¨ã—ã¦ã¯ã€Lambda Function ã‚’ç”¨ã„ãŸå®Ÿè£…ãŒã€ã‚³ã‚¹ãƒˆãƒ»é‹ç”¨ã®è¦³ç‚¹ã§ãŠå‹§ã‚ã§ã™ã€‚ æ—¢ã«ã€ã™ãã«ä½¿ãˆã‚‹ Lambda Function ãŒ github ä¸Šã«ã‚ã‚Šã¾ã—ãŸã®ã§ã€æ¬¡ã«ã¾
atsuizo 2016/11/28
MySQL

lambda

s3
ãƒªãƒ³ã‚¯
ä¹™æ¦ä¸å€«ã®è¬ç½ªãƒ›ãƒ¼ãƒ ãƒšãƒ¼ã‚¸ã«è¦‹ã‚‹ã‚µãƒ¼ãƒãƒ¼æ§‹ç¯‰ï¼š
ä»Šå›žã€ä¸å€«ã§æœ‰åã«ãªã£ãŸä¹™æ¦ã•ã‚“ã®è¬ç½ªæ–‡ã¯AWSã®S3ã§æ§‹ç¯‰ã—ã¦ã‚‹ã€‚æŠ€è¡“çš„ã«ã‚‚ãƒ—ãƒã®çŠ¯è¡Œã ã€‚S3ã¨ã¯ã€ã–ã£ãã‚Šè¨€ã†ã¨Amazonã•ã‚“ãŒé‹å–¶ã—ã¦ã‚‹ã»ã¼çµ¶å¯¾è½ã¡ãªã„é™çš„ã‚µãƒ¼ãƒã®ã“ã¨ã§ã™ã€‚http://ototake.com ã‚’DNSã§å…¨éƒ¨S3ã«é™ã£ã¦ã‚‹ã€‚è¦ã™ã‚‹ã«è¬ç½ªæ–‡ã—ã‹è¡¨ç¤ºã—ãªã„ã‘ã©çµ¶å¯¾è½ã¡ãªã„ã‚µãƒ¼ãƒã‚’Amazonã•ã‚“ã‹ã‚‰çŸæœŸçš„ã«å€Ÿã‚Šã‚‹ã€‚ä»Šå¾Œã€èŠ¸èƒ½äººã®è¬ç½ªæ–‡ã¯AWSã®S3ã¨ã„ã†ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ãŒå¢—ãˆã‚‹ã€‚ GMOã•ã‚“ã¯èŠ¸èƒ½äººã«å¼·ã„ã®ã«å–¶æ¥ã—ãªã„ã®ã‹ãªã€‚CAã¨çµ„ã‚“ã§è¬ç½ªæ–‡ã‚µãƒ¼ãƒã¨ã‹å£²ã‚Œã°ã„ã„ã®ã«ã€‚ã“ã‚Œã¯ã€èŠ¸èƒ½äººã®ã‚µã‚¤ãƒˆã‚’é‹ç”¨ã—ã¦ã„ã‚‹äººã«ã¯é‡è¦ãªäº‹ä¾‹ã ã€‚æ•™ç§‘æ›¸ã«ã®ã‚‹ã‹ã‚‚ã—ã‚Œãªã„ã€‚ã‚€ã—ã‚ã€ä»Šå¾Œã®è¬ç½ªãƒšãƒ¼ã‚¸ã®ã‚»ã‚ªãƒªãƒ¼ã«ãªã‚‹ã‹ã‚‚ã—ã‚Œãªã„ã€‚æ˜”ã«æ¯”ã¹ã¦ã€DNSã®æµ¸é€ã¯çˆ†é€Ÿã«ãªã£ãŸã®ã§ã€ã“ã†ã„ã†ã®ãŒå¯èƒ½ãªã‚“ã ã‚ãªã€‚ ä»Šã¾ã§ã€ototake.comã‚’ç„¡è¦–ã—ã¦ã€çŸæœŸçš„ã«S3ã«DNSã‚’é™ã‚‹ã“ã¨ã§ã€ä»¥ä¸‹ã®ãƒ¡ãƒªãƒƒãƒˆãŒæœ‰ã‚‹
atsuizo 2016/03/25
s3

ç‚Žä¸Š

AWS
ãƒªãƒ³ã‚¯
Amazon S3ã¨nanocã§ä½œã‚‹ å®‰ã„ãƒ»è½ã¡ãªã„webã‚µã‚¤ãƒˆ
Amazon S3ã«ã‚ˆã‚‹é™çš„webã‚µã‚¤ãƒˆãƒ›ã‚¹ãƒ†ã‚£ãƒ³ã‚°ã®ç´¹ä»‹ã€å®Ÿéš›ã®ã‚µã‚¤ãƒˆäºŒã¤ã‚’ä¾‹ã«æ–™é‡‘ã®è©¦ç®—ã€nanocã‚’ä½¿ã£ãŸã‚µã‚¤ãƒˆåˆ¶ä½œãƒ»S3ã¸ã®å…¬é–‹ãƒ•ãƒãƒ¼ã®ç´¹ä»‹ã€‚ 2014/12/06 JAWS-UG Shimane vol.3 ç™ºè¡¨è³‡æ–™(ä¸€éƒ¨ä¿®æ£)ã€‚Read less
atsuizo 2014/12/10
slides

s3

amazon

development

aws
ãƒªãƒ³ã‚¯
1