ã¯ã˜ã‚ã¦ã®EMRï¼fluentdã§S3ã«ã‚¢ãƒƒãƒ—ãƒãƒ¼ãƒ‰ã—ãŸãƒã‚°ã‚’Elastic MapReduceã§æ¤œç´¢ãƒ»é›†è¨ˆã™ã‚‹ | DevelopersIO今回解決ã—ãŸã„課題 ã“ã‚“ã«ã¡ã¯æ¤æœ¨å’Œæ¨¹ã§ã™ã€‚本日ã®èª²é¡Œã¯ã‚¿ã‚¤ãƒˆãƒ«ã®é€šã‚Šã€Œfluentdã§S3ã®ãƒã‚±ãƒƒãƒˆã«ã‚¢ãƒƒãƒ—ãƒãƒ¼ãƒ‰ã—ãŸãƒã‚°ã‚’検索・集計ã™ã‚‹ã€ã§ã™ã€‚EC2ã§ã‚µãƒ¼ãƒã‚’構築ã—ãŸå ´åˆã€ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ãŒTerminateã—ãŸå¾Œã‚‚ãƒã‚°ãŒå‚ç…§ã§ãるよã†fluentdを使ã£ã¦S3ã«ãƒ•ã‚¡ã‚¤ãƒ«ã‚’アップãƒãƒ¼ãƒ‰ã—ã¦ãŠãã®ãŒAWSã®ãƒ™ã‚¹ãƒˆãƒ—ラクティスã§ã™ã€‚ 「Amazon Recommends Fluentd as “Best Practice for Data Collection†over Flume and Scribe〠ã—ã‹ã—S3ã«ã‚¢ãƒƒãƒ—ãƒãƒ¼ãƒ‰ã—ãŸãƒã‚°ãƒ•ã‚¡ã‚¤ãƒ«ã¯ãƒ„ールを用ã„ãªã‘ã‚Œã°ã‚¢ã‚¯ã‚»ã‚¹ã™ã‚‹ã“ã¨ãŒã§ããšã€ã“ã®ã¾ã¾ã§ã¯å®¹æ˜“ã«æ¤œç´¢ã§ãã¾ã›ã‚“。EC2ã‹ã‚‰S3ã‚’s3fsã§ãƒžã‚¦ãƒ³ãƒˆã—ã¦grepã¨ã„ã†æ–¹æ³•ã¯ã‚ã‚Šã¾ã™ãŒã€é…ã™ãŽã¦å®Ÿç”¨çš„ã¨ã¯ã„ãˆã¾ã›ã‚“。s3cmdã§ã„ã£ãŸã‚“ãƒãƒ¼ã‚«ãƒ«ã«ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ダウンãƒãƒ¼ãƒ‰ã—ã¦ã‹ã‚‰æ¤œç´¢ã™
{{#tags}}- {{label}}
{{/tags}}