[B! s3] yassã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

yass id:yass

s3ã«é–¢ã™ã‚‹yassã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (166)

${{author_name}}$

{{author_name}} {{created}}

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

{{#following_bookmarks}}

${{author_name}}$

{{author_name}} {{created}}

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

{{/following_bookmarks}}

{{/is_wiped}}

MediaStoreã‚’S3ã‚ˆã‚Šã‚‚æ•´åˆæ€§ã®å¼·ã„ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã¨ã—ã¦ç†è§£ã™ã‚‹ | DevelopersIO
ã¯ã˜ã‚ã« æ¸…æ°´ã§ã™ã€‚ã€ŒMediaStoreã£ã¦å‹•ç”»ç”¨ã®ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚‰ã—ã„ã‹ã‚‰ä½¿ã†æ©Ÿä¼šãªã•ãã†ã ã‚ˆãªâ€¦ã€ãªã©ã¨æ€ã£ã¦ã„ã¾ã›ã‚“ã‹ï¼Ÿ MediaStoreã¯ã€Œãƒ¡ãƒ‡ã‚£ã‚¢å‘ã‘ã«æœ€é©åŒ–ã•ã‚ŒãŸAWSã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚µãƒ¼ãƒ“ã‚¹ã€ã§ã™ãŒã€S3ã‚ˆã‚Šã‚‚å¼·ã„ãƒ‡ãƒ¼ã‚¿æ•´åˆæ€§ãƒ¢ãƒ‡ãƒ«ã‚’æä¾›ã—ã¤ã¤ã€S3ã¨åŒæ§˜ã®ã‚»ã‚ãƒ¥ãƒªãƒ†ã‚£ãŠã‚ˆã³è€ä¹…æ€§ã‚’æŒã¤ã‚ªãƒ–ã‚¸ã‚§ã‚¯ãƒˆã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚µãƒ¼ãƒ“ã‚¹ã¨ã‚‚æ‰ãˆã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ãã®ãŸã‚æ•´åˆæ€§ã®è¦³ç‚¹ã§S3ã®ä½¿ç”¨ãŒé›£ã—ã„å ´åˆã€MediaStoreã‚’å€™è£œã«æ¤œè¨Žã™ã‚‹ã“ã¨ãŒã§ãã‚‹ã®ã§ã¯ãªã„ã‹ã¨è€ƒãˆã¾ã™ã€‚æœ¬ã‚¨ãƒ³ãƒˆãƒªã§ã¯ãã‚“ãªAWS Elemental MediaStoreã¨Amazon S3ã‚’ãƒ‡ãƒ¼ã‚¿æ•´åˆæ€§ãƒ¢ãƒ‡ãƒ«ã®é¢ã§æ¯”è¼ƒã—ã¦ã¿ãŸã„ã¨æ€ã„ã¾ã™ã€‚ Amazon S3ã®ãƒ‡ãƒ¼ã‚¿æ•´åˆæ€§ãƒ¢ãƒ‡ãƒ« ã¾ãšã¯Amazon S3ã®ãƒ‡ãƒ¼ã‚¿æ•´åˆæ€§ãƒ¢ãƒ‡ãƒ«ã§ã™ã€‚ æ–°ã—ã„ã‚ªãƒ–ã‚¸ã‚§ã‚¯ãƒˆã®PUTã¯æ›¸ãè¾¼ã¿å¾Œã®èªã¿è¾¼ã¿æ•´åˆæ€§(read-after-write co
yass 2018/03/08
s3

eventualy consistency
ãƒªãƒ³ã‚¯
AWS CLIãŒS3ã¨ã®ãƒˆãƒ©ãƒ•ã‚£ãƒƒã‚¯ã‚’å¸¯åŸŸåˆ¶å¾¡ã§ãã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã—ãŸ | DevelopersIO
AWS CLIå˜ä½“ã§S3ã¨ã®ãƒˆãƒ©ãƒ•ã‚£ãƒƒã‚¯ã‚’å¸¯åŸŸåˆ¶å¾¡å‡ºæ¥ã‚‹ã‚ˆã†ã«ãªã£ãŸãŸã‚ã€æ—©é€Ÿä½¿ã£ã¦ã¿ã¾ã—ãŸã€‚ 3è¡Œã¾ã¨ã‚ ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆ OS ã«ä¾å˜ã›ãš AWS CLI å˜ä½“ã§å¸¯åŸŸåˆ¶å¾¡å¯èƒ½ ã‚¤ãƒ³ãƒã‚¦ãƒ³ãƒ‰ãƒ»ã‚¢ã‚¦ãƒˆãƒã‚¦ãƒ³ãƒ‰ã§åŒã˜å€¤ã‚’é©ç”¨ è¨å®šã‚³ãƒžãƒ³ãƒ‰ $ aws configure set default.s3.max_bandwidth 50MB/s ã‚„ã£ã¦ã¿ãŸ ç’°å¢ƒ EC2(m4.xlarge)ã®Amazon Linux AWS CLI:1.14.8 S3è»¢é€ã«åˆ©ç”¨ã™ã‚‹ã‚ªãƒ–ã‚¸ã‚§ã‚¯ãƒˆã®ä½œæˆ 1 GB ã®ã‚ªãƒ–ã‚¸ã‚§ã‚¯ãƒˆã‚’ä½œæˆã—ã¾ã™ã€‚ $ fallocate -l 1G test.dat AWS CLIã®åˆæœŸè¨å®šå€¤ å¸¯åŸŸåˆ¶å¾¡ç”¨ã«è¿½åŠ ã•ã‚ŒãŸ s3.max_bandwidth ã‚’é™¤ãã€AWS CLI ã®è¨å®šå€¤ã¯ãƒ‡ãƒ•ã‚©ãƒ«ãƒˆã®ã¾ã¾ã¨ã—ã¾ã™ã€‚ ç‰¹ã«ã€s3.multipart_threshold ã¯ 8MB ã®ãŸã‚ã€ä»Šå›žè©¦
yass 2018/01/04
s3

bandwidth
ãƒªãƒ³ã‚¯
GitHub - peak/s5cmd: Parallel S3 and local filesystem execution tool.
s5cmd is a very fast S3 and local filesystem execution tool. It comes with support for a multitude of operations including tab completion and wildcard support for files, which can be very handy for your object storage workflow while working with large number of files. There are already other utilities to work with S3 and similar object storage services, thus it is natural to wonder what s5cmd has
yass 2017/09/04
s3

cui

cli
ãƒªãƒ³ã‚¯
Gnocchi 4 is out
yass 2017/08/21
gnocchi

tsdb

redis

s3
ãƒªãƒ³ã‚¯
ãã—ã¦ç‰©èªžã¯æ›´ã«ä½•åº¦ç›®ã‹ã®ã‚¢ãƒ—ãƒªå†…é€šçŸ¥å†å®Ÿè£…ã‚’è¿Žãˆã‚‹ / Reimplement in app notification again
Kyoto.ãªã‚“ã‹ #3ã®è³‡æ–™ã§ã™
yass 2017/08/19
redis

S3
ãƒªãƒ³ã‚¯
The mystery of the hanging S3 downloads
A coworker was experiencing a strange probl em with their Internet connection at home. Large downloads from most sites worked fine. The exception was that downloads from a Amazon S3 would get up to a good speed (500Mbps), stall completely for a few seconds, restart for a while, stall again, and eventually hang completely. The probl em seemed to be specific to S3, downloads from generic AWS VMs were
yass 2017/07/30
s3

tcp
ãƒªãƒ³ã‚¯
Route53 + SES + S3 + Lambda ã§ ç‹¬è‡ªãƒ‰ãƒ¡ã‚¤ãƒ³å®›ã®ãƒ¡ãƒ¼ãƒ«ã‚’Gmailã«è»¢é€ã™ã‚‹
ã‚¤ãƒŽãƒ™ãƒ¼ã‚·ãƒ§ãƒ³ã€€ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ãƒ–ãƒã‚° æ ªå¼ä¼šç¤¾ã‚¤ãƒŽãƒ™ãƒ¼ã‚·ãƒ§ãƒ³ã®ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ãŸã¡ã®æŠ€è¡“ç³»ãƒ–ãƒã‚°ã§ã™ã€‚ITãƒˆãƒ¬ãƒ³ãƒ‰ãƒ»List Finderã®é–‹ç™ºã‚’ãƒ™ãƒ¼ã‚¹ã«ã€æ¥å‹™å¤–ã§ã®æŠ€è¡“ç ”ç©¶ãªã©ã‚‚ãƒ–ãƒã‚°ã¨ã—ã¦ç™ºä¿¡ã—ã¦ã„ã£ã¦ã¾ã™ï¼
yass 2017/07/26
mail

s3

aws lambda

ses

Route53
ãƒªãƒ³ã‚¯
AWS Database Migration Serviceã§åœ§ç¸®ã—ãŸã‚Šãƒ•ã‚¡ã‚¤ãƒ«å½¢å¼ã‚’æŒ‡å®šã—ã¦S3ã«å‡ºåŠ›ã™ã‚‹ | DevelopersIO
AWS Database Migration Service(ä»¥ä¸‹ã€DMS)ã§ã¯ã‚¿ãƒ¼ã‚²ãƒƒãƒˆã«S3ã‚’é¸æŠžã§ãã¾ã™ã€‚ãƒ‡ãƒ•ã‚©ãƒ«ãƒˆã§ã¯CSVå½¢å¼ã€æœªåœ§ç¸®ã®çŠ¶æ…‹ã§S3ã«ãƒ•ã‚¡ã‚¤ãƒ«ãŒç½®ã‹ã‚Œã¾ã™ãŒTSVå½¢å¼ã«ã—ãŸã‚ŠGZIPåœ§ç¸®ã—ãŸã‹ã£ãŸã®ã§æ–¹æ³•ã‚’èª¿ã¹ã¾ã—ãŸ Management Consoleã§DMSã®ã‚¨ãƒ³ãƒ‰ãƒã‚¤ãƒ³ãƒˆã®è¨å®šç”»é¢ã‚’é–‹ã„ã¦ã€[ã‚¢ãƒ‰ãƒãƒ³ã‚¹ãƒˆ]-[è¿½åŠ ã®æŽ¥ç¶šæƒ…å ±]ã®ã¨ã“ã‚ã«è¨å®šã‚’è¿½åŠ ã—ã¾ã™ã€‚ åŒºåˆ‡ã‚Šæ–‡å—ã‚’è¨å®šã—ãŸã„å ´åˆã¯csvDelimiterã§å½¢å¼ã‚’æŒ‡å®šã—ã¦ã„ã¾ã™ã€‚ä»Šå›žã¯TSVå½¢å¼ã«ã—ãŸã‹ã£ãŸã®ã§csvDelimiter=\tã¨ã—ã¾ã—ãŸã€‚ æ¬¡ã«åœ§ç¸®ã—ãŸã„å ´åˆã¯compressionTypeã§å½¢å¼ã‚’æŒ‡å®šã—ã¦ã„ã¾ã™ã€‚GZIPã«ã™ã‚‹å ´åˆã¯compressionType=GZIPã¨ã—ã¾ã—ãŸã€‚ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã‚’è¦‹ãŸæ„Ÿã˜GZIPã—ã‹ã¾ã ãªã„ã‚ˆã†ã§ã™ã€‚è¤‡æ•°å±žæ€§ã‚’æŒ‡å®šã™ã‚‹å ´åˆã¯;(ã‚»ãƒŸã‚³ãƒãƒ³)ã§åŒºåˆ‡ã‚Šã¾ã™ã€‚ ã“ã‚Œä»¥
yass 2017/06/16
s3
ãƒªãƒ³ã‚¯
GitHub - anomalizer/ngx_aws_auth: nginx module to proxy to authenticated AWS services
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
yass 2017/02/10
nginx

s3

proxy
ãƒªãƒ³ã‚¯
S3 Reduced Redundancy Storage is (almost) dead â€“ Renato Losio
yass 2017/01/29
s3
ãƒªãƒ³ã‚¯
Storing Apache Hadoop Data on the Cloud - HDFS vs. S3
History is full of great rivalries: France versus England, Red Sox versus Yankees, Sherlock HolmesÂ versusÂ Moriarty, KenÂ versusÂ Ryu in Street Fighter... When it comes toÂ Apache HadoopÂ data storage in the cloud, though, the biggest rivalry lies between the Hadoop Distributed File System (HDFS) and Amazon's Simple Storage Service (S3). While Apache Hadoop has traditionally worked with HDFS, S3 also m
yass 2016/12/07
hadoop

s3

HDFS
ãƒªãƒ³ã‚¯
Revolutionizing S3 Storage Management with 4 new features
Weâ€™re excited to announce new features to the growing portfolio of Amazon S3 Storage Management capabilities to help you better analyze and manage your storage. Todayâ€™s release includes: S3 Object Tagging â€“ With S3 Object Tagging you can manage and control access for Amazon S3 objects. S3 Object Tags are key-value pairs applied to S3 objects which can be created, updated or deleted at any time dur
yass 2016/11/30
s3

CloudWatch
ãƒªãƒ³ã‚¯
AWS Storage Update â€“ S3 & Glacier Price Reductions + Additional Retrieval Options for Glacier | Amazon Web Services
AWS News Blog AWS Storage Update â€“ S3 & Glacier Price Reductions + Additional Retrieval Options for Glacier Back in 2006, we launched S3 with a revolutionary pay-as-you-go pricing model, with an initial price of 15 cents per GB per month. Over the intervening decade, we reduced the price per GB by 80%, launched S3 in every AWS Region, and enhanced the original one-size-fits-all model with user-dri
yass 2016/11/22
$0.025

s3

price

cost

Glacier
ãƒªãƒ³ã‚¯
GitHub - matiaskorhonen/shells3: A small(ish) shell script to upload files to S3 from the command line
yass 2016/07/30
shellscript

s3
ãƒªãƒ³ã‚¯
Uploading to S3 in 18 lines of Shell (used to upload builds for http://soltrader.net)
s3.sh @ï¿½ 3ï¿½U # You don't need Fog in Ruby or some other library to upload to S3 -- shell works perfectly fine # This is how I upload my new Sol Trader builds (http://soltrader.net) # Based on a modified script from here: http://tmont.com/blargh/2014/1/uploading-to-s3-in-bash S3KEY="my aws key" S3SECRET="my aws secret" # pass these in function putS3 { path=$1 file=$2 aws_path=$3 bucket='my-aws-buck
yass 2016/07/30
s3

shellscript

curl

OpenSSL

hmac
ãƒªãƒ³ã‚¯
Greenplum Can Now Do Hybrid Queries Across On-Premises & AWS S3 Data
One of the biggest challenges in modern computing is connecting data stored across the web with analytical data engines, often deployed on-premises, in near real-time. Pivotal Greenplum just made this challenge a lot easier by introducing Amazon Web Services Simple Storage Service (AWS S3) external table support. To put a finer point on the challenge, modern applications running in the public clou
yass 2016/04/29
greenplum

s3
ãƒªãƒ³ã‚¯
ã€æ–°æ©Ÿèƒ½ã€‘S3ã®ãƒ•ã‚¡ã‚¤ãƒ«æ•°ã¨ãƒã‚±ãƒƒãƒˆã‚µã‚¤ã‚ºãŒCloudWatchã«è¿½åŠ ã•ã‚Œã¾ã—ãŸ | DevelopersIO
ã©ã‚‚ã€å¤§ç€§ã§ã™ã€‚ æœ¬æ—¥æœªæ˜Žã«S3ã®æ©Ÿèƒ½è¿½åŠ ãŒã‚ã‚Šã€ãƒ•ã‚¡ã‚¤ãƒ«æ•°ã¨ãƒã‚±ãƒƒãƒˆã‚µã‚¤ã‚ºãŒCloudWatchã«è¿½åŠ ã•ã‚Œã¾ã—ãŸï¼ã‚‚ã†ä¸€ã¤ã®ã‚¢ãƒƒãƒ—ãƒ‡ãƒ¼ãƒˆã§ã‚ã‚‹S3 Event Notificationã®Deleteã‚¤ãƒ™ãƒ³ãƒˆè¿½åŠ ã¯ä»¥ä¸‹ã®ã‚¨ãƒ³ãƒˆãƒªãƒ¼ã‚’ã”è¦§ãã ã•ã„ã€‚ ã€æ–°æ©Ÿèƒ½ã€‘S3 Event Notificationã«Deleteã‚¤ãƒ™ãƒ³ãƒˆãŒè¿½åŠ ã•ã‚Œã¾ã—ãŸ ï½œ Developers.IO å¾“æ¥ã€S3ãƒã‚±ãƒƒãƒˆã«ä¿å˜ã—ã¦ã„ã‚‹ãƒ•ã‚¡ã‚¤ãƒ«ã®æ•°ã‚„ãƒã‚±ãƒƒãƒˆã‚µã‚¤ã‚ºã¯ã€å€‹åˆ¥ã«S3:Get*ã®APIã‚’å‘¼ã³å‡ºã—ã¦æƒ…å ±ã‚’å–å¾—ã™ã‚‹å¿…è¦ãŒã‚ã‚Šã€ç‰¹ã«ã‚µã‚¤ã‚ºã¯ãƒ•ã‚¡ã‚¤ãƒ«1ã¤1ã¤ã®ãƒ—ãƒãƒ‘ãƒ†ã‚£ã‚’è¦‹ã‚‹æ–¹æ³•ã—ã‹ã‚ã‚Šã¾ã›ã‚“ã§ã—ãŸã€‚ä»Šå›žã®ã‚¢ãƒƒãƒ—ãƒ‡ãƒ¼ãƒˆã«ã‚ˆã‚Šã€AWSæ¨™æº–ã®ç›£è¦–ã‚µãƒ¼ãƒ“ã‚¹ã§ã‚ã‚‹CloudWatchã®ãƒ¡ãƒˆãƒªãƒƒã‚¯ã‚¹(ç›£è¦–é …ç›®)ã¨ã—ã¦ãƒ•ã‚¡ã‚¤ãƒ«æ•°ã¨ãƒ•ã‚¡ã‚¤ãƒ«ã‚µã‚¤ã‚ºã®åˆè¨ˆãŒå–å¾—ã§ãã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã—ãŸã€‚ è¨å®šæ–¹æ³• æ—¢å®šã§S3ã®ä¸‹è¨˜ãƒ¡ãƒˆãƒªã‚¯ã‚¹ãŒCloudWat
yass 2015/12/09
" RRS(Reduced Redundancy Storage)ã¯é€šå¸¸(Standard)ã¨åˆ¥ãƒ¡ãƒˆãƒªãƒƒã‚¯ã‚¹ã«ãªã‚Šã¾ã™ã€‚ã¾ãŸã€ãƒ©ã‚¤ãƒ•ã‚µã‚¤ã‚¯ãƒ«ãƒãƒªã‚·ãƒ¼ã§Glacierã¸ã®å¾…é¿è¨å®šã‚’æœ‰åŠ¹ã«ã—ã¦ã„ã‚‹å ´åˆã€Glacierã«å¾…é¿æ¸ˆã¿ã®ã‚ªãƒ–ã‚¸ã‚§ã‚¯ãƒˆã¯é›†è¨ˆå¯¾è±¡ã«å«ã¾ã‚Œã¾ã›ã‚“ã€‚"

s3

CloudWatch
ãƒªãƒ³ã‚¯
S3ã€Kinesis/DynamoDB Streamsã§ã®Lambdaãƒªãƒˆãƒ©ã‚¤å‡¦ç† - Qiita
ã“ã¡ã‚‰ã®è¨˜äº‹ã®å†…å®¹ã¨ç¾åœ¨ã®ãƒªãƒˆãƒ©ã‚¤å‹•ä½œã¯ç•°ãªã£ã¦ã„ã¾ã™ã€‚ è©³ç´°ã¯ä¸‹è¨˜ã®å…¬å¼ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã‚’å‚ç…§ã—ã¦ãã ã•ã„ã€‚ ã‚¨ãƒ©ãƒ¼æ™‚ã®ãƒªãƒˆãƒ©ã‚¤ - AWS Lambdaå…¬å¼ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆ AWS Lambda ã®ã‚¤ãƒ™ãƒ³ãƒˆã‚½ãƒ¼ã‚¹ã”ã¨ã®å‘¼ã³å‡ºã—ã‚¿ã‚¤ãƒ— - Qiita æ¦‚è¦ Lambda ãƒ•ã‚¡ãƒ³ã‚¯ã‚·ãƒ§ãƒ³å†…ã§ context.done() ã®ç¬¬1å¼•æ•°ã« null ä»¥å¤–ã®å€¤ã‚’æ¸¡ã™ã¨å‡¦ç†å¤±æ•—ã¨ãªã‚Šãƒªãƒˆãƒ©ã‚¤ãŒç™ºç”Ÿã™ã‚‹ã€‚ å„ã‚¤ãƒ™ãƒ³ãƒˆã‚½ãƒ¼ã‚¹ã«ã‚ˆã‚‹ãƒªãƒˆãƒ©ã‚¤å‡¦ç†ã‚’èª¿ã¹ã¦ã¿ãŸã€‚ å‡¦ç†å¤±æ•—æ™‚ã«ã¯ 3 åˆ†å¾Œã«å†åº¦ãƒ•ã‚¡ãƒ³ã‚¯ã‚·ãƒ§ãƒ³ãŒå‘¼ã³å‡ºã•ã‚Œã‚‹ã€‚ context.invokeid ã¯å‰å›žã¨åŒã˜å€¤ã«ãªã‚‹ã€‚ ãƒªãƒˆãƒ©ã‚¤ã‚’å«ã‚ã¦æœ€å¤§ 3 å›žå®Ÿè¡Œã•ã‚Œã‚‹ã€‚ ETagã®æ¯”è¼ƒ US Standard ã¯å…¨ã¦ã®æ“ä½œã§çµæžœæ•´åˆæ€§ã€ãã‚Œä»¥å¤–ã®ãƒªãƒ¼ã‚¸ãƒ§ãƒ³ã§ã¯æ–°è¦ä½œæˆä»¥å¤–ã®æ“ä½œã§çµæžœæ•´åˆæ€§ã‚’ã‚‚ã£ã¦å‹•ä½œã™ã‚‹ã€‚ Lambda ã«é™ã‚‰ãš S3 ã®ã‚ªãƒ–ã‚¸ã‚§ã‚¯ãƒˆã‚’å–å¾—ã™ã‚‹å ´
yass 2015/11/07
Kinesis

aws lambda

retry

s3
ãƒªãƒ³ã‚¯
Now Send Payloads up to 2GB with Amazon SQS
Amazon Simple Queue Service (SQS) now has an Extended Client Library that enables you to send and receive messages with payloads up to 2GB. Previously, message payloads were limited to 256KB. Using the Extended Client Library, message payloads larger than 256KB are stored in an Amazon Simple Storage Service (S3) bucket, using SQS to send and receive a reference to the payload location. Large paylo
yass 2015/10/28
sqs

s3
ãƒªãƒ³ã‚¯
Kinesisã‹S3ã‹
Kinesisã‚’è§¦ã£ã¦ã¯ã¿ãŸã‚‚ã®ã®ã€ç‰¹åˆ¥ã€Œã“ã‚Œã¯ä½¿ã„ã‚„ã™ã„ï¼ã€ã¨ã„ã†å°è±¡ã§ã¯ãªã‹ã£ãŸã€‚ Kinesisã®ç”¨é€”ã¯è¦ã™ã‚‹ã« AWSã«ã‚¬ãƒ³ã‚¬ãƒ³ãƒ‡ãƒ¼ã‚¿ã‚’é€ã‚‹ AWSå´ã§ã¯ã€é€ã‚‰ã‚Œã¦ããŸãƒ‡ãƒ¼ã‚¿ã‚’ç‰‡ã£ç«¯ã‹ã‚‰å‡¦ç†ã™ã‚‹ AWSå´ã«ç€ã„ãŸãƒ‡ãƒ¼ã‚¿ã¯å‡¦ç†ã—ã‚ˆã†ãŒã—ã¾ã„ãŒä¸€å®šæœŸé–“(ç¾åœ¨ã¯24æ™‚é–“)ã§æ¶ˆãˆã‚‹ ã¨ã„ã†ã‚‚ã®ã€‚ ã—ã‹ã—ã€AWSã¸ã®é€ä¿¡ã¯å˜ç´”ã«HTTPSã®POSTãƒªã‚¯ã‚¨ã‚¹ãƒˆã§ã‚ã‚Šã€ã•ã‚‰ã«Base64ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ã•ã‚Œã¦ã„ã‚‹ã¨ã„ã†ã“ã¨ã§ç‰¹ã«åŠ¹çŽ‡çš„ãªæ–¹æ³•ã§ã¯ãªã„ã€‚ã‚€ã—ã‚åŠ¹çŽ‡ã‚’ã¾ã£ãŸãè€ƒæ…®ã—ã¦ãŠã‚‰ãšã€ã‚·ãƒ³ãƒ—ãƒ«ã•ã€æ‰±ã„ã‚„ã™ã•ã«å¾¹ã—ã¦ã„ã‚‹ã€‚ HTTPSã®POSTãƒªã‚¯ã‚¨ã‚¹ãƒˆã§ã‚ã‚‹ã«ã‚‚é–¢ã‚ã‚‰ãšã‚µã‚¤ã‚ºä¸Šé™(ç¾åœ¨ã¯50KB)ãŒãã¤ã„ã®ã§ã€å°ã•ãªãƒ‡ãƒ¼ã‚¿ã‚’é€ã‚‹ç”¨é€”ã«é™å®šã•ã‚Œã‚‹ã€‚ å€‹äººçš„ã«æ•°åï½žç™¾å°ç¨‹åº¦ã®ã‚µãƒ¼ãƒã‹ã‚‰AWSã¸ã®ãƒã‚°ã®é›†ç´„(Log Aggregation)ã‚’è¨ˆç”»ã—ã¦ã„ã‚‹ã®ã ãŒã€Kinesisã®ç”¨é€”ã«ã´ã£ãŸã‚Šã‹ï¼Ÿã¨è€ƒãˆãŸä¸€æ–¹
yass 2015/10/12
" æ•°ç™¾ï½žåƒ/ç§’ä»¥ä¸Šã®ã€ãã‚Œãžã‚Œã®ã‚µã‚¤ã‚ºã¯ãã‚Œã»ã©å¤§ãããªã„ãƒ‡ãƒ¼ã‚¿ã‚’æ‰±ã„ãŸã„å ´åˆã«ã¯Kinesisã€ï½žæ•°ç™¾/ç§’ã§ãã‚Œãžã‚Œã®ãƒ‡ãƒ¼ã‚¿ã®ã‚µã‚¤ã‚ºã¯ãã‚Œãªã‚Šã«å¤§ãããªã‚‹ï¼ˆ50KBä»¥ä¸Šï¼‰å ´åˆã«ã¯S3ã ã‚ã†ã‹ã€‚"

s3

kinesis
ãƒªãƒ³ã‚¯
1 2 3 4 5 6 7 8 9 æ¬¡ã®ãƒšãƒ¼ã‚¸

ãŠçŸ¥ã‚‰ã›

ã‚‚ã£ã¨èªã‚€

å…¬å¼Twitter

@HatenaBookmark
ãƒªãƒªãƒ¼ã‚¹ã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“ã‚¹ã®ãŠçŸ¥ã‚‰ã›
@hatebu
æœ€æ–°ã®äººæ°—ã‚¨ãƒ³ãƒˆãƒªãƒ¼ã®é…ä¿¡

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

jæ¬¡ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

kå‰ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

lã‚ã¨ã§èªã‚€

eã‚³ãƒ¡ãƒ³ãƒˆä¸€è¦§ã‚’é–‹ã

oãƒšãƒ¼ã‚¸ã‚’é–‹ã

è¨å®šã‚’å¤‰æ›´ã—ã¾ã—ãŸx