[B! fluentd][fluent] beth321ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

beth321 id:beth321

fluentdã¨fluentã«é–¢ã™ã‚‹beth321ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (16)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

FluentdãŒKubernetesã®æ¨™æº–ãƒã‚°åŽé›†ãƒ„ãƒ¼ãƒ«ã¨ã—ã¦æŽ¡ç”¨
GoogleãŒã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã¨ã—ã¦å…¬é–‹ã—ãŸKubernetesã¯ã€ã‚³ãƒ³ãƒ†ãƒŠåž‹ä»®æƒ³åŒ–ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã®Dockerã‚’ç®¡ç†ã™ã‚‹ãƒ„ãƒ¼ãƒ«ã§ã™ã€‚é–‹ç™ºãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã«ã¯Dockerã€RedHatã€IBMã€VMwareã€ãƒžã‚¤ã‚¯ãƒã‚½ãƒ•ãƒˆãªã©å¤šæ•°ã®ä¼æ¥ãŒå‚åŠ ã‚’è¡¨æ˜Žã—ã¦ã„ã¾ã™ã€‚ Kubernetesã¯ã€è¤‡æ•°ã®Dockerã‚³ãƒ³ãƒ†ãƒŠã«ã¾ã¨ã‚ã¦ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‚’ãƒ‡ãƒ—ãƒã‚¤ã—ã€è¨å®šã‚’è¡Œã„ã€ç¨¼åƒçŠ¶æ³ã‚’ç›£è¦–ã€ç®¡ç†ã—ã€ã‚µãƒ¼ãƒ“ã‚¹ã¸ã®ãƒˆãƒ©ãƒ•ã‚£ãƒƒã‚¯ã‚’ãƒ«ãƒ¼ãƒ†ã‚£ãƒ³ã‚°ã™ã‚‹ãªã©ã€ã‚¯ãƒ©ã‚¹ã‚¿ã¨ã—ã¦Dockerã‚’é‹ç”¨ã™ã‚‹ãŸã‚ã®å¤šãã®æ©Ÿèƒ½ã‚’å‚™ãˆã¦ã„ã¾ã™ã€‚ ã“ã®Kubernetesã§ä½¿ã‚ã‚Œã‚‹æ¨™æº–ã®ãƒã‚°åŽé›†ãƒ„ãƒ¼ãƒ«ã¨ã—ã¦ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®fluentdãŒæŽ¡ç”¨ã•ã‚ŒãŸã“ã¨ãŒæ˜Žã‚‰ã‹ã«ãªã‚Šã¾ã—ãŸã€‚ä¸‹è¨˜ã¯ãã‚Œã‚’ä¼ãˆã‚‹Googleä½è—¤æ°ã®ãƒ„ã‚¤ãƒ¼ãƒˆã€‚ fluentdãŒKubernetesã®æ¨™æº–ãƒã‚°ã‚³ãƒ¬ã‚¯ã‚¿ã«æŽ¡ç”¨ã•ã‚ŒãŸãœï¼ï¼ï¼ https://t.co/V8VDM4IE7e
beth321 2014/11/11
Publickey

elasticsearch

fluentd

ãƒ›ãƒƒãƒˆã‚¨ãƒ³ãƒˆãƒª

kubernetes

docker

google

ã‚ã¨ã§èªã‚€

ãƒã‚°

fluent
ãƒªãƒ³ã‚¯
fluentdã§é›†ç´„ã—ãŸerror_logã‚’slackã«æµã™ã¨æ—ã‚‹ - UNIXçš„ãªã‚¢ãƒ¬
nanapiã§ã¯ç¤¾å†…ã®ãƒãƒ£ãƒƒãƒˆãƒ„ãƒ¼ãƒ«ã«ã€Slackã‚’å°Žå…¥ã—ã¦ã„ã¾ã™ã€‚Slackã®ä¾¿åˆ©ãªã¨ã“ã‚ã¯integrationå‘¨ã‚Šã§ã€è¦ã™ã‚‹ã«ä»–ã®ãƒ„ãƒ¼ãƒ«ã¨ã®é€£æºãŒéžå¸¸ã«ã—æ˜“ã„ã‚“ã§ã™ãã€‚ãã†ã„ã£ãŸã€Chatã‚’ä¸å¿ƒã«ã—ãŸæ¥å‹™åŠ¹çŽ‡åŒ–ã‚’æœ€è¿‘ã§ã¯ChatOpsã¨å‘¼ã‚“ã ã‚Šã—ã¾ã™ã€‚ http://nanapi.co.jp/blog/2014/07/24/nanapi_chatops/ ChatOpsã®é‡è¦ãªç‚¹ã¯ã‚³ãƒ³ãƒ†ã‚ã‚¹ãƒˆã‚’å…±æœ‰ã§ãã‚‹ç‚¹ã§ã™ã‚ˆãã€‚ã€Œâ—‹â—‹ã£ã¦ã‚¨ãƒ©ãƒ¼ãƒã‚°ãŒå‡ºã¦ã‚‹ã‚ˆã€ã¿ãŸã„ãªæƒ…å ±ã‚’ç›´æŽ¥èª°ã‹ã«ä¼ãˆã‚‹ã®ã§ã¯ãªãã€ãƒã‚°ãŒå‡ºã¦ã„ã‚‹ã¨ã„ã†çŠ¶æ…‹ã‚’Chatã‚’çµŒç”±ã—ã¦åŒã˜ã‚‚ã®ã‚’è¦‹ã‚‹ã“ã¨ã§ã€èª¬æ˜ŽãŒéžå¸¸ã«ãƒ©ã‚¯ã«ãªã‚Šã¾ã™ã€‚ ã»ã‹ã«ã‚‚ãƒ‡ãƒ—ãƒã‚¤ã‚’HubotçµŒç”±ã§æŒ‡ç¤ºã—ãŸã‚Šã€ã‚¹ãƒ†ãƒ¼ã‚¿ã‚¹å–å¾—ã‚’ã—ãŸã‚Šãªã©æ§˜ã€…ãªä½¿ã„æ–¹ãŒã‚ã‚Šã¾ã™ãŒã‚„ã¯ã‚Šé‡è¦ãªã®ã¯åŒã˜ç”»é¢ã‚’çš†ãŒè¦‹ã¦ã„ã‚‹ã¨ã„ã†ã“ã¨ã§ã™ãã€‚ãã†ã„ã£ãŸç‚¹ãŒChatOpsã®å¤§ããªãƒ¡ãƒªãƒƒãƒˆã¨ã—ã¦ã‚
beth321 2014/08/19
fluentd

slack

devops

chat

fluent

ChatOps

error

vagrant

nanapi

log
ãƒªãƒ³ã‚¯
GitHub - fluent/fluentd-ui: Web UI for Fluentd
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
beth321 2014/08/02
fluentd

ui

repos

fluentd-ui

DevOps

rails

tool

github

fluent
ãƒªãƒ³ã‚¯
Quickstart Guide | Fluentd
Letâ€™s get started with Fluentd! Fluentd is a fully free and fully open-source log collector that instantly enables you to have a â€˜Log Everythingâ€™ architecture with 125+ types of systems. Fluentd treats logs as JSON, a popular machine-readable format. It is written primarily in C with a thin-Ruby wrapper that gives users flexibility. Fluentdâ€™s scalability has been proven in the field: its largest u
beth321 2014/08/01
fluentd

log

tool

ãƒã‚°

fluent

server

document

package

install

ruby
ãƒªãƒ³ã‚¯
Fluentd | Open Source Data Collector
Fluentd is an open source data collector for unified logging layer. Fluentd allows you to unify data collection and consumption for a better use and understanding of data.
beth321 2014/03/24
fluent

ruby

fluentd

json

log

server

logging

development

mongodb

software
ãƒªãƒ³ã‚¯
fluent-plugin-config_pit - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼
fluentd ã‚’ä½¿ã£ã¦å±…ã¦ s3 ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ãªã‚“ã‹ã‚’ä½¿ã†ã¨ãã«å„ç¨®APIã‚ãƒ¼ãªã©ã‚’è¨å®šãƒ•ã‚¡ã‚¤ãƒ«ã«æ›¸ã„ãŸã‚Šã™ã‚‹ã®ãŒå¾®å¦™ãªå ´åˆãŒã‚ã‚‹ã®ã§ã€è¨å®šå†…ã§ pit ã‚’ä½¿ã„ãŸã„ã€‚ã®ã§ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã‚’ä½œã‚Šã¾ã—ãŸã€‚ <match my.tag> type config_pit <pit aws> type s3 ... aws_key_id $pit[aws_access_key] aws_sec_key $pit[aws_secret_access_key] ... </pit> </match>ã“ã‚“ãªæ„Ÿã˜ã§è¨å®šã—ã¦ã‚„ã‚‹ã¨è©²å½“ç®‡æ‰€ã‚’ pit ã«ä¿å˜ã•ã‚Œã¦ã„ã‚‹å€¤ã§ç½®ãæ›ãˆã¾ã™ã€‚pit aws ã® "aws" ãŒ pit ã® ID ã§ã™ã€‚ github : https://github.com/naoya/fluent-plugin-config_pit rubygems : https://rubygems.
beth321 2014/02/13
ã‚ã¨ã§ã¿ã‚‹

naoya-ito

fluentd

fluent

plugin

hatena-bookmark

*ã‚ã¨ã§

aws

security

naoya
ãƒªãƒ³ã‚¯
åºƒå‘Šãƒã‚°è§£æžåŸºç›¤ã«Fluentdã‚’ä½¿ã£ã¦ã„ã‚‹è©± - ã™ãšã‘ã‚“ãƒ¡ãƒ¢
ã“ã‚Œã¯Fluentd Advent Calendar 14æ—¥ç›®ã®è¨˜äº‹ã§ã™ã€‚ ç§ã¯ç¾åœ¨ã€VOYAGE GROUPã®åä¼šç¤¾ã§ã‚ã‚‹adingoã§ã€DMP cosmiã®é–‹ç™ºã‚’ã—ã¦ã„ã¾ã™ã€‚ä»Šæ—¥ã¯cosmiã§ã®fluentdåˆ©ç”¨ã®è©±ã‚’ã—ã‚ˆã†ã¨æ€ã„ã¾ã™ã€‚ DMPã«ã¤ã„ã¦ éŽåŽ»ã«å‹‰å¼·ä¼šã§ã‚¢ãƒ‰ãƒ†ã‚¯ã¾ã‚ã‚ŠåŠã³DMPã«ã¤ã„ã¦è©±ã—ãŸã®ã§ãã‚Œã‚’è²¼ã£ã¦ãŠãã¾ã™ã€‚ã–ã£ã¨ã„ã†ã¨ã€ã„ã„æ„Ÿã˜ã«ã„ã‚ã‚“ãªãƒã‚°ã‚’å—ã‘ã„ã‚‰ã‚Œã‚‹ã‚ˆã†ã«ã—ã¦ã€ãã‚Œã‚‰ã‚’ãƒ¢ãƒ‹ã‚¿ãƒªãƒ³ã‚°ã—ãªãŒã‚‰æ•´ç†ã—ã¦ä½¿ãˆã‚‹ã‚ˆã†ã«ã™ã‚‹ã€ã¨ã„ã†å½¹å‰²ã‚’ã‚‚ã£ãŸãƒ—ãƒãƒ€ã‚¯ãƒˆã§ã™ã€‚ Head First Ad Techno logy and DMP http://www.slideshare.net/suzuken/head-first-ad-techno logy-and-dmp ã©ã“ã§ä½¿ã£ã¦ã„ã‚‹ã‹ ã»ã¼å…¨ã¦ã§ã™ã€‚æ§‹æˆã¨ã—ã¦ã¯ ãƒã‚°åŽé›†ã‚µãƒ¼ãƒ | | out-forward (roundro
beth321 2013/12/15
fluentd

adtech

aws

ã‚¤ãƒ³ãƒ•ãƒ©

dmp

ã‚µãƒ¼ãƒ

ãƒã‚°

fluent
ãƒªãƒ³ã‚¯
fluentd(td-agent) ã®å°Žå…¥ | Raccoon Tech Blog [æ ªå¼ä¼šç¤¾ãƒ©ã‚¯ãƒ¼ãƒ³ãƒ›ãƒ¼ãƒ«ãƒ‡ã‚£ãƒ³ã‚°ã‚¹ æŠ€è¡“æˆ¦ç•¥éƒ¨ãƒ–ãƒã‚°]
æ ªå¼ä¼šç¤¾ãƒ©ã‚¯ãƒ¼ãƒ³ãƒ›ãƒ¼ãƒ«ãƒ‡ã‚£ãƒ³ã‚°ã‚¹ã®ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢/ãƒ‡ã‚¶ã‚¤ãƒŠãƒ¼ã‹ã‚‰æŠ€è¡“æƒ…å ±ã‚’ã¯ã˜ã‚ã€ä¸–ã®ä¸ã®ãŸã‚ã«ãªã‚‹ã“ã¨ã‚„ç¤¾å†…ã®ã“ã¨ãªã©ã‚’ç™ºä¿¡ã—ã¦ã¾ã™ã€‚ Rubyfluentdtd-agentlog ã¯ã˜ã‚ã¾ã—ã¦ã€‚é–‹ç™ºãƒãƒ¼ãƒ ã®Â yuzukiÂ ã§ã™ã€‚ 7/1ã«å¼Šç¤¾ã® æ±ºæ¸ˆã‚µãƒ¼ãƒ“ã‚¹Paidï¼ˆãƒšã‚¤ãƒ‰ï¼‰ ã®ã‚µãƒ¼ãƒãƒ¼ç¾¤ã¸ ãƒã‚°é›†ç´„ã®æ”¹å–„ã‚’ç›®çš„ã¨ã—ã¦å°Žå…¥ã—ãŸ fluentd(td-agent) ã®å°Žå…¥æ‰‹é †ãªã©ã‚’ã¾ã¨ã‚ã¦ã¿ã¾ã—ãŸã€‚ ãƒã‚°é›†ç´„ã‚’æ”¹å–„ã™ã‚‹å‹•æ©Ÿ å¼Šç¤¾ã§ã¯ã“ã‚Œã¾ã§ï¼ˆä»Šã‚‚å¤§éƒ¨åˆ†ã¯ï¼‰ cron + rsync ã‚’ä½¿ã„ã€é€±æ¬¡ãƒãƒƒãƒã§Webã‚µãƒ¼ãƒãƒ¼ä¸Šã®ãƒã‚°ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ãƒ•ã‚¡ã‚¤ãƒ«ã‚µãƒ¼ãƒãƒ¼ã¸è»¢é€ã™ã‚‹ã“ã¨ã§ä¸€å¿œã®é›†ç´„ã‚’ã•ã›ã¦ãã¾ã—ãŸã€‚ ï¼ˆé›†ç´„ã¨ã„ã†ã‚ˆã‚Šã¯ãƒãƒƒã‚¯ã‚¢ãƒƒãƒ—ã¨ã„ã£ãŸæ„å‘³åˆã„ã®æ–¹ãŒå¼·ã„ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ï¼‰ ã‚µãƒ¼ãƒãƒ¼å°æ•°ãŒå°‘ãªã‹ã£ãŸé ƒã¯ã“ã®ä»•çµ„ã¿ã§ã‚‚ç‰¹ã«å¤§ããªå•é¡Œã¯ãªã‹ã£ãŸã¨æ€ã„ã¾ã™ãŒã€ ã‚µãƒ¼ãƒ“ã‚¹ã®æˆé•·ã«ã‚ã‚ã›ã¦ã€ã‚µãƒ¼ãƒãƒ¼å°æ•°ãŒå¢—ãˆ
beth321 2013/12/03
fluentd

ãƒã‚°

fluent

apache

rsync

cron

via Pocket

log

ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°

ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°
ãƒªãƒ³ã‚¯
Fluentdã¨Redisã‚’ä½¿ã£ãŸãƒ©ãƒ³ã‚ãƒ³ã‚°æ©Ÿèƒ½ã®å®Ÿè£… | SmartNewsé–‹ç™ºè€…ãƒ–ãƒã‚°
ã‚´ã‚¯ãƒã®å¤§å¹³ã§ã™ã€‚ã”ãã‚ã†ã•ã¾ã§ã™ã€‚ Redisã¯é«˜é€Ÿã§ã€ã‹ã¤ãƒ‡ãƒ¼ã‚¿ã®æ°¸ç¶šåŒ–ã‚„ã€è¤‡æ•°ã®ãƒ‡ãƒ¼ã‚¿åž‹ã«ã‚ˆã‚‹ã‚¹ãƒˆã‚¢(list,set,sorted setç‰ï¼‰ã‚‚å¯¾å¿œã—ã¦ãŠã‚Šã€æ©Ÿèƒ½çš„ãŒè±Šå¯Œã¨ã„ã†ã“ã¨ã‹ã‚‰æ„›ç”¨è€…ã®å¤šã„KVSå®Ÿè£…ã®ä¸€ã¤ã ã¨æ€ã„ã¾ã™ã€‚ ç‰¹ã«ç§ã®ã‚ˆã†ãªã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®äººé–“ã«ã¨ã£ã¦ã¯ãƒ‡ãƒ¼ã‚¿åž‹ã®ãƒãƒªã‚¨ãƒ¼ã‚·ãƒ§ãƒ³ã®è±Šå¯Œã•ãŒä¾¿åˆ©ã•ã‚’æ„Ÿã˜ã‚‹éƒ¨åˆ†ã§ã€ãŸã¨ãˆã°listã‚’ç”¨ã„ã¦ã‚¿ã‚¤ãƒ ãƒ©ã‚¤ãƒ³çš„ãªæƒ…å ±ã‚„å±¥æ´æƒ…å ±ã®ç®¡ç†ã€sorted setã‚’ç”¨ã„ã¦ãƒ©ãƒ³ã‚ãƒ³ã‚°æƒ…å ±ã®ç®¡ç†ã€ãªã©ã®ã‚ˆã†ã«ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã®éœ€è¦ã®å¤šãã«RedisãŒå¯¾å¿œã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ ã“ã‚Œã‚‰ã®æƒ…å ±ã‚’ç™»éŒ²ã™ã‚‹éš›ã®ãƒ•ãƒãƒ¼ã¨ã—ã¦ã¯è‡ªä½œã®ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‹ã‚‰ç›´æŽ¥ã€ã¨ã„ã†ã‚±ãƒ¼ã‚¹ãŒå¤šã„ã¨æ€ã„ã¾ã™ãŒã€ã›ã£ã‹ãFluentdã®ã‚ˆã†ãªä¾¿åˆ©ãªlog collectorå®Ÿè£…ãŒã‚ã‚‹ã®ã§ã€Fluentdã¨Redisã‚’çµ„ã¿åˆã‚ã›ã‚‹äº‹ã§ã‚«ã‚¸ãƒ¥ã‚¢ãƒ«ã«æƒ…å ±ã®è“„ç©ã‚’è¡Œã„ãŸã„
beth321 2013/09/25
fluentd

redis

ãƒ©ãƒ³ã‚ãƒ³ã‚°

ãƒ‡ãƒ¼ã‚¿

ranking

algorithm

*ã‚ã¨ã§èªã‚€

fluent

**ã‚ã¨ã§è©¦ã™

key
ãƒªãƒ³ã‚¯
Kibana 3 + Rails + Fluentdã®ã‚µãƒ³ãƒ—ãƒ«ã‚¢ãƒ—ãƒªã‚’ä½œã£ã¦ã¿ãŸ - y_310's diary
miyagawaã•ã‚“ã®Podcast Rebuild: 19ã§Kibanaã®è©±ãŒã‚ã£ã¦ã¡ã‚‡ã£ã¨ç››ã‚Šä¸ŠãŒã‚Šå§‹ã‚ã¦ã‚‹ã®ã§ã€ç°¡å˜ã«å‹•ä½œã‚’è©¦ã›ã‚‹ã‚µãƒ³ãƒ—ãƒ«ã‚¢ãƒ—ãƒªã‚»ãƒƒãƒˆã‚’ä½œã£ã¦ã¿ã¾ã—ãŸã€‚ https://github.com/y310/kibana-trial git cloneã—ã¦READMEã«æ›¸ã„ã¦ã‚ã‚‹æ‰‹é †ã‚’å®Ÿè¡Œã—ã¦ã„ãã¨å¤§ä½“å‹•ãã¨æ€ã„ã¾ã™ã€‚ railsã‹ã‚‰fluentdã«ãƒã‚°ã‚’é€ã‚‹éƒ¨åˆ†ã¯ã€ã“ã‚“ãªæ„Ÿã˜ã§rack middlewareã‚’ä½¿ã£ã¦é€ã‚Šã¾ã™ã€‚ # application_controller.rb class ApplicationController < ActionController::Base around_filter :collect_metrics def collect_metrics yield # ensureã‚’ä½¿ã†ã®ã¯ä¾‹å¤–æ™‚ã®ãƒã‚°ã‚‚æ•æ‰ã™ã‚‹ãŸã‚ ensure # co
beth321 2013/09/12
app

kibana

fluentd

rails

ruby

app

fluent

class

rack

log
ãƒªãƒ³ã‚¯
S3ã¨Fluentdã‚’ç”¨ã„ãŸåŠ¹çŽ‡çš„ãªãƒã‚°ç®¡ç† | SmartNewsé–‹ç™ºè€…ãƒ–ãƒã‚°
ã‚´ã‚¯ãƒã®å¤§å¹³ã§ã™ã€‚ ç§ã«ã¨ã£ã¦ä¸€ç•ªå¤§äº‹ã§æ›¿ãˆã®åŠ¹ã‹ãªã„ãƒŸãƒ¥ãƒ¼ã‚¸ã‚·ãƒ£ãƒ³ã¯ã•ã ã¾ã•ã—ã•ã‚“ã§ã™ãŒã€ç§ã«ã¨ã£ã¦ã‚¯ãƒ©ã‚¦ãƒ‰ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ãƒ†ã‚£ãƒ³ã‚°ã®ã‚µãƒ¼ãƒ“ã‚¹ã®ä¸ã§ä¸€ç•ªå¤§äº‹ã§æ›¿ãˆãŒåŠ¹ã‹ãªã„ã‚µãƒ¼ãƒ“ã‚¹ã¯S3ã§ã™ã€‚ å¤šç¨®å¤šæ§˜ãªAPIã‚’ç”¨ã„ã¦æŸ”è»Ÿã«ãƒ•ã‚¡ã‚¤ãƒ«ã®æ“ä½œãŒå‡ºæ¥ã‚‹äº‹ã‚„ã€â€99.999999999ï¼…â€ã¨è¬³ã‚ã‚Œã¦ã„ã‚‹é«˜ã„è€éšœå®³æ€§ã€S3ã«ã‚ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚’Elastic MapReduceã‚„Redshiftãªã©ã‚’ç”¨ã„ã¦æ‰‹è»½ã«ãƒ‡ãƒ¼ã‚¿è§£æžã‚’è¡Œãˆã‚‹åŸºç›¤ãŒæä¾›ã•ã‚Œã¦ã„ã‚‹ã“ã¨ãªã©ã€ã‚ã¾ã‚Šã«ä¾¿åˆ©ã™ãŽã¦S3ã®ä»£æ›¿ã¨ãªã‚‹ã‚µãƒ¼ãƒ“ã‚¹ã‚’æŽ¢ã—ã ã™ã®ãŒé›£ã—ã„çŠ¶æ…‹ã§ã™ã€‚ ã‚‚ã¡ã‚ã‚“å¤šãã®AWSãƒ¦ãƒ¼ã‚¶ãƒ¼ãŒåŒã˜ã‚ˆã†ã«S3ã®ä¾¿åˆ©ã•ã‚’äº«å—ã—ã¦ã„ã‚‹ã¨æ€ã„ã¾ã™ã—ã€ã‚¤ãƒ³ã‚¿ãƒ¼ãƒãƒƒãƒˆä¸Šã§ã‚‚å¤šãã®ãƒ–ãƒã‚°ç‰ã§ãã®é…åŠ›ãŒèªžã‚‰ã‚Œã¦ã„ã¾ã™ã€‚ãã®ä¸ã§æœ¬è¨˜äº‹ã¯æ—¢ã«å˜åœ¨ã™ã‚‹è¨˜äº‹ã¨ä¼¼ãŸã‚ˆã†ãªå†…å®¹ã‚’æ›¸ã„ã¦ã—ã¾ã†ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ãŒã€å¼Šç¤¾ãªã‚Šã®S3ã®ä½¿ã„æ–¹ã«ã¤ã„ã¦ã”ç´¹ä»‹ã—ãŸã„ã¨æ€ã„ã¾ã™ã€‚ ãªãŠ
beth321 2013/09/02
fluentd

aws

s3

log

fluent

ãƒã‚°

amazon s3

#Tech

ãƒ‡ãƒ¼ã‚¿

amazon
ãƒªãƒ³ã‚¯
â€œã‚·ãƒªã‚³ãƒ³ãƒãƒ¬ãƒ¼ã®æŠ€è¡“è€…é›†å›£â€ã§ã¯ãƒˆãƒ¬ã‚¸ãƒ£ãƒ¼ãƒ‡ãƒ¼ã‚¿ã‚’è¦‹èª¤ã‚‹ (1/5)
ã‚·ãƒªã‚³ãƒ³ãƒãƒ¬ãƒ¼ã®æ—¥æœ¬äººãƒ™ãƒ³ãƒãƒ£ãƒ¼ã¨ã—ã¦æ³¨ç›®åº¦ã®é«˜ã„ãƒˆãƒ¬ã‚¸ãƒ£ãƒ¼ãƒ‡ãƒ¼ã‚¿ã®CTOã§ã‚ã‚‹å¤ªç”°ä¸€æ¨¹æ°ã¨ã®ã‚¤ãƒ³ã‚¿ãƒ“ãƒ¥ãƒ¼ãŒå®Ÿç¾ã—ãŸã€‚CEOèŠ³å·è£•èª æ°ã®å®¶ã®ãƒ™ãƒ©ãƒ³ãƒ€ã¨ç†±æµ·ã®æ¸©æ³‰ã§å§‹ã¾ã£ãŸä¼šç¤¾ã®èµ·æ¥ç‰©èªžã‚„ã‚µãƒ¼ãƒ“ã‚¹ã®ãƒã‚¤ãƒ³ãƒˆãªã©ã‚’èžã„ãŸ1æ™‚é–“ã®ã‚¤ãƒ³ã‚¿ãƒ“ãƒ¥ãƒ¼ã‚’ã»ã¼åŠ å·¥ãªã—ã§æŽ²è¼‰ã™ã‚‹ã€‚ Hadoopã®ãƒãƒ†ãƒ³ã‚·ãƒ£ãƒ«ã‚’æ„Ÿã˜å§‹ã‚ãŸã¨ãã«å£°ã‚’ã‹ã‘ã¦ã‚‚ã‚‰ã£ãŸ TECH.ASCII.jp å¤§è°·ï¼ˆä»¥ä¸‹ã€TECH å¤§è°·ï¼‰ï¼šå¤ªç”°ã•ã‚“ã¨ã„ã†ã¨ã€Hadoopã®äººã¨ã„ã†ã‚¤ãƒ¡ãƒ¼ã‚¸ãŒã‚ã‚Šã¾ã™ãŒã€ãã‚‚ãã‚‚ã®ãƒãƒƒã‚¯ã‚°ãƒ©ã‚¦ãƒ³ãƒ‰ã‚’æ•™ãˆã¦ãã ã•ã„ã€‚ ãƒˆãƒ¬ã‚¸ãƒ£ãƒ¼ãƒ‡ãƒ¼ã‚¿ å¤ªç”°æ°ï¼ˆä»¥ä¸‹ã€TD å¤ªç”°ï¼‰ï¼šã¯ã„ã€‚ã‚‚ã¨ã‚‚ã¨ç§ã®ãƒãƒƒã‚¯ã‚°ãƒ©ã‚¦ãƒ³ãƒ‰ã¯HPCï¼ˆHigh Performance Computingï¼‰ã®ã‚¨ãƒªã‚¢ã§ã€19æ³ãã‚‰ã„ã‹ã‚‰ã‚ã¾ã‚Šå¦æ ¡ã«ã‚‚è¡Œã‹ãšï¼ˆç¬‘ï¼‰ã€ãƒ—ãƒªãƒ•ã‚¡ãƒ¼ãƒ‰ã‚¤ãƒ³ãƒ•ãƒ©ã‚¹ãƒˆãƒ©ã‚¯ãƒãƒ£ã¨ã„ã†ä¼šç¤¾ã®CTOã‚’ã‚„ã‚‰ã›ã¦ã„ãŸã ãã¾ã—ãŸã€‚ã‚ã¨ã€ç±³ã‚ªãƒ¬ã‚´ãƒ³ã®å›½ç«‹ç ”ç©¶æ‰€ã§
beth321 2013/07/03
business

treasuredata

hadoop

interview

fluentd

startup

èµ·æ¥

çµŒå–¶

fluent

ãƒ‡ãƒ¼ã‚¿ãƒžã‚¤ãƒ‹ãƒ³ã‚°
ãƒªãƒ³ã‚¯
ç•°å¸¸å€¤æ¤œå‡ºãƒ—ãƒ©ã‚°ã‚¤ãƒ³ fluent-plugin-anomalydetect ã‚’ä½¿ã£ã¦ã¿ãŸã®ã§ãã‚ãã‚é–¾å€¤ã‚’æ±ºã‚ãŸã„ - é…’æ—¥è¨˜ ã¯ã¦ãªæ”¯åº—
ç•°å¸¸å€¤æ¤œçŸ¥ã€ç´ æ•µãªéŸ¿ãã§ã™ãï¼fluent-plugin-anomalydetect ä½œã‚Šã¾ã—ãŸ - PolyPeaceLight ã‚ã‚‰ã‹ã˜ã‚å›ºå®šå€¤ã§ã‚¢ãƒ©ãƒ¼ãƒˆã®æ¡ä»¶ã‚’æ±ºã‚ã¦ãŠã‹ãªãã¦ã‚‚ã€é€šå¸¸ã¨ç•°ãªã‚‹æ•°å€¤å¤‰åŒ–ã‚’æ¤œå‡ºã—ã¦ã‚¢ãƒ©ãƒ¼ãƒˆã§ããŸã‚‰å¤§å¤‰å¬‰ã—ã„ã€ã¨ã„ã†ã“ã¨ã§ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã—ã¦ä¸€é€±é–“ã»ã©é‹ç”¨ã—ã¦ã¿ã¾ã—ãŸã€‚ fluent-agent-lite ã§é€ä¿¡ã•ã‚Œã¦ãã‚‹ nginx ã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã®æ•°ã‚’å¯¾è±¡ 60ç§’é–“éš”ã§é›†è¨ˆ <match nginx.access.**> type copy <store> ... </store> <store> ... </store> <store> type anomalydetect tag nginx.anomaly.access_log tick 60 store_file /var/log/td-agent/anomalydetect.dat </store
beth321 2013/01/26
ã¯ã¦ãª

*thresh25

fluentd

nginx

ç›£è¦–

fluent

anormalydetect

monitoring

ã‚ã¨ã§ã¿ã‚‹

unread
ãƒªãƒ³ã‚¯
OSSã§æ”¯ãˆã‚‰ã‚Œã‚‹ãƒ©ã‚¤ãƒ–ãƒ‰ã‚¢ã®å·¨å¤§ãƒã‚°é›†è¨ˆ #nhntech
1. OSSã§æ”¯ãˆã‚‰ã‚Œã‚‹ ãƒ©ã‚¤ãƒ–ãƒ‰ã‚¢ã®å·¨å¤§ãƒã‚°é›†è¨ˆ - Hiveã¨Fluentd - ç¬¬2å›ž NHNãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ 2012/08/18 TAGOMORI Satoshi (@tagomoris) 12å¹´8æœˆ18æ—¥åœŸæ›œæ—¥
beth321 2012/08/19
ruby

fluentd

hadoop

Hive

log

fluent

slideshare

server

CentOS

OSS
ãƒªãƒ³ã‚¯
fluentd ã‚’åˆ©ç”¨ã—ãŸå¤§è¦æ¨¡ã‚¦ã‚§ãƒ–ã‚µãƒ¼ãƒ“ã‚¹ã®ãƒã‚®ãƒ³ã‚°
3. â€¢ id:secondlife â€¢ @hotchpotch â€¢ èˆ˜é‡Žç¥ä¸€ / Yuichi Tateno â€¢ Shibuya.js ç™ºèµ·äºº â€¢ Asakusa.rb æ‰€å±ž â€¢ ï¬‚uentd ã‚³ãƒŸãƒƒã‚¿Ì¶ â€¢ BiS, ã‚‚ã‚‚ã„ã‚ã‚¯ãƒãƒ¼ãƒãƒ¼Z
beth321 2012/02/04
cookpad

case

debug

fluentd

fluent

log

slide

rails

web

ruby
ãƒªãƒ³ã‚¯
Perl ã‹ã‚‰ Fluentd ã«ãƒã‚°å‡ºåŠ› - Fluent::Logger ãƒªãƒªãƒ¼ã‚¹ - é…’æ—¥è¨˜ ã¯ã¦ãªæ”¯åº—
çš†ã•ã‚“ã€ãƒã‚°æ›¸ã„ã¦ã¾ã™ã‹ï¼ï¼Ÿ(æŒ¨æ‹¶) Fluentd meetup in Japan ã‚‚é–‹å‚¬é–“è¿‘ã€æœ€è¿‘å¤§å¤‰ç†±ã„ã‚¤ãƒ™ãƒ³ãƒˆãƒã‚°åŽé›†ã‚·ã‚¹ãƒ†ãƒ Fluentd ãªã‚ã‘ã§ã™ãŒã€Perl ã‹ã‚‰ãƒã‚°ã‚’å‡ºåŠ›ã™ã‚‹ Fluent::Logger ã¨ã„ã†ãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«ã‚’ CPAN ã«ãƒªãƒªãƒ¼ã‚¹ã—ãŸã®ã§ãŠçŸ¥ã‚‰ã›ã—ã¾ã™ã€‚ (æœ€åˆã®ç‰ˆã¯ id:hirose31 ã•ã‚“ãŒæ›¸ã‹ã‚Œã¦ã€ãã‚Œã«åŒåƒšã® id:shin1rosei ã¨æ‰‹ã‚’åŠ ãˆãŸã‚‚ã®ã§ã™) ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã¯ cpanm ãªã©ã§ã©ã†ãžã€‚ä½¿ã„æ–¹ã¯ POD ã«ã‚‚ã‚ã‚‹ã‚ˆã†ã«ç°¡å˜ã§ã™ã€‚ use Fluent::Logger; my $logger = Fluent::Logger->new( host => "127.0.0.1", port => 24224 ); $logger->post( "myapp.info" => { foo => "bar" } ); ä¸Šè¨˜ã®ä¾‹ã§é€ä¿¡ã™
beth321 2012/01/31
ã¯ã¦ãª

BAR

benchmark

perl

fluentd

fluent

log

ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ã‚¿ãƒ»IT

ã‚ã¨ã§èªã‚€

ãƒã‚°
ãƒªãƒ³ã‚¯
1