[B! fluentd] tm8rã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

tm8r id:tm8r

fluentdã«é–¢ã™ã‚‹tm8rã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (14)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Fluentdã¨Redisã‚’ä½¿ã£ãŸãƒ©ãƒ³ã‚ãƒ³ã‚°æ©Ÿèƒ½ã®å®Ÿè£… | SmartNewsé–‹ç™ºè€…ãƒ–ãƒã‚°
ã‚´ã‚¯ãƒã®å¤§å¹³ã§ã™ã€‚ã”ãã‚ã†ã•ã¾ã§ã™ã€‚ Redisã¯é«˜é€Ÿã§ã€ã‹ã¤ãƒ‡ãƒ¼ã‚¿ã®æ°¸ç¶šåŒ–ã‚„ã€è¤‡æ•°ã®ãƒ‡ãƒ¼ã‚¿åž‹ã«ã‚ˆã‚‹ã‚¹ãƒˆã‚¢(list,set,sorted setç‰ï¼‰ã‚‚å¯¾å¿œã—ã¦ãŠã‚Šã€æ©Ÿèƒ½çš„ãŒè±Šå¯Œã¨ã„ã†ã“ã¨ã‹ã‚‰æ„›ç”¨è€…ã®å¤šã„KVSå®Ÿè£…ã®ä¸€ã¤ã ã¨æ€ã„ã¾ã™ã€‚ ç‰¹ã«ç§ã®ã‚ˆã†ãªã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®äººé–“ã«ã¨ã£ã¦ã¯ãƒ‡ãƒ¼ã‚¿åž‹ã®ãƒãƒªã‚¨ãƒ¼ã‚·ãƒ§ãƒ³ã®è±Šå¯Œã•ãŒä¾¿åˆ©ã•ã‚’æ„Ÿã˜ã‚‹éƒ¨åˆ†ã§ã€ãŸã¨ãˆã°listã‚’ç”¨ã„ã¦ã‚¿ã‚¤ãƒ ãƒ©ã‚¤ãƒ³çš„ãªæƒ…å ±ã‚„å±¥æ´æƒ…å ±ã®ç®¡ç†ã€sorted setã‚’ç”¨ã„ã¦ãƒ©ãƒ³ã‚ãƒ³ã‚°æƒ…å ±ã®ç®¡ç†ã€ãªã©ã®ã‚ˆã†ã«ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã®éœ€è¦ã®å¤šãã«RedisãŒå¯¾å¿œã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ ã“ã‚Œã‚‰ã®æƒ…å ±ã‚’ç™»éŒ²ã™ã‚‹éš›ã®ãƒ•ãƒãƒ¼ã¨ã—ã¦ã¯è‡ªä½œã®ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‹ã‚‰ç›´æŽ¥ã€ã¨ã„ã†ã‚±ãƒ¼ã‚¹ãŒå¤šã„ã¨æ€ã„ã¾ã™ãŒã€ã›ã£ã‹ãFluentdã®ã‚ˆã†ãªä¾¿åˆ©ãªlog collectorå®Ÿè£…ãŒã‚ã‚‹ã®ã§ã€Fluentdã¨Redisã‚’çµ„ã¿åˆã‚ã›ã‚‹äº‹ã§ã‚«ã‚¸ãƒ¥ã‚¢ãƒ«ã«æƒ…å ±ã®è“„ç©ã‚’è¡Œã„ãŸã„
tm8r 2013/09/25
redis

fluentd

ranking
ãƒªãƒ³ã‚¯
é–‹ç™ºãƒ¡ãƒ¢#6 : ãƒã‚°ã®å–ã‚Šæ‰±ã„ : GrowthForecast, Amazon S3, Treasure Data ã§å¿ƒåŠ´ã‚¼ãƒ - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼
é–‹ç™ºãƒ¡ãƒ¢#6 ã§ã™ã€‚å‰å›žã‹ã‚‰å°‘ã—é–“ãŒã‚ã„ã¦ã—ã¾ã„ã¾ã—ãŸã€‚ é–‹ç™ºãƒ¡ãƒ¢#2 : AWS ã§ã®ãƒ›ã‚¹ãƒˆ / ã‚¯ãƒ©ã‚¦ãƒ‰ãƒã‚¤ãƒ†ã‚£ãƒ–ãªãƒ‡ãƒ—ãƒã‚¤ - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼ ã§æ›¸ã„ãŸã‚ˆã†ã«ã€EC2 ã¸ã®ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã®ãƒ‡ãƒ—ãƒã‚¤ã«ã‚ãŸã£ã¦ã¯ Elastic IP ã®åˆ©ç‚¹ã‚’æ´»ã‹ã—ã¦ã‚«ã‚¸ãƒ¥ã‚¢ãƒ«ã«ãƒ›ã‚¹ãƒˆã‚’å…¥ã‚Œæ›¿ãˆã¾ãã£ã¦ã„ã¾ã™ã€‚ã¡ã‚‡ã£ã¨ã“ã®ãƒ‡ãƒ—ãƒã‚¤ã¯æ…Žé‡ã«ãªã‚ŠãŸã„ãªã€ã¨æ€ã£ãŸã‚‰ã‚¹ãƒŠãƒƒãƒ—ã‚·ãƒ§ãƒƒãƒˆã‹ã‚‰ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ã‚’ç«‹ã¡ä¸Šã’ã¦ã¯åˆ‡ã‚Šæ›¿ãˆã‚‹ã€ã®ç¹°ã‚Šè¿”ã—ã€‚ ã“ã®é‹ç”¨ã‚’ã—ã¦ã„ã‚‹ã¨ã€ã‚¹ãƒŠãƒƒãƒ—ã‚·ãƒ§ãƒƒãƒˆã¨ã®å·®åˆ†ãŒã§ãã‚„ã™ã„ã®ã¯ chef-solo ã§å¸åŽã™ã‚‹ã¨ã„ã†ã®ãŒå‰å›žã€å‰ã€…å›žã®ã¯ãªã—ã€‚ ã‚‚ã†ä¸€ç‚¹å•é¡ŒãŒã‚ã‚Šã¾ã™ã€‚ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚„ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã®ãƒã‚°ã§ã™ã€‚ãƒ•ãƒãƒ³ãƒˆã‚¨ãƒ³ãƒ‰ã®ã‚µãƒ¼ãƒã‚’ã‚ã£ã¡ã“ã£ã¡åˆ‡ã‚Šæ›¿ãˆã¦ã„ã‚‹ã†ã¡ã«ã€ãã®ã¾ã¾ã§ã¯ãƒã‚°ãŒåˆ†æ–ã•ã‚Œã¦ã—ã¾ã†ã€‚ãƒ›ã‚¹ãƒˆã‚’ Terminate ã—ã‚ˆã†ã‚‚ã®ãªã‚‰ãƒã‚°ã¯æ¶ˆå¤±ã—ã¦ã—ã¾ã„ã¾ã™ã€‚ ã“ã®
tm8r 2013/02/20
fluentd

GrowthForecast

log
ãƒªãƒ³ã‚¯
fluent-plugin-rewriteã¨ã„ã†ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã‚’ä½œæˆã—ãŸ #fluentd - Kentaro Kuribayashi's blog
fluent-plugin-rewriteã¨ã„ã†fluentdã®ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã‚’ä½œæˆã—ãŸã€‚ä»¥ä¸‹ã€ã“ã®ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã®è§£æ±ºã™ã‚‹å•é¡Œã«ã¤ã„ã¦è¿°ã¹ã‚‹ã€‚ https://github.com/kentaro/fluent-plugin-rewrite https://rubygems.org/gems/fluent-plugin-rewrite å•é¡Œ ã‚ã‚‹ã‚µãƒ¼ãƒ“ã‚¹ã®ãƒ¬ã‚¹ãƒãƒ³ã‚¹ã‚¿ã‚¤ãƒ æ”¹å–„ã‚’ã—ã¦ã„ã¦ã€ã¾ãšã¯çŠ¶æ³ã®å¯è¦–åŒ–ã®ãŸã‚ã«ã€fluentdã‚’ç”¨ã„ã‚‹ã“ã¨ã«ã—ãŸã€‚ãã®éš›ã€ãŸã¨ãˆã° ãƒˆãƒƒãƒ—ãƒšãƒ¼ã‚¸ ãƒ¦ãƒ¼ã‚¶ãƒšãƒ¼ã‚¸ æ›¸ç±æ¤œç´¢ãƒšãƒ¼ã‚¸ æ›¸ç±è©³ç´°ãƒšãƒ¼ã‚¸ ... ãã®ä»– ã¨ã„ã£ãŸã‚°ãƒ«ãƒ¼ãƒ—ã«ã‚ã‘ã¦ã€ãƒ¬ã‚¹ãƒãƒ³ã‚¹ã‚¿ã‚¤ãƒ ã®å„ç¨®çµ±è¨ˆã‚’å–ã‚ŠãŸã„ã€‚ã¾ãŸã€ãƒã‚°ã‚’å…¨éƒ¨é›†è¨ˆã™ã‚Œã°ã„ã„ã¨ã„ã†ã‚‚ã®ã§ã¯ãªãã€é™¤å¤–ã™ã¹ãmessageã‚‚è¤‡æ•°ç¨®é¡žã‚ã‚‹ã®ã§ã€æŸ”è»Ÿã«ãƒ•ã‚£ãƒ«ã‚¿ãƒ«ãƒ¼ãƒ«ã‚’è¨å®šã—ãŸã„ã€‚ æ—¢å˜ã®ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã ã¨out_exec_filterã‚’ä½¿ã†ã“ã¨ã«ã‚ˆã£
tm8r 2012/12/21
fluentd

plugin
ãƒªãƒ³ã‚¯
Fluentular: a Fluentd regular expression editor
Regular Expression Test String Custom Time Format (See also ruby document; strptime) Example (Apache) Regular expression: ^(?<host>[^ ]*) [^ ]* (?<user>[^ ]*) \[(?<time>[^\]]*)\] "(?<method>\S+)(?: +(?<path>[^ ]*) +\S*)?" (?<code>[^ ]*) (?<size>[^ ]*)(?: "(?<referer>[^\"]*)" "(?<agent>[^\"]*)")?$ Time Format: %d/%b/%Y:%H:%M:%S %z
tm8r 2012/11/21
fluentdã®æ£è¦è¡¨ç¾ç¢ºèª

fluentd
ãƒªãƒ³ã‚¯
fluentdã§ã€1ã¤ã®ãƒã‚°ã‹ã‚‰è¤‡æ•°ã®ãƒ¡ãƒˆãƒªã‚¯ã‚¹ã‚’å¾—ã‚‹ã€‚ - Studio3104::BLOG.new
ã‚¦ã‚£ãƒ¼ã‚¯ãƒªãƒ¼Fluentdãƒ¦ãƒ¼ã‚¹ã‚±ãƒ¼ã‚¹ã‚¨ãƒ³ãƒˆãƒªãƒªãƒ¬ãƒ¼ã®è¨˜äº‹ã§ã™ã€‚ ã€Œ1ã¤ã®ãƒã‚°ã‹ã‚‰è¤‡æ•°ã®ãƒ¡ãƒˆãƒªã‚¯ã‚¹ã‚’å¾—ã‚‹ã€ã¨ã„ã†ç›®çš„ä¸»çœ¼ã®è¨˜äº‹ã§ã™ã€‚ å„ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã®ä»•æ§˜ã‚„ç´¹ä»‹ã—ã¦ã„ãªã„ã‚ªãƒ—ã‚·ãƒ§ãƒ³ã«ã¤ã„ã¦ã¯ã€ä»–ã®æ–¹ãŒæ›¸ã‹ã‚Œã‚‹è¨˜äº‹ã‚„ã€ä½œè€…æ§˜ã®ãƒ–ãƒã‚°ã‚„GitHubã‚’ã”å‚ç…§ãã ã•ã„ã€‚ WEBã®ãƒ¬ã‚¹ãƒãƒ³ã‚¹ã‚¿ã‚¤ãƒ ã‚’ã‚°ãƒ©ãƒ•åŒ–ã™ã‚‹ fluentd casual talks ã§ã€fujiwaraã•ã‚“ãŒç™ºè¡¨ã•ã‚ŒãŸfluentdã§Webã‚µã‚¤ãƒˆé‹ç”¨ã‚’æ¥½ã«ã™ã‚‹ãŒãã£ã‹ã‘ã§ã€WEBã®ãƒ¬ã‚¹ãƒãƒ³ã‚¹ã‚¿ã‚¤ãƒ ã‚’å¯è¦–åŒ–ã—å§‹ã‚ãŸæ–¹ã€å¤šã„ã¨æ€ã„ã¾ã™ã€‚ (ã‹ãªã‚Šæ¥µç«¯ãªä¾‹ã§ã™ãŒ)ã“ã‚“ãªãµã†ã«ã‚°ãƒ©ãƒ•ãŒå‡ºã‚‹ã“ã¨ã«ã‚ˆã£ã¦ã€ã€Œ14:30é ƒã‹ã‚‰ãƒ¬ã‚¹ãƒãƒ³ã‚¹ãŒè‘—ã—ãæ‚ªããªã£ã¦ã„ã‚‹ï¼ã€ã¨ã„ã†ã“ã¨ãŒè¦‹ã¦å–ã‚Œã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã™ã€‚ ã“ã‚Œã«ã‚ˆã£ã¦"14:30ã‹ã‚‰é…ã„å¿œç”ãŒå¢—ãˆå§‹ã‚ãŸ"ã¨ã„ã†ã“ã¨ã¯ã‚ã‹ã‚‹ã‚ˆã†ã«ãªã‚‹ã®ã§ã™ãŒã€ã€Œã˜ã‚ƒã‚ã©ã“ãŒé…ã„ã®ï¼Ÿã€ã¨ãªã£ã¦çµå±€ç”Ÿã®ãƒã‚°ã‚’æ¼ã£ãŸã‚Šã™ã‚‹
tm8r 2012/10/09
fluentd

plugin
ãƒªãƒ³ã‚¯
dstatã®çµæžœã‚’fluentdã§å–å¾—ã—ã¦ã€WebSocketã§é€ã‚Šã¤ã‘ã‚‹ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãƒªã‚½ãƒ¼ã‚¹ç›£è¦–ã‚¢ãƒ—ãƒªã‚’ä½œã£ã¦ã¿ãŸã€‚ - from scratch
Tuppariå…¬é–‹è¨˜å¿µHackathonã§ä½œã‚ã†ã¨ã—ãŸå¥´ã‚’ä½œã£ã¦ã¿ã¾ã—ãŸã€‚ ã”ã‚ã‚“ãªã•ã„ã€micro instanceãªã®ã§ã‚¢ã‚¯ã‚»ã‚¹éŽå¤šã§å‹•ã‹ãªã„æ™‚ãŒã‚ã‚‹ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ã€ã¡ã‚‡ã£ã¨èª¿æ•´ä¸ã§ã™ã€‚ ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãƒªã‚½ãƒ¼ã‚¹ç›£è¦–ã‚¢ãƒ—ãƒª yosuke-furukawa/dstatwatcher Â· GitHub WebSocketã‚’ä½¿ã£ã¦ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ã«ãƒªã‚½ãƒ¼ã‚¹ç›£è¦–ã—ãŸã‚Šãƒã‚°ç›£è¦–ã—ãŸã‚Šã™ã‚‹ã®ã¯æ£ç›´ã‚ˆãã‚ã‚‹ã‚„ã¤ãªã®ã§ã™ãŒã€fluentdä½¿ã£ã¦ã¿ãŸã‹ã£ãŸã¨ã„ã†ã®ã¨ã€highchartã‚’æœ¬æ¥ã®æ–¹ã§ä½¿ãŠã†ã‹è¿·ã£ãŸæŒ™å¥ã€ä½¿ãˆãªã‹ã£ãŸçµŒç·¯ãŒã‚ã£ãŸã®ã§ã€ä½¿ã£ã¦ã¿ã‚ˆã†ã¨æ€ã£ã¦ä½œæˆã—ã¦ã¿ã¾ã—ãŸã€‚ å¤§ä½“ã€â†“ã®æ„Ÿã˜ã®æµã‚Œã§ã‚„ã£ã¦ã¾ã™ã€‚ Fluentdã¨dstatã®ã¤ãªãŽã®éƒ¨åˆ†ã«ã¯fluent-plugin-dstatã‚’ä½¿ç”¨ã—ã¦ã„ã¾ã™ã€‚ shun0102/fluent-plugin-dstat Â· GitHub ã“ã‚Œã‚’ä½¿ã†ã¨ã€d
tm8r 2012/08/16
fluentd

websocket
ãƒªãƒ³ã‚¯
Fluentd out_forward ã«ãŠã‘ã‚‹æœ€é©åŒ–ãƒ‘ãƒ©ãƒ¡ãƒ¼ã‚¿ã„ãã¤ã‹ã®è©± - ãŸã”ã‚‚ã‚Šã™ãƒ¡ãƒ¢
Fluentdã®ãƒ‡ãƒ¼ã‚¿ã‚’ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯çµŒç”±ã§è»¢é€ã™ã‚‹ãŸã‚ã®çµ„ã¿è¾¼ã¿ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ out_forward ã«ã¯æœ€é©åŒ–ã®ãŸã‚ã®è¨å®šãŒã„ã‚ã„ã‚ã‚ã‚‹ãŒã€å†…éƒ¨æ§‹é€ ã¸ã®ç†è§£ãŒãªã„ã¨ãªã‹ãªã‹æ„å‘³ãŒã‚ã‹ã‚‰ãªã‹ã£ãŸã‚Šã™ã‚‹ã‚‚ã®ã‚‚å¤šã„ã€‚ã®ã§ã€ã‚ã‚“ã¾ã‚Šã„ã˜ã£ã¦ã‚‹äººã¯ã„ãªã„ã‚“ã˜ã‚ƒãªã„ã‹ã¨ã„ã†æ°—ãŒã™ã‚‹ã€‚ æœ€è¿‘è¤‡æ•°ã®è»¢é€å…ˆã¸ã®ãƒãƒ¼ãƒ‰ãƒãƒ©ãƒ³ã‚¹ã‚’ out_roundrobin ãƒ™ãƒ¼ã‚¹ã®æ–¹æ³•ã‹ã‚‰ out_forward ã®æ©Ÿèƒ½ã‚’ä½¿ã£ãŸæ–¹æ³•ã«åˆ‡ã‚Šæ›¿ãˆã¦ã¿ãŸã®ã§ã€ã¤ã„ã§ã«ãã®ã‚ãŸã‚Šã«ã¤ã„ã¦æ›¸ã„ã¦ã¿ã‚‹ã€‚ (ãŠã¾ã‘) out_roundrobin ã¨ out_forward(ã®ãƒãƒ¼ãƒ‰ãƒãƒ©ãƒ³ã‚¹)ã®é•ã„ out_roundrobin ã¯ event stream ã® em it ã¤ã¾ã‚ŠFluentdå†…éƒ¨ã«ãŠã‘ã‚‹æœ€å°ã®é…é€å‡¦ç†å˜ä½ã”ã¨ã«é…é€å…ˆãƒ—ãƒ©ã‚°ã‚¤ãƒ³(ã®ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹)ã‚’åˆ‡ã‚Šæ›¿ãˆã‚‹ã€‚å¯èƒ½ãªé™ã‚Šç´°ã‹ã„å˜ä½ã§é…é€å…ˆã‚’ãƒãƒ©ã‘ã•ã›ãŸã„ã¨ãã¯ã“ã¡ã‚‰ã‚’ä½¿ã†
tm8r 2012/07/31
fluentd
ãƒªãƒ³ã‚¯
fluentdã§Nagiosã‚¢ãƒ©ãƒ¼ãƒˆã®é›†ç´„ Â« ãƒœãƒ¼ãƒ€ãƒ¼ãƒ¬ã‚¹ãƒ©ã‚¤ãƒ•
RRDãªã©ã«ãƒ¡ãƒˆãƒªã‚¯ã‚¹ã‚’æ›¸ãè¾¼ã‚“ã§ã‚°ãƒ©ãƒ•ã‚’ç”Ÿæˆã—ã¦ã„ã‚‹å ´åˆã€æ¨™æº–çš„ãªã‚µãƒ¼ãƒã ã¨CPUã‹HDDãŒãƒœãƒˆãƒ«ãƒãƒƒã‚¯ã«ãªã£ã¦ã€Nagiosã‚µãƒ¼ãƒ1å°ã‚ãŸã‚ŠæŒã¦ã‚‹ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã¯ã€300å°ã€œ700å°ãã‚‰ã„ãŒé™åº¦ã¨ã„ã£ãŸã¨ã“ã‚ã§ã—ã‚‡ã†ã€‚ æ•°ä¸‡å°ã®ã‚µãƒ¼ãƒã‚’ç®¡ç†ã™ã‚‹æ§˜ãªç’°å¢ƒã§ã¯ã€Nagiosã‚µãƒ¼ãƒå˜ä½ã§æƒ…å ±ãŒåˆ†æ–ã•ã‚Œã¦ã—ã¾ã†ã®ã§ã€é–¢é€£ã™ã‚‹ã‚·ã‚¹ãƒ†ãƒ ï¼ˆç‰¹ã«ä»–éƒ¨ç½²ãŒç®¡ç†ã—ã¦ã„ã‚‹æ§˜ãªï¼‰ã®çŠ¶æ³ãŒæŠŠæ¡ã—ã¥ã‚‰ã„ã“ã¨ãŒã‚ˆãã‚ã‚Šã¾ã™ã€‚ å…¨ã‚µãƒ¼ãƒã®çŠ¶æ³ã‚’æ¨ªæ–ã—ã¦æ¤œç´¢ã€ãƒªã‚¹ãƒ†ã‚£ãƒ³ã‚°ãŒã§ãã‚‹ã¨ã€éšœå®³æ™‚ã®å¯¾å¿œæ™‚é–“ã‚’çŸç¸®ã§ãã‚‹ã—ã€çµ±è¨ˆæƒ…å ±ã®å–å¾—ãŒã§ãã‚‹ã¨ãƒ¡ãƒˆãƒªã‚¯ã‚¹drivenãªé‹ç”¨ï¼†é–‹ç™ºã‚‚ã—ã‚„ã™ããªã‚Šã€ãƒ—ãƒãƒ€ã‚¯ãƒˆã®è³ªã‚‚å‘ä¸Šã™ã‚‹ã ã‚ã†ã¨ã„ã†ã“ã¨ã§fluentdã§ã‚„ã£ã¦ã¿ã¾ã—ãŸã€‚ã¨ã¯è¨€ã£ã¦ã‚‚ã¾ã å§‹ã¾ã£ãŸã°ã‹ã‚Šãªã®ã§ã™ãŒã€ä¸‹ã®å›³ã®æ§˜ãªæ§‹æˆã§ã€Nagiosä¸Šã®ã‚¤ãƒ™ãƒ³ãƒˆãƒã‚°ã‚’fluentdãŒtailã—ã€å¿…è¦ãªã‚¤ãƒ™ãƒ³ãƒˆãƒã‚°ã‚’fluentd serv
tm8r 2012/06/08
fluentd

nagios
ãƒªãƒ³ã‚¯
#fluentdcasual ã«ã„ã£ã¦ããŸãƒ¡ãƒ¢ - Kentaro Kuribayashi's blog
Fluentd Casual Talksã‚’ããã«ã„ã£ã¦ãã¾ã—ãŸã€‚ä»¥ä¸‹ãƒ¡ãƒ¢ã€‚ fluentdã¯ã˜ã‚ã¾ã—ãŸ by @oranie httpdã®ãƒ¬ã‚¹ãƒãƒ³ã‚¹ã‚¿ã‚¤ãƒ å–ã‚ŠãŸã„ã in_tailã§ã¨ã£ã¦ã‚‹ã®ã‹ãª apacheãƒã‚°ã®ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã£ã¦çµ±ä¸€åŒ–ã—ã¦ã‚‹ã®ã‹ãª in_tailå‹•ã‹ã—ã¦ã‚‹fluentdãŒappã‚µãƒ¼ãƒã¨åŒå±…ã—ã¦ã‚‹ã®ã£ã¦ã€ãƒ‡ãƒ—ãƒã‚¤ã£ã¦ã©ã†ã—ã¦ã‚‹ã®ã‹ãªãƒ¼ configã‚’å‹•çš„ç”Ÿæˆã—ã¦ã‚‹ â†’ ã¡ã‚‡ã£ã¨å…·ä½“çš„ã«ã‚ã‹ã‚“ãªã‹ã£ãŸã®ã§ã‚ã¨ã§ãƒ–ãƒã‚°ã¿ã‚ˆã† in_forwardãŒ10,000 message/secã§CPUçš„ã«é™ç•Œã«ãã¦ã‚‹(ã‚¹ãƒšãƒƒã‚¯ã‚ã™ã‚ŒãŸ â†’ æ»éœŠã¿ã‚‹) fluentdã§ã‚¦ã‚§ãƒ–ã‚µã‚¤ãƒˆé‹ç”¨ã‚’æ¥½ã«ã™ã‚‹ by @fujiwara access log 10GB/day in_tailã§ã¯ãªãfluent-agent-liteã§ fluentdç½®ãã‚ˆã‚Šè² è·ä½Žã„ã‚‰ã—ã„ file_alternativ
tm8r 2012/06/01
fluentd
ãƒªãƒ³ã‚¯
Fluentd Casual Talksã«å‚åŠ ã—ã¦ãã¾ã—ãŸ Â« ãƒœãƒ¼ãƒ€ãƒ¼ãƒ¬ã‚¹ãƒ©ã‚¤ãƒ•
Fluentd Casual Talksã«å‚åŠ ã—ã¦ãã¾ã—ãŸã€‚ã“ã†ã„ã£ãŸå‹‰å¼·ä¼šã®æƒ…å ±ã¯ã€twitterã¨RSSã§ç´ æ—©ãæŠŠæ¡ã§ãã‚‹æ§˜ã«ã—ã¦ã¯ã„ã‚‹ã®ã§ã™ãŒã€ç”³ã—è¾¼ã‚“ã æ™‚ç‚¹ã§è£œæ¬ 40ç•ªç›®ã¨ã„ã†ã‹ãªã‚Šçµ¶æœ›çš„ãªçŠ¶æ³ã€‚ã€‚ã§ã‚‚å½“æ—¥ã«ã‚ãƒ£ãƒ³ã‚»ãƒ«ãŒç¶šå‡ºã—ã¦ä½™è£•ã§ç¹°ã‚Šä¸Šã’å½“é¸ã¨ãªã‚Šã¾ã—ãŸï¼ ä¼šå ´ã¯å…ˆæ—¥ã‚ªãƒ•ã‚£ã‚¹ã‚’ç§»è»¢ã—ãŸã°ã‹ã‚Šã®DeNAã®ãƒ’ã‚«ãƒªã‚¨ã‚ªãƒ•ã‚£ã‚¹ã§ã™ã€‚å¤–éƒ¨ã®äººã‚’å¤šæ•°æ‹›ãã®ã¯å¤§å¤‰ã ã¨æ€ã„ã¾ã™ãŒï¼ˆã—ã‹ã‚‚ç„¡æ–™ã§ï¼ï¼‰å—ä»˜ã‚‚èª˜å°Žã®æ–¹ã€…ã‚‚ãƒ•ãƒ¬ãƒ³ãƒ‰ãƒªãƒ¼ã§ä½™è£•ã®ã‚ã‚‹å¯¾å¿œï¼ãã†ã„ã£ãŸã¨ã“ã‚è¦‹ç¿’ã‚ãªã„ã¨ãªã€œãªã‚“ã¦æ€ã„ã¾ã—ãŸã€‚ oranieã•ã‚“ã®ã€Œfluentdã¯ã˜ã‚ã¾ã—ãŸã€ Fluentd casual å¤§è¦æ¨¡ã§ä½¿ã†æ§˜ã«ãªã‚‹ã¨å›°ã‚‹ã®ãŒconfigãƒ•ã‚¡ã‚¤ãƒ«ã®ç®¡ç†ã§ã™ã‚ˆãã€‚ã‚¦ãƒã®ç’°å¢ƒã§ã‚‚ã“ã®ã‚ãŸã‚Šã¯ãã®ã¾ã¾çœŸä¼¼ã—ãŸæ–¹ãŒè‰¯ã„ã ã‚ã†ãªã¨æ€ã„ã¾ã—ãŸã€‚ ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‚µãƒ¼ãƒã§ã¯ã€include httpdã§configæƒ…å ±ã‚’èªã¿è¾¼ã‚“
tm8r 2012/06/01
[

fluentd
ãƒªãƒ³ã‚¯
[fluentd] #Fluentd Casual Talks ã§ã€Œfluentdã§Webã‚µã‚¤ãƒˆé‹ç”¨ã‚’æ¥½ã«ã™ã‚‹ã€è©±ã‚’ã—ã¦ãã¾ã—ãŸ - é…’æ—¥è¨˜ ã¯ã¦ãªæ”¯åº—
id:tagomoris ã•ã‚“ã«ãŠå£°ãŒã‘ã„ãŸã ãã¾ã—ã¦ã€Fluentd Casual Talks ã«ã¦ã€Œfluentdã§Webã‚µã‚¤ãƒˆé‹ç”¨ã‚’æ¥½ã«ã™ã‚‹ã€ã¨ã„ã†ã‚¿ã‚¤ãƒˆãƒ«ã§ç™ºè¡¨ã•ã›ã¦ã„ãŸã ãã¾ã—ãŸã€‚ ç™ºè¡¨è³‡æ–™ã¯ã“ã¡ã‚‰ ä¸»å‚¬è€…ã® id:tagomoris ã•ã‚“ã€ä¼šå ´ã‚’æä¾›ã—ã¦ã„ãŸã ã„ãŸ DeNA æ§˜ã€ã„ã‚ã„ã‚æº–å‚™ã‚’ã—ã¦ãã ã•ã£ãŸ id:riywo ã•ã‚“ã¯ã˜ã‚å¤šãã®æ–¹ã€…ã€å‚åŠ ã—ã¦ãã ã•ã£ãŸ100åä»¥ä¸Šã®çš†æ§˜ã€ã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã—ãŸï¼æ¥½ã—ã‹ã£ãŸã§ã™ã€‚ ç™ºè¡¨ã§ã¯ã“ã“åŠå¹´ã»ã© Fluentd ã‚’é‹ç”¨ã—ã¦æ¥ãŸçµŒé¨“ã‚’ãŠè©±ã—ã—ã¾ã—ãŸãŒã€ç™ºè¡¨å†…ã§è§¦ã‚Œãªã‹ã£ãŸã“ã¨ã§å¤§äº‹(?)ãªã“ã¨ãŒã‚ã‚Šã¾ã™ã®ã§ä»¥ä¸‹ã«è£œéºã‚’ã„ãã¤ã‹æ›¸ã„ã¦ãŠãã¾ã™ã€‚ Mongo DB ã«ãƒã‚°ã‚’æºœã‚ã™ãŽãªã„æ–¹ãŒã„ã„ã‹ã‚‚ å¤ªç”°ã•ã‚“ (@kzk_mover) ã®ç™ºè¡¨å†…ã§ã‚‚è§¦ã‚Œã‚‰ã‚Œã¦ã„ã¾ã—ãŸãŒã€æ•°åƒä¸‡ä»¶ç¨‹åº¦ã«ã—ã¦ãŠã„ãŸã»ã†ãŒã„ã„ã®ã§ã¯â€¦â€¦ã¨ã„ã†å®Ÿæ„Ÿã§ã™ã€‚ ç™ºè¡¨å†…
tm8r 2012/05/22
fluentd

mongodb
ãƒªãƒ³ã‚¯
#fluentd fluentdï¼ˆtd-agentï¼‰æ§‹ç¯‰æ™‚ã«æ°—ã‚’ã¤ã‘ã‚‹ãƒã‚¤ãƒ³ãƒˆã«ã¤ã„ã¦[2012/3/26 è¿½è¨˜ã‚ã‚Š] - oranie's blog
çµæ§‹æ—¢å‡ºãªå†…å®¹ã§ã™ãŒã€æ€ã„ã£ãã‚Šãƒãƒžã£ãŸã®ã§æ”¹ã‚ã¦ã€‚ â—fluentdâ†’fluentdã®é€šä¿¡æ™‚ã«fowardã‚’ä½¿ãŠã†ã¨ã—ãŸã‚‰ã‚¨ãƒ©ãƒ¼ã«ãªã‚‹ã€‚ â€»è¿½è¨˜ VMwareã®å ´åˆã¯ã“ã£ã¡ã‚’å‚è€ƒã«ã€‚fluentdã˜ã‚ƒãªãã¦VMwareã®å•é¡Œã¨ã„ã†ãƒ‘ã‚¿ãƒ¼ãƒ³ã‚‚ã‚ã‚Šã€‚ http://d.hatena.ne.jp/oranie/20121107/1352298768 ä¸é–“fluentdã‹ã‚‰æœ€çµ‚çš„ã«é›†ç´„ã™ã‚‹fluentdã«fowardã§ãƒã‚°ã‚’é€ã‚ã†ã¨ã™ã‚‹ã¨ã€å§‹ã‚ã¯ã¡ã‚ƒã‚“ã¨é€ã‚Œã‚‹ã®ã«ã€ã¡ã‚‡ã£ã¨ã™ã‚‹ã¨ãƒã‚°ã«ã‚¨ãƒ©ãƒ¼ãŒå‡ºã¦ã„ãŸã€‚ã‚‚ã¡ã‚ã‚“é›†ç´„å…ˆã®æ–¹ã§ã¯ãƒã‚°å—ä¿¡å‡ºæ¥ãªããªã£ã¦ã„ã‚‹ã€‚ failed to flush the buffer, retrying. error="no nodes are available" ã‚‚ã£ã¨å…·ä½“çš„ã«ã¯ã“ã‚“ãªã®ã€‚ ã§ã€ç†ç”±ã¯ @oranie æ»æ´»ç›£è¦–ã«UDPã®ã»ã†ä½¿ã†ã‚‰ã—ã„ã®ã§ãã£ã¡ã‚‚é€šã•ãªã„
tm8r 2012/03/23
fluentd
ãƒªãƒ³ã‚¯
fluentdã®ãƒ–ãƒã‚°è¨˜äº‹ãªã©ã¾ã¨ã‚ãƒ¡ãƒ¢ - oranie's blog
è‡ªåˆ†ã‚‚ï¬‚uentdã®ãƒ“ãƒƒã‚°ã‚¦ã‚§ãƒ¼ãƒ–ã«ä¹—ã‚ã†ã¨ã—ã¦ã€è©¦ã™ä¸Šã§è‰²ã€…æ¤œç´¢ã—ã¦ã„ã‚‹ã‘ã©ã€ ã—ã‚‡ã£ã¡ã‚…ã†åŒã˜ã‚µã‚¤ãƒˆè¦‹ãŸã‚Šã—ã¦ã„ã‚‹ã€‚ ãªã®ã§ã€ãƒ¡ãƒ¢ã¨ã—ã¦ã‚ˆãè¦‹ã‚‹ã‚µã‚¤ãƒˆã¨ã‹ã‚’æ›¸ã„ã¦ãŠãã€‚ - å‹æ‰‹ã«è¼‰ã›ã‚“ãªï¼ï¼ã¨ã„ã†ã®ãŒã‚ã‚Œã°ã€ç”³ã—è¨³ç„¡ã„ã§ã™ãŒè¨€ã£ã¦é ‚ã‘ã‚Œã° å‰Šé™¤ã—ã¾ã™ãƒ»ãƒ»ãƒ»ã€‚ - å¤æ©‹è²žä¹‹ã®æ—¥è¨˜ã€Œã‚¤ãƒ™ãƒ³ãƒˆãƒã‚°åŽé›†ãƒ„ãƒ¼ãƒ« fluent ãƒªãƒªãƒ¼ã‚¹ï¼ã€ id:viverã•ã‚“ http://d.hatena.ne.jp/viver/20110929/p1 http://www.slideshare.net/treasure-data/fluentd-meetup-in-japan-11410514 å…¬å¼ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆ http://fluentd.org/doc/ Github https://github.com/fluent/fluentd - ä»¥ä¸‹ã€åˆ©ç”¨ã—ã¦ã„ã‚‹äººãŸã¡ã®ã¾ã¨ã‚ã‚„ã‚¹ãƒ©ã‚¤ãƒ‰ - 2012/02
tm8r 2012/02/09
fluentd
ãƒªãƒ³ã‚¯
fluentd ã‚’åˆ©ç”¨ã—ãŸå¤§è¦æ¨¡ã‚¦ã‚§ãƒ–ã‚µãƒ¼ãƒ“ã‚¹ã®ãƒã‚®ãƒ³ã‚°
3. â€¢ id:secondlife â€¢ @hotchpotch â€¢ èˆ˜é‡Žç¥ä¸€ / Yuichi Tateno â€¢ Shibuya.js ç™ºèµ·äºº â€¢ Asakusa.rb æ‰€å±ž â€¢ ï¬‚uentd ã‚³ãƒŸãƒƒã‚¿Ì¶ â€¢ BiS, ã‚‚ã‚‚ã„ã‚ã‚¯ãƒãƒ¼ãƒãƒ¼Z
tm8r 2012/02/08
fluentd

log
ãƒªãƒ³ã‚¯
1