Deleted articles cannot be recovered. Draft of this article would be also deleted. Are you sure you want to delete this article?
ãã®è¨äºã¯ãã¨ã ã¹ãªã¼ Advent Calendar 2016ãã® 10æ¥ç®ã®è¨äºã§ã ä»å¹´ã®5æã«ç¡åçãæä¾ããã¦ãã Google Data Studio ã§ããã使ã£ã人ãã¡ã®ã³ã¡ã³ããè¦ã¦ããã¨ããã¥ã¡ã³ããèªã¾ãªãã¦ãããããªã使ããã¨ããã¡ãªããããã£ããã®ã®ãSQLãæ¸ããªãã¨ãããã¡ãªããããã£ã¦ã ä»ã®ç¡æãã¼ã«ã® Re:dash (ç¡æã ã¨ãµã¼ãã¼ãå¿ è¦)ã®æ¹ããã¼ã¿åæçã«ä½¿ããããªã¨æã£ã¦ãã¾ããã ããããæè¿ãã®è¨äºãèªãã§ãã¦ãéã« SQLã¯ã¨ãªãæ¸ããªãã¦è¯ã ã¨ãããã¨ã (ãã£ã¬ã¯ã¿ã¼ã«ä¸¸æãã§ããã¨ããæå³ã§) æ大ã®é åã¨ãããã¨ã«æ°ã¥ãã¾ãããã¨ãããã¨ã§ã Google Data Studio ã使ããã¨ã§ããã£ã¬ã¯ã¿ã¼ãããè¦ããææ¨ã©ã³ãã³ã°TOPã«æããã§ãããã¦ã¼ã¶ã¼ã®ã¢ã¯ã»ã¹ãã°ãå¯è¦åããã®ã§ããã°åéé¨åããã¾ãã£ã¨è§£èª¬ãã¾ãã
Treasure Agentãããã«ä½¿ãããã ãåç¥ã®æ¹ãå¤ããã¨æãã¾ããããã¬ã¸ã£ã¼ãã¼ã¿ç¤¾ã§ã¯ãout_tdãã©ã°ã¤ã³ã使ããã¨ã§ãFluentdããç°¡åã«ãã¼ã¿ãæµãè¾¼ããããã«ãªã£ã¦ãã¾ããããã¯Herokuä¸ã§ãåãããã«ãªã£ã¦ãããheroku-td-agentã¨ãã¦å ¬éããã¦ãã¾ãã ãã ãããæå¤ã¨é¢åãããã§ããå ·ä½çã«ã¯ Treasure Dataã®ã¢ã«ã¦ã³ããæã£ã¦ãããã¨ãåæã ããã¦APIãã¼ãã¡ã¢ã GitHubã®Herokuã¢ããªãã¯ãã¼ã³ãã¦ã㦠bundle install... ãããããããããããããããããããããã£ã¦ãããããã±ãããã!!!! ããã§ã¯ãããããã£ããHerokuã¨ãããã½ããã¦ã§ã¢ã®ãããã¤ãæ¹æ®ºãã¦ããããã©ãããã©ã¼ã ã«ãããã ããã®æ©æµã100ï¼ åãã¦ããããããªããã åºã¾ããTreasure Agent Her
Googleããªã¼ãã³ã½ã¼ã¹ã¨ãã¦å ¬éããKubernetesã¯ãã³ã³ããåä»®æ³åã½ããã¦ã§ã¢ã®Dockerã管çãããã¼ã«ã§ããéçºããã¸ã§ã¯ãã«ã¯DockerãRedHatãIBMãVMwareããã¤ã¯ãã½ãããªã©å¤æ°ã®ä¼æ¥ãåå ã表æãã¦ãã¾ãã Kubernetesã¯ãè¤æ°ã®Dockerã³ã³ããã«ã¾ã¨ãã¦ã¢ããªã±ã¼ã·ã§ã³ããããã¤ããè¨å®ãè¡ãã稼åç¶æ³ãç£è¦ã管çãããµã¼ãã¹ã¸ã®ãã©ãã£ãã¯ãã«ã¼ãã£ã³ã°ãããªã©ãã¯ã©ã¹ã¿ã¨ãã¦Dockerãéç¨ããããã®å¤ãã®æ©è½ãåãã¦ãã¾ãã ãã®Kubernetesã§ä½¿ãããæ¨æºã®ãã°åéãã¼ã«ã¨ãã¦ããªã¼ãã³ã½ã¼ã¹ã®fluentdãæ¡ç¨ããããã¨ãæããã«ãªãã¾ãããä¸è¨ã¯ãããä¼ããGoogleä½è¤æ°ã®ãã¤ã¼ãã fluentdãKubernetesã®æ¨æºãã°ã³ã¬ã¯ã¿ã«æ¡ç¨ããããï¼ï¼ï¼ https://t.co/V8VDM4IE7e
I am pleased to announce that Treasure Data just open sourced a lightweight Fluentd forwarder written in Go. Creatively christened as Fluentd Forwarder, it was designed and written with the following goals in mind. A simple forwarder for simple use cases: Fluentd is very versatile and extendable, but sometimes you need something simple. Fluentd Forwarder is meant to be an alternative for such case
ç®ç Kibana 㧠Heroku ã¢ããªã®ãã°ãå¯è¦åãããããã ããã¬ã¹ãã³ã¹ã¿ã¤ã ã¨ã㯠New Relic ã§ãè¦ããã®ã§ãããã§ã¯ã¢ããªãåºåããããã°ãå¯è¦åããæ¹æ³ãç´¹ä»ããã ã¾ããä»åãã¢ããªããã®åºåãå¯è½ãªéãã«ç°¡åã«ããããã«ãã¢ããªãã㯠Heroku ã® STDOUT ã«åºåããã ãã§ããã°ã Kibana ãµã¼ãã«éä¿¡ã§ããããã«ãã¦ã¿ãã å ·ä½çã«ã¯ãããï¼Ruby ã®å ´åï¼ åºåã®å½¢å¼ã¯ãTreasure Data addon ã®æ¹æ³ ãçä¼¼ã¦ããã puts "@[tag.name] #{{'uid'=>123}.to_json}" ããã§ãtag.name ã fluentd ã® tag åã«ãããã«ç¶ã JSON æååãéä¿¡ãããã¼ã¿ã¨ãã¦å¦çãããã ç°å¢ Amazon EC2 ä¸ã« Kibana ãµã¼ããæ§ç¯ OS 㯠Ubuntu 13.1
Scenario You have an application written in Rails and want to collect data into MongoDB, HDFS, Elasticsearch, et. al. for analytics/search. Logging directly into MongoDB/HDFS/Elasticsearch is not highly recommended since synchronous logging is slow/potentially hazardous for the backend. You can build asynchronous logging into your application, but Fluentd can sit between your application and backe
ããã«ã¡ã¯ãå¤ä¼ã¿ã«é·éã«è¡ã£ã¦å± é å±ã§é¦¬åºãããããµãé£ã¹ã¦ããã å°å ã®ãã£ãã人çã®å¤§å 輩ã®çµ¡ã¿é ã«ä»ãåããããç¥å±±ã§ãã 4æã«å ¥ç¤¾ãã¦ä»¥éããµã¼ããµã¤ãã®Webéçºãã¹ã¯ã©ã ã®å°å ¥ããµã¤ãå æ¤ç´¢ã®æ¹åãªã©æ§ã ãªæ¥åã« åãçµãã§ãã¾ãããæè¿ã®å¤§ããªæ¡ä»¶ã¨ãã¦ã¯ãã¢ã¯ã»ã¹ãã°è§£æåºç¤ã®æ´åãããã¾ããã nginxã®ã¢ã¯ã»ã¹ãã°ãåæããããç°å¢ãä½ããããElasticsearchã¨BigQueryã«ãã°ãèç©ãå§ããã®ã§ããã ãã®éã«ä¸çªã®ãã¢ã¨ãªãã®ã¯ãã¿ããªå¤§å¥½ãfluentdã§ãã ä»åã¯ãæã ãã¦ãã¬ãã¸ã§ã³ãã©ã®ããã«ã¢ã¯ã»ã¹ãã°ãåéãä¿åãã¦ããã®ãã«ã¤ãã¦ãfluentdã®è¨å®ãä¸å¿ã«ãç´¹ä»ãã¾ãã ã¢ã¯ã»ã¹ãã°åéã®ç®ç ç¾å¨ã®æã ã®ãµã¼ãã¹ç°å¢ãèæ ®ããã¨ãã¢ã¯ã»ã¹ãã°ã®åéã«ã¯ä¸è¨2ã¤ã®ç®çãåå¨ãã¾ãã ã¢ã¯ã»ã¹æ å ±ããã¨ã«ã¦ã¼ã¶ã¼ã®è¡åã解æ é²
LINEæ ªå¼ä¼ç¤¾ã¯ã2023å¹´10æ1æ¥ã«LINEã¤ãã¼æ ªå¼ä¼ç¤¾ã«ãªãã¾ãããLINEã¤ãã¼æ ªå¼ä¼ç¤¾ã®æ°ããããã°ã¯ãã¡ãã§ãã LINEã¤ãã¼ Tech Blog saegusa2017-04-16Yoshihiro was a network engineer at LINE, responsible for all levels of LINE's infrastructure. Since being named Infra Platform Department manager, he is finding ways to apply LINE's technology and business goals to the platform. ããã«ã¡ã¯ãLINEã§ãããã¯ã¼ã¯ããã¼ã¿ã»ã³ã¿ã¼ãæ å½ãã¦ããä¸æã§ãã2017å¹´1æã«JANOG39ã§ç»å£ããæ©ä¼ãé ãã¾ããã®ã§ãä»å
ããã°ãéãã¦ä¿åãããã¨è¨ãã®ã¯ç°¡åã ãã©ï¼ãã°åéã®æ§æã«ã¯ããã¤ãæ¹æ³ãããï¼åå¼·ä¼ãªã©ã§ã¡ããã¡ããèãããã®ã§ï¼ããã¤ãã®ãã¿ã¼ã³ã«ã¤ãã¦æ¸ãï¼ ã俺ã¯ããããªããªãã°åéãã£ã¦ããï¼ãã¨ãã人ã¯å¤åãã§ã«ç¥ã£ã¦ãããã¨ãæ¸ããã¦ããã®ã§ï¼ã¿ããéãã¦è¯ãï¼ ããã§ã¯ãã°ã³ã¬ã¯ã¿ã«Fluentdãæ³å®ãã¦ãããï¼ä»ã®ãã°åéãããã¯ãã«ãé©ç¨åºæ¥ãã¯ãï¼ ãã ï¼Fluentdã¯ã¿ã°ãã¼ã¹ã®ã«ã¼ãã£ã³ã°ãæã¡ï¼åä½ã§ããã¥ã¼ã®ããã«åä½ããããã¨ãå¯è½ã§ï¼æ¢åã®ãã®ããè¤éãªåé¡ã解決ãããã¨ãã¦ããã®ã§ï¼å°ã工夫ãå¿ è¦ãããããªãï¼ Fluentdãã®ãã®ã«ã¤ãã¦ã¯å ¬å¼ããã¥ã¡ã³ããï¼Fluentdã¨ã¯ã©ã®ãããªã½ããã¦ã§ã¢ãªã®ããåèã«ï¼ ã¯ã©ã¤ã¢ã³ãããç´æ¥ä¿åãã ãããªãFluentdã使ããªããã¿ã¼ã³ï¼JavaScript SDKãæä¾ãã¦ãã解æãµã¼ãã¹ãã¢ãã¤ã«ç«¯æ«
https://github.com/fluent/fluentd-ui éçºè ã¨ãã¦ã¯ããã足ãã¦ãªãããããªã£ã¦ãã¨è¯ãããããªã©ãªã©çæ³ã次ãã次ã¸ã¨æ確ã«è¦ãã¦ããã®ã§ãªããªãæºè¶³ã§ããªããã®ã§ãããä»ã®ã¨ããæ¦ã好æçãªè©ä¾¡ãé ãã¦ããããã§ããã£ãã§ãã @kzk_mover, @repeatedly, @kiyototamuraã®å¾¡ä¸æ¹ã«ã¯å¤§å¤ãä¸è©±ã«ãªãã¾ããã社ã¨ãã¦ã®ããã¯ç¤¾ã¨ãã¦ãããããã ããã¨ãããã¨ã§ãã以å¤ã®ãããæ¸ãã¨ãã¾ãã å¶ç´ã«ã¤ã㦠çãããã®ã¨ãã¦ä»¥ä¸ã®2ã¤ãããã RDBMSã¯ç¦æ¢ï¼å¥ãã¼ã¢ã³ã®postgresqlã¨ãã¯è«å¤ãsqliteãwindowsã§å°ãæªããï¼ coffeescriptã¯ç¦æ¢ï¼ã¦ã¼ã¶ã¼ãnode.jsãæã£ã¦ãªãå¯è½æ§ã¯å åããï¼ RDBMSããªããã¨ã§ãã¼ã¸ã§ã³ã¢ããã¨ãã¤ã°ã¬ã¼ã·ã§ã³ã«ã¤ãã¦æ©ã¾ãªãã¦æ¸ãã ããªã©ã®ãã
July 9, 2014 TL;DR Monitor the state of the Fluentd by Sensu. Sensuã§Fluentdã®ç¶æ ãç£è¦ãã å©ç¨ããã½ããã¦ã§ã¢(Using Software) fluentd Sensu check-fluentd-monitor-agent.rb ç£è¦è¨å®(Monitoring Settings) Sensuâs Configuration Example Sensuã®è¨å®ä¾ check_fluentd_monitor_agent.json { "checks": { "check_fluentd_monitor_agent_retry": { "command": "/etc/sensu/plugins/check-fluentd-monitor-agent.rb -w 5 -c 10 -m 'retry_count'",
From Fluentd Meetupã«è¡ã£ã¦ãã¾ãã ãããèªãã æãBigQueryã®æ¤ç´¢ã¹ãã¼ãã«ã¤ãã¦ã¡ãã£ã¨è£è¶³ããããªã£ãã確ãã«Fluentd Meetupã®ãã¢ã§ã¯9å件ã7ç§ç¨åº¦ã§æ¤ç´¢ãã¦ããããBigQueryã®çã®å®åã¯ãããã1ã2ã±ã¿ä¸ã ããã ãã¡ãã£ã¨æå ã§å°ã大ããã®ãã¼ãã«ã§è©¦ãã¦ã¿ããã120åè¡ã®æ£è¦è¡¨ç¾ãããä»ãéè¨ã5ç§ã§å®äºãããè«ãã証æ ã§ããã¢ãããªï¼1å16ç§ï¼ãä½ã£ã¦ã¿ãï¼ From The Speed of Google BigQuery ããã¯éããããä½ãã®ã¤ã³ããã§ããï¼æåã«ãã¢ãè¦ãæããæã£ãï¼ãæ£è¦è¡¨ç¾ãããããå¤ãã¦ã¿ã¦ãã¹ãã¼ãã¯å¤ãããªããã¤ã¾ããã¤ã³ããã¯ã¹ãäºåæ§ç¯ã§ããªãã¯ã¨ãªã«å¯¾ãã¦ãã®ã¹ãã¼ããªã®ã§ããã ä¾¡æ ¼ãå®ãããããã«120åè¡ã®ã¯ã¨ãªã¯1åã§200åãããã£ã¦æ°è»½ã«å®è¡ã§ããªãããã§ãããã1.2å
ã©ã³ãã³ã°
ã©ã³ãã³ã°
ã©ã³ãã³ã°
ãªãªã¼ã¹ãé害æ å ±ãªã©ã®ãµã¼ãã¹ã®ãç¥ãã
ææ°ã®äººæ°ã¨ã³ããªã¼ã®é ä¿¡
å¦çãå®è¡ä¸ã§ã
j次ã®ããã¯ãã¼ã¯
kåã®ããã¯ãã¼ã¯
lãã¨ã§èªã
eã³ã¡ã³ãä¸è¦§ãéã
oãã¼ã¸ãéã
{{#tags}}- {{label}}
{{/tags}}