Install, configure, and manage Fluentd data collector.

• Installs td-agent package
• Generates configuration file td-agent.conf
• Generates custom configuration files and saves them to config.d/
• Manages td-agent service
• Installs Fluentd gem plugins

include fluentd

fluentd::plugin { 'fluent-plugin-elasticsearch': }

fluentd::config { '500_elasticsearch.conf':
  config => {
    'source' => {
      'type' => 'unix',
      'path' => '/tmp/td-agent/td-agent.sock',
    },
    'match'  => {
      'tag_pattern'     => '**',
      'type'            => 'elasticsearch',
      'index_name'      => 'foo',
      'type_name'       => 'bar',
      'logstash_format' => true,
    }
  }
}

include fluentd

fluentd::config { '600_forwarding.conf':
  config => {
    'source' => {
      'type' => unix,
      'path' => '/tmp/td-agent/td-agent.sock',
    },
    'match'  => {
      'tag_pattern' => '**',
      'type'        => forward,
      'server'      => [
        { 'host' => 'example1.com', 'port' => 24224 },
        { 'host' => 'example2.com', 'port' => 24224 },
      ]
    }
  }
}

All configs employ a numbering system in the resource's title that is used for ordering. When titling your config, make sure you prefix the filename with a number, for example, 999_catch_all.conf, 500_elasticsearch.conf (999 has smaller priority than 500)

• fluentd: Main class, includes all other classes.

• fluentd::install: Handles the packages.
• fluentd::service: Handles the service.

The following parameters are available in the fluentd class:

Default value: true

Default value: 'treasuredata'

Default value: 'TreasureData'

Default value: 'http://packages.treasuredata.com/2/redhat/$releasever/$basearch'

Default value: true

Default value: true

Default value: 'https://packages.treasuredata.com/GPG-KEY-td-agent'

Default value: 'C901622B5EC4AF820C38AB861093DB45A12E206F'

Default value: 'td-agent'

Default value: present

Default value: 'td-agent'

Default value: running

Default value: true

Default value: true

Default value: '/etc/td-agent/td-agent.conf'

• fluentd::config: Generates custom configuration files.
• fluentd::plugin: Installs plugins.

The following parameters are available in the fluentd::plugin defined type:

Plugin name

Default value: present

Default value: 'https://rubygems.org'

The following parameters are available in the fluentd::config defined type:

Config filename

Config Hash, please see usage examples.

Tested on CentOS 6, CentOS 7, Ubuntu 14.04, Debian 7.8

Bug reports and pull requests are welcome!

$ bundle install
$ bundle exec rake lint
$ bundle exec rake metadata
$ bundle exec rake spec
$ bundle exec rake beaker BEAKER_set=centos-6-x64
$ bundle exec rake beaker BEAKER_set=centos-7-x64
$ bundle exec rake beaker BEAKER_set=debian-7-amd64
$ bundle exec rake beaker BEAKER_set=ubuntu-server-1404-x64

Relevant Beaker docs: https://github.com/puppetlabs/beaker/blob/master/docs/How-to-Write-a-Beaker-Test-for-a-Module.md

• Remove rubygems package dependency

Copyright 2015–2016 SPB TV AG

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.

You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

See the License for the specific language governing permissions and limitations under the License.