Skip to content

Utilities for transforming InfluxDB time series data

License

Notifications You must be signed in to change notification settings

michaelr524/downsampler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

downsampler

Utilities for transforming InfluxDB time series data

Get up and running

The basics are:

  1. Install Rust (to build the project): https://rustup.rs/
  2. git clone [email protected]:michaelr524/downsampler.git
  3. cd downsampler
  4. cargo build --release
  5. Edit config.toml to your needs
  6. Run like this: target/release/downsampler downsample -s ‘2018-08-13 15:22:06’ -e ‘2018-08-17 19:03:17’

The following operations are currently supported:

downsample

Create downsampled series from other series.

split

Creates many measurement with a single serie from measurements with multiple series.

listen - continuous downsampling

Continuously downsampling the configured series as new data arrives. You need to have Redis running. Redis is used for notifying downsampler about new data. Additionally, Redis is used to store a checkpoint so that downsampler knows how to restart from the point where it stopped last time it ran. The way to send updates to Redis is:

HSET downsampler_updates "binance_BTCUSDT" "1537710900000000000"

The key will be used in the downsampled series name (check listen > measurement_template in config.toml) and the value is the timestamp in nanoseconds format. Downsampler will downsample all the data from the previous checkpoint up to the given timestamp.

About

Utilities for transforming InfluxDB time series data

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages