Explore 120 million taxi trips in real time with Dash and Vaex
Available at https://dash.vaex.io/
Clone the repo
$ git clone https://github.com/vaexio/dash-120million-taxi-app
Run in debug mode:
$ python app.py
Make sure the data is downloaded from s3:
$ python getdata.py
(You can ignore the warning WARNING:ThreadPoolExecutor-1_31:urllib3.connectionpool:Connection pool is full, discarding connection: vaex.s3.amazonaws.com)
Run in production mode (make sure the data is downloaded if you stream from s3):
$ VAEX_NUM_THREADS=8 gunicorn -w 16 app:server -b 0.0.0.0:8050
Change settings in the dash app
$ export TAXI_PATH=/data/taxi/yellow_taxi_2012_zones.hdf5 # change the default s3 file
$ export VAEX_NUM_THREADS=16 # change the number of threads per process/worker
$ export DASH_CACHE_TIMEOUT=240 # increase cache timeout to 4 minutes
$ export DASH_CACHE_TIMEOUT=-1 # disable cache (useful for benchmarking)