- ??? Kubernetes source #31
- 11/27/16 BigTable Data Source #30
- 11/10/16 upgrade grid to newer version, rework the gnats, etcd apis
- 9/8/16 New balancer to schedule work more evently across nodes #26
- 8/28/16 massive schema improvements #25
- 8/14/16 Cassandra Data Source #21
- 6/27/16 Update data-types to ensure it works with metabase, first real use-case #17
- 04/27/16 Distributed runtime #16
- Cloud Based Files datasource (csv, json, etc) uses distributed query engine. Use Google Storage files as datasource. Includes pluggable scanner-parser, so custom file formats can easily have an adapter added.
- improve the distributed execution engine, with cleaner start, stop, finish mechanics including better flushing, ensuring each task is drained appropriately.
- QLBridge Improvements
*Better internal Schema Query planning, system (SHOW, DESCRIBE) with schemadb araddon/qlbridge#68
- introspect csv files for types
- convert
SHOW
,DESCRIBE
intoSELECT
statements - better internal data-source registry
- Distributed Query runtime using Actors and Nats.io message passing.
- Distributed Queries required new implementation of query planner
- Utilize Metafora for Task Scheduler https://github.com/lytics/metafora
- Utilize Grid for Distributed Work primitives https://github.com/lytics/grid:
- actors
- message passing/hashing/rings via Nats.io