Skip to content

Latest commit

 

History

History

asynchbase

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
src
src
 
 
README.md
README.md
 
 
pom.xml
pom.xml
 
 

README.md

AsyncHBase Driver for YCSB

This driver provides a YCSB workload binding for Apache HBase using an alternative to the included HBase client. AsyncHBase is completely asynchronous for all operations and is particularly useful for write heavy workloads. Note that it supports a subset of the HBase client APIs but supports all public released versions of HBase.

Quickstart

1. Start a HBase Server

You need to start a single node or a cluster to point the client at. Please see Apache HBase Reference Guide for more details and instructions.

2. Set up YCSB

Download the latest YCSB file. Follow the instructions.

3. Create a HBase table for testing

For best results, use the pre-splitting strategy recommended in HBASE-4163:

hbase(main):001:0> n_splits = 200 # HBase recommends (10 * number of regionservers)
hbase(main):002:0> create 'usertable', 'family', {SPLITS => (1..n_splits).map {|i| "user#{1000+i*(9999-1000)/n_splits}"}}

Failing to do so will cause all writes to initially target a single region server.

2. Load a Workload

Switch to the root of the YCSB repo and choose the workload you want to run and load it first. With the CLI you must provide the column family at a minimum if HBase is running on localhost. Otherwise you must provide connection properties via CLI or the path to a config file. Additional configuration parameters are available below.

bin/ycsb load asynchbase -p columnfamily=cf -P workloads/workloada

The load step only executes inserts into the datastore. After loading data, run the same workload to mix reads with writes.

bin/ycsb run asynchbase -p columnfamily=cf -P workloads/workloada

Configuration Options

The following options can be configured using CLI (using the -p parameter) or via a JAVA style properties configuration file.. Check the AsyncHBase Configuration project for additional tuning parameters.

  • columnfamily: (Required) The column family to target.
  • config: Optional full path to a configuration file with AsyncHBase options.
  • hbase.zookeeper.quorum: Zookeeper quorum list.
  • hbase.zookeeper.znode.parent: Path used by HBase in Zookeeper. Default is "/hbase".
  • debug: If true, prints debug information to standard out. The default is false.
  • clientbuffering: Whether or not to use client side buffering and batching of write operations. This can significantly improve performance and defaults to true.
  • durable: When set to false, writes and deletes bypass the WAL for quicker responses. Default is true.
  • jointimeout: A timeout value, in milliseconds, for waiting on operations synchronously before an error is thrown.
  • prefetchmeta: Whether or not to read meta for all regions in the table and connect to the proper region servers before starting operations. Defaults to false.