Rhebok is High Performance Rack Handler/Web Server. 2x performance when compared against Unicorn.
Rhebok supports following features.
- ultra fast HTTP processing using picohttpparser
- uses accept4(2) if OS support
- uses writev(2) for output responses
- prefork and graceful shutdown using prefork_engine
- hot deploy using start_server (here is golang version by lestrrat-san)
- supports HTTP/1.1 except for KeepAlive
- supports OobGC
This server is suitable for running HTTP application servers behind a reverse proxy like nginx.
Add this line to your application's Gemfile:
gem 'rhebok'
And then execute:
$ bundle
Or install it yourself as:
$ gem install rhebok
$ rackup -s Rhebok --port 8080 -O MaxWorkers=5 -O MaxRequestPerChild=1000 -O OobGC=yes -E production config.ru
nginx.conf
http {
upstream app {
server unix:/path/to/app.sock;
}
server {
location / {
proxy_pass http://app;
}
location ~ ^/(stylesheets|images)/ {
root /path/to/webapp/public;
}
}
}
command line of running Rhebok
$ rackup -s Rhebok -O Path=/path/to/app.sock \
-O MaxWorkers=5 -O MaxRequestPerChild=1000 -E production config.ru
filename to load options. For details, please read Config File section
hostname or ip address to bind (default: 0.0.0.0)
port to bind (default: 9292)
path to listen using unix socket
specifies a listen backlog parameter (default: Socket::SOMAXCONN. usually 128 on Linux )
enable SO_REUSEPORT for TCP socket
number of worker processes (default: 5)
Max number of requests to be handled before a worker process exits (default: 1000)
If set to 0. worker never exists. This option looks like Apache's MaxRequestPerChild
if set, randomizes the number of requests handled by a single worker process between the value and that supplied by MaxRequestPerChlid (default: none)
seconds until timeout (default: 300)
Boolean like string. If true, Rhebok execute GC after close client socket. (defualt: false)
If gctools is available, this option is not used. invoke GC by GC::OOB.run after every requests.
Max number of request before invoking GC (defualt: 5)
If set, randomizes the number of request before invoking GC between the number of MaxGCPerRequest (defualt: none)
If set, use chunked transfer for response (default: false)
if set, worker processes will not be spawned more than once than every given seconds. Also, when SIGUSR1 is being received, no more than one worker processes will be collected every given seconds. This feature is useful for doing a "slow-restart". See http://blog.kazuhooku.com/2011/04/web-serverstarter-parallelprefork.html for more information. (default: none)
load options from specified config file. If same options are exists in command line and the config file, options written in the config file will take precedence.
$ cat rhebok_config.rb
host '127.0.0.1'
port 9292
max_workers ENV["WEB_CONCURRENCY"] || 3
before_fork {
defined?(ActiveRecord::Base) and
ActiveRecord::Base.connection.disconnect!
}
after_fork {
defined?(ActiveRecord::Base) and
ActiveRecord::Base.establish_connection
}
$ rackup -s Rhebok -O ConfigFile=rhebok_config.rb -O port 8080 -O OobGC -E production
Rhebok starts Listening on 127.0.0.1:9292 Pid:11892
Supported options in config file are below.
proc object. This block will be called by a master process before forking each worker
proc object. This block will be called by a worker process after forking
- TERM, HUP: If the master process received TERM or HUP signal, Rhebok will shutdown gracefully
- USR1: If set SpawnInterval, Rhebok will collect workers every given seconds and exit
- TERM: If the worker process received TERM, exit after finishing current request
Rhebok and Unicorn "Hello World" Benchmark (behind nginx reverse proxy)
"nginx static file" represents req/sec when delivering 13 bytes static files from nginx
Application code is here.
ruby version
$ ruby -v
ruby 2.1.5p273 (2014-11-13 revision 48405) [x86_64-linux]
nginx.conf
worker_processes 16;
events {
worker_connections 50000;
}
http {
include mime.types;
access_log off;
sendfile on;
tcp_nopush on;
tcp_nodelay on;
etag off;
upstream app {
server unix:/dev/shm/app.sock;
}
server {
location / {
proxy_pass http://app;
}
}
}
command to run
$ start_server --backlog=16384 --path /dev/shm/app.sock -- \
bundle exec --keep-file-descriptors rackup -s Rhebok \
-O MaxWorkers=8 -O MaxRequestPerChild=0 -E production config.ru
$ ./wrk -t 4 -c 500 -d 30 http://localhost/
Running 30s test @ http://localhost/
4 threads and 500 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 1.74ms 661.27us 38.69ms 91.19%
Req/Sec 72.69k 9.42k 114.33k 79.43%
8206118 requests in 30.00s, 1.34GB read
Requests/sec: 273544.70
Transfer/sec: 45.90MB
$ ./wrk -t 4 -c 500 -d 30 http://localhost/
Running 30s test @ http://localhost/
4 threads and 500 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 16.39ms 418.08us 22.25ms 78.25%
Req/Sec 7.73k 230.81 8.38k 70.81%
912104 requests in 30.00s, 273.09MB read
Requests/sec: 30404.28
Transfer/sec: 9.10MB
$ ./wrk -t 4 -c 500 -d 30 http://localhost/
Running 30s test @ http://localhost/
4 threads and 500 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 101.13ms 2.57ms 139.04ms 96.88%
Req/Sec 1.24k 27.11 1.29k 82.98%
148169 requests in 30.00s, 178.18MB read
Requests/sec: 4938.93
Transfer/sec: 5.94MB
unicorn.rb
$ cat unicorn.rb
worker_processes 8
preload_app true
listen "/dev/shm/app.sock"
command to run
$ bundle exec unicorn -c unicorn.rb -E production config.ru
$ ./wrk -t 4 -c 500 -d 30 http://localhost/
Running 30s test @ http://localhost/
4 threads and 500 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 3.50ms 518.60us 30.28ms 90.35%
Req/Sec 37.99k 4.10k 56.56k 72.14%
4294095 requests in 30.00s, 786.07MB read
Requests/sec: 143140.20
Transfer/sec: 26.20MB
$ ./wrk -t 4 -c 500 -d 30 http://localhost/
Running 30s test @ http://localhost/
4 threads and 500 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 19.31ms 1.09ms 65.92ms 89.94%
Req/Sec 6.55k 312.92 7.24k 73.41%
775712 requests in 30.00s, 244.09MB read
Requests/sec: 25857.85
Transfer/sec: 8.14MB
$ ./wrk -t 4 -c 500 -d 30 http://localhost/
Running 30s test @ http://localhost/
4 threads and 500 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 105.70ms 4.70ms 151.11ms 93.50%
Req/Sec 1.19k 44.16 1.25k 89.13%
141846 requests in 30.00s, 172.74MB read
Requests/sec: 4728.11
Transfer/sec: 5.76MB
I used EC2 for benchmarking. Instance type if c3.8xlarge(32cores). A benchmark tool and web servers were executed at same hosts. Before benchmark, increase somaxconn and nfiles.
Gazelle Rhebok is created based on Gazelle code
Server::Stater a superdaemon for hot-deploying server programs
picohttpparser fast http parser
Copyright (C) Masahiro Nagano.
This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself.
- Fork it ( https://github.com/kazeburo/rhebok/fork )
- Create your feature branch (
git checkout -b my-new-feature) - Commit your changes (
git commit -am 'Add some feature') - Push to the branch (
git push origin my-new-feature) - Create a new Pull Request