Skip to content

Java message queue using MongoDB 3.2 as a backend

Notifications You must be signed in to change notification settings

kostapc/queue-box

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

55 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

QueueBox - async queue engine based on MongoDB

Build Status

Async java message queue using MongoDB as a backend.

This fork use the latest MongoDB version with the latest Java Driver (version 3.2.2) and contains wrapper that hide MongoDB driver API and allow queue plain java objects.

Fake MongoDB added to project (Fongo) to be used in the unit tests. Fongo is a standalone mock server simulating 90% of MongoDB completely developed in Java. While it aims to be 100% compatible, this is obviously not easy to achieve and some incompatibilities exist which are also reflected in two unit tests here.

Features

  • totally async and non-blocking multithreading
  • Message selection and/or count via MongoDB query
  • Distributes across machines via MongoDB
  • Message priority
  • Delayed messages
  • Running message timeout and redeliver
  • Atomic acknowledge and send together
  • Easy index creation based only on payload
  • work with the latest MongoDB 3.2
  • you can use any other storage sytem by implementing interface

Usage example

  • starting QueueBox instance
  • creating listener for specific "destination"
  • creating and sending some simple message presented as POJO
public final class Main {
    public static void main(String[] args) throws InterruptedException, IOException {
        final String defaultSource = "just_source";
        final String defaultDestination = "just_destination";

        Properties properties = new Properties();
        properties.load(ExampleWithMain.class.getResourceAsStream("mongodb.properties"));
        MongoRoutedQueueBox<JustPojoRouted> queueBox = new MongoRoutedQueueBox<>(
                properties,
                JustPojoRouted.class
        );
        queueBox.start(); // init internal thread pool ant begin periodic query to db

        final JustPojoRouted pojo = new JustPojoRouted(13, "string message for 13");
        pojo.setSource(defaultSource);
        pojo.setDestination(defaultDestination);

        queueBox.subscribe(new QueueConsumer<JustPojoRouted>() {
            @Override
            public void onPacket(MessageContainer<JustPojoRouted> message) {
                JustPojoRouted recvPojo = message.getMessage();
                System.out.println("received packet:"+recvPojo);
                message.done(); // accepting message
            }

            @Override
            public String getConsumerId() {
                return defaultDestination; // destinations that this consumer accepts
            }
        });

        Future future = queueBox.queue(pojo);

        while (!future.isDone()) {
            Thread.sleep(5);
        }

        System.out.println("send packet: "+pojo);

    }
}

Also you can use just core library without wrapper, as it described in original README.

public final class Main {

    public static void main(final String[] args) throws UnknownHostException {
        final Queue queue = new Queue(new MongoClient().getDB("testing").getCollection("messages"));
        queue.send(new BasicDBObject());
        final BasicDBObject message = queue.get(new BasicDBObject(), 60);
        queue.ack(message);
    }
}

Jar

To add the library as a jar simply Build the project and use the queue-box-0.0.1.jar from the created target directory!

Maven

To add the library as a local, per-project dependency use Maven! Simply add a dependency on to your project's pom.xml file such as:

<dependency>
	<groupId>ru.infon.oss</groupId>
	<artifactId>queue-box</artifactId>
	<version>0.0.2</version>
</dependency>

Documentation

Found in the source itself, take a look!

Contact

Developers may be contacted at:

Project Build

Install and start mongodb or use docker container With a checkout of the code get Maven in your PATH and run:

mvn clean install

Alternatively the mvn clean install can also be run without a local MongoDB thanks to Fongo.

We must know our heroes!

This version is based on the original version authored by Gaillard from here and impoved by Uromahn

About

Java message queue using MongoDB 3.2 as a backend

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Java 100.0%