Skip to content

qbicsoftware/spark-service

Repository files navigation

Development branch build status GitHub release (latest by date) GitHub commits since latest release Documentation Status

Docker Builds Statuses

Docker Cloud Automated build Docker Cloud Build Status Docker Cloud Build Status Docker Cloud Build Status Docker Cloud Build Status

spark-service

spark-service provides a docker based containerized solution for a quick setup of an Apache Spark infrastructure. It is designed to faciliate benchmarking and interoperability with scark-cli.

spark-service in action

Spark

If you need an introduction to spark head over to Spark introduction.

Features

  • spark-service offers docker containers for master, work and submit nodes
  • All docker containers are integrated and connected via docker-compose
  • Configurations and allocation parameters of master/worker nodes are easily changed through predefined variables
  • Several runnable example scripts are already included
  • spark-service is specifically designed to interoperate with scark-cli

Documentation

Please visit the Documentation.

Authors

spark-service was designed and implemented by Lukas Heumos.