Docker Builds Statuses
spark-service provides a docker based containerized solution for a quick setup of an Apache Spark infrastructure. It is designed to faciliate benchmarking and interoperability with scark-cli.
If you need an introduction to spark head over to Spark introduction.
- spark-service offers docker containers for master, work and submit nodes
- All docker containers are integrated and connected via docker-compose
- Configurations and allocation parameters of master/worker nodes are easily changed through predefined variables
- Several runnable example scripts are already included
- spark-service is specifically designed to interoperate with scark-cli
Please visit the Documentation.
spark-service was designed and implemented by Lukas Heumos.