Skip to content

chih7/spark-install

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 

Repository files navigation

Install Spark Cluster with shell script

Spark install script for debian and Ubuntu. but only tested in Ubuntu Server 16.04.

The script will let you setup a 3 node Spark cluster in no more than 10 minutes.

Installation in a node

sudo -s
su -
git clone https://github.com/chih7/spark-install.git
cd ./spark_install
./install-spark.sh
reboot

Done

Run as a cluster

clone the machine or install spark in other machine with the script.

note the ip address must same with the script.

in spark master machine

sudo -s
su -
vim  /usr/local/spark/conf/spark-env.sh # change  SPARK_LOCAL_IP=spark-xxxx
/usr/local/spark/sbin/start-all.sh

Done

Releases

No releases published

Packages

No packages published

Languages