This project Analysis BC climate data with Amazon Web service. We create a EMR cluster with core and node servers. The key technologies of this project are HUE, Hadoop, Hive and Pig. Detail can be found in the paper.
- https://aws.amazon.com/elasticmapreduce/details/hadoop/
- https://aws.amazon.com/elasticmapreduce/
- https://aws.amazon.com/getting-started/launch-a-virtual-machine-B-0-video/launch-a-virtual-machine-B-1/
- http://aws.amazon.com/blogs/aws/hue-web-ui-for-emr/
- https://hive.apache.org/
- https://pig.apache.org/
- http://gethue.com/hadoop-tutorial-how-to-create-a-real-hadoop-cluster-in-10-minutes/
- https://aws.amazon.com/lambda/?nc2=h_m1
- https://aws.amazon.com/getting-started/launch-a-virtual-machine-B-0/
http://tools.pacificclimate.org/dataportal/pcds/map/
- EC2 instance only open port 22 for ssh access, for other port access you need to create new security groups for it. Refer for the below link for how to http://docs.aws.amazon.com/AmazonVPC/latest/GettingStartedGuide//getting-started-create-security-group.html
- Launch an Amazon EC2 Instance https://aws.amazon.com/getting-started/launch-a-virtual-machine-B-0/