Writing Applications for NextGen Hadoop
This article describes the high-level concept of writing applications for NextGen Hadoop and the flow behind the concept. It is written by reading source codes of NextGen Hadoop and referring the useful info. The flow described here may be modified later since the fast development of NextGen Hadoop now. Invoking The First Container (ApplicationMaster) for YARN ApplicationFirst, you have to write a
Spark Programming Guide
At a high level, every Spark application consists of a driver program that runs the user's main function and executes various parallel operations on a cluster. The main abstraction Spark provides is a distributed dataset, which is a collection of elements partitioned across the nodes of the cluster that can be operated on in parallel. Distributed datasets are created by starting with a file in the
Matei Zaharia
Matei ZahariaI'm a fourth year PhD student in the UC Berkeley AMP Lab, working with Scott Shenker and Ion Stoica. I'm interested in computer systems and networking. I'm currently working on Mesos, a cluster manager that allows diverse datacenter applications to efficiently share resources (paper at NSDI 2011), and Spark, a parallel programming framework for iterative and interactive data analytics
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
処ç†ã‚’実行ä¸ã§ã™
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
{{#tags}}- {{label}}
{{/tags}}