我遇到了在HDP2.0上运行sparkPI示例的问题我从http://spark.apache.org/downloads.html下载了spark1.0pre-build(对于HDP2)来自spark网站的运行示例:./bin/spark-submit--classorg.apache.spark.examples.SparkPi--masteryarn-cluster--num-executors3--driver-memory2g--executor-memory2g--executor-cores1./lib/spark-examples-1.0.0-hadoop2.2.0.j

在GoogleComputeEngine上部署了一个Hadoop(Yarn+Spark)集群，其中有一个主节点和两个从节点。当我运行以下shell脚本时:spark-submit--classorg.apache.spark.examples.SparkPi--masteryarn-cluster--num-executors1--driver-memory1g--executor-memory1g--executor-cores1/home/hadoop/spark-install/lib/spark-examples-1.1.0-hadoop2.4.0.jar10作业一直在运行，每