Zeppelin起Spark任务报错:RECEIVED SIGNAL TERM
解决方法如下所示:
- 调大spark任务资源
export SPARK_SUBMIT_OPTIONS="
--driver-memory 4G
--executor-memory 4G
--driver-cores 2
--executor-cores 2
--num-executors 20
--conf spark.sql.shuffle.partitions=1000
--conf spark.default.parallelism=300