spark case

[ZJLi2013]

Spark-Notebook开发环境搭建.pdf

Spark on Yarn https://www.cnblogs.com/zlslch/p/6638461.html

spark 安装和使用 https://www.cnblogs.com/dion-90/articles/9058500.html

pyspark on yarn 依赖https://www.jianshu.com/p/df0a189ff28b

docker 下 搭建 spark 集群 https://cloud.tencent.com/developer/article/1438344

multi-process parallel framework:

python mutlirunner 

https://github.com/ray-project/ray

c++ multi-processor 

Ubuntu Clusters https://wiki.ubuntu.com/UbuntuClusters

Spring batch https://docs.spring.io/spring-batch/trunk/reference/html/index.html

https://spark.apache.org/docs/latest/cluster-overview.html
Next, it sends your application code (defined by JAR or Python files passed to SparkContext) to the executors. ?

cluster mode overview
https://spark.apache.org/docs/latest/cluster-overview.html

job scheduling
http://spark.apache.org/docs/latest/job-scheduling.html

ros-spark
https://github.com/NXROBO/spark

.net-spark
https://github.com/dotnet/spark

to support multi-scenes

create new map
lgsvl/simulator#198