Skip to content

Commit

Permalink
minor tweaks
Browse files Browse the repository at this point in the history
  • Loading branch information
michaelkamprath committed Jan 19, 2021
1 parent a4ce169 commit e2c9acc
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 5 deletions.
5 changes: 1 addition & 4 deletions spark-qfs-swarm/deploy-spark-qfs-swarm.yml
Original file line number Diff line number Diff line change
Expand Up @@ -58,14 +58,11 @@ services:
- 4040:4040
volumes:
- type: bind
source: /mnt/gfs/jupyter-notebooks
source: /mnt/share/jupyter-notebooks
target: /home/spark/jupyter/notebooks
- type: bind
source: /mnt/data/spark
target: /data/spark
- type: bind
source: /mnt/gfs/data
target: /gfs/data
deploy:
resources:
limits:
Expand Down
2 changes: 1 addition & 1 deletion spark-qfs-swarm/worker-node/spark-conf/spark-defaults.conf
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ spark.executor.cores 12
spark.executor.extraJavaOptions -XX:+UseG1GC

# driver configurations
spark.driver.memory 9g
spark.driver.memory 5g
spark.driver.cores 2

# operational configurations
Expand Down

0 comments on commit e2c9acc

Please sign in to comment.