v0.5.8
Enhancements
- #287: Search workflows in side menu
Bugfixes
- #639: Add retry when sending notifications
Internal tasks
- #599: Replaced SparkLauncher with InProcessLauncher
- #647: Bump follow-redirects from 1.13.3 to 1.14.8 in /ui
- #648: Bump minimist from 1.2.5 to 1.2.6 in /ui
Application properties changes
New
notification.delay
. Optional, default value0ms
notification.max.retries
. Optional, default value5
Removed
sparkYarnSink.hadoopConfDir
sparkYarnSink.sparkHome
New configuration for Tomcat
-
The Hadoop configuration directory needs to be added as the environment variable
HADOOP_CONF_DIR
and it has to be added to the web application's classpath. -
The environment variable can be added in
<tomcat-root>/bin/setenv.sh
, e.g.HADOOP_CONF_DIR=/opt/hadoop
. -
To add the Hadoop configuration directory to the application classpath,
in the file<tomcat-base>/conf/catalina.properties
, append to the keyshared.loader
the hadoop conf dir, e.g.shared.loader="/opt/hadoop"
. -
Update env variable and application classpath as follows:
<tomcat-base>/bin/setenv.sh
. Add exportSPARK_CONF_DIR=/opt/spark/conf
/conf/catalina.properties
Set shared.loader=/opt/spark/conf,/opt/hadoop_{environment} (It's important that /opt/spark/conf is before /opt/hadoop)
Full Changelog: v0.5.7...v0.5.8