Skip to content

v0.5.8

Compare
Choose a tag to compare
@jozefbakus jozefbakus released this 31 Mar 10:49
· 114 commits to develop since this release

Enhancements

  • #287: Search workflows in side menu

Bugfixes

  • #639: Add retry when sending notifications

Internal tasks

  • #599: Replaced SparkLauncher with InProcessLauncher
  • #647: Bump follow-redirects from 1.13.3 to 1.14.8 in /ui
  • #648: Bump minimist from 1.2.5 to 1.2.6 in /ui

Application properties changes
New

  • notification.delay. Optional, default value 0ms
  • notification.max.retries. Optional, default value 5

Removed

  • sparkYarnSink.hadoopConfDir
  • sparkYarnSink.sparkHome

New configuration for Tomcat

  • The Hadoop configuration directory needs to be added as the environment variable HADOOP_CONF_DIR and it has to be added to the web application's classpath.

  • The environment variable can be added in <tomcat-root>/bin/setenv.sh, e.g. HADOOP_CONF_DIR=/opt/hadoop.

  • To add the Hadoop configuration directory to the application classpath,
    in the file <tomcat-base>/conf/catalina.properties, append to the key shared.loader the hadoop conf dir, e.g. shared.loader="/opt/hadoop".

  • Update env variable and application classpath as follows: <tomcat-base>/bin/setenv.sh. Add export SPARK_CONF_DIR=/opt/spark/conf
    /conf/catalina.properties
    Set shared.loader=/opt/spark/conf,/opt/hadoop_{environment} (It's important that /opt/spark/conf is before /opt/hadoop)

Full Changelog: v0.5.7...v0.5.8