Seems that spider is crashing when finds bad (or empty?) urls. Running memory leak test:
TypeError: Parameter 'url' must be a string, not undefined
at Url.parse (url.js:107:11)
at urlParse (url.js:101:5)
at Url.resolve (url.js:409:29)
at urlResolve (url.js:405:40)
at null.<anonymous> (/var/www/sitemap/spider/main.js:186:15)
at Function.jQuery.extend.each (/var/www/sitemap/spider/jquery.js:641:20)
at jQuery.fn.jQuery.each (/var/www/sitemap/spider/jquery.js:265:17)
at window.$.fn.spider (/var/www/sitemap/spider/main.js:183:12)
at Object.spider.route.route.article.title [as fn] (/var/www/sitemap/go.js:5:10)
at Spider._handler (/var/www/sitemap/spider/main.js:196:12)
Seems that spider is crashing when finds bad (or empty?) urls. Running memory leak test: