- Javascript
- Nodejs 12.19.0
- Cheerio
- get-href
node index.js 'https://chghealthcare.com' 5
Root URL to crawl example: https://chghealthcare.com max Layers to crawl: example 1-10
- make sure you have nodejs installed
- download repository
- run npm ci
- run the crawler using the correct commandline