This Cli tool extracts links from a specified URL and writes them to a sitemap XML file. The generator handles concurrent requests and limits the number of links it processes. It also uses custom flags for specifying the maximum number of links and the output file.
- Concurrent link extraction using goroutines
- Sitemap XML file generation
- Logging for progress and errors
- Go 1.18 or later
- Go modules enabled (
go mod)
- Clone the repository:
git clone https://github.com/yourusername/sitemap-generator.git cd sitemap-generator - Build the project:
go build -o sitemap-generator
- Run the project:
./sitemap-generator -t <target-url> -maxLinks <number-of-links> -o <output-file>