[Bug] Relative URLs Not Resolved - Links Reference Non-Existent Paths

[anshul23102]

Description

When scraping relative URLs (e.g., "/products/item"), they are stored as-is without resolving to absolute URLs. Links become broken when accessed from different contexts. Downstream systems cannot follow links.

Steps to Reproduce

1. Scrape page: example.com/blog/post
2. Page contains link:
3. Scraper extracts: "/products/item"
4. Link stored in database
5. Requesting: "/products/item" without base URL = 404

Environment Information

• Framework: Cheerio
• URL handling: No resolution
• Storage: Relative URLs saved
• Application version: Current main branch

Expected Behavior

All relative URLs resolved to absolute URLs using base domain. Stored as: https://example.com/products/item

Actual Behavior

File: src/services/linkExtractor.js
Extracts href without resolving: const url = link.attr('href')

Code Reference

File: src/services/linkExtractor.js
Missing: URL resolution using base URL

Additional Context

Resolve URLs:

const absoluteUrl = new URL(relativeUrl, baseUrl).href;

GSSoC Points Estimate: Level 1 (Bug/URL Handling)

Suggested Labels

• gssoc:approved
• type:bug
• severity:medium
• area:data-processing

[Xenon010101]

Hi, I am a GSSoC 2026 contributor and would like to work on this issue. This project matches my expertise. Please assign it to me.

/assign

[garima-agarwall]

Hi @sharmavaibhav31
I would like to work on this issue. Please assign this to me if possible.