[BUG]: Confluence Connector not working for self-hosted Confluence server

[markkofler]

How are you running AnythingLLM?

Docker (local)

What happened?

Unfortunately I am not able to connect to our self-hosted Confluence servers when using the Confluence Connector. The logs show the following error:

[collector] error: Error: Error: Failed to fetch https://confluence.example.com/rest/api/content?spaceKey=AIINFRA&limit=25&start=0&expand=body.storage,version from Confluence: Error: Failed to fetch https://confluence.example.com/rest/api/content?spaceKey=AIINFRA&limit=25&start=0&expand=body.storage,version from Confluence: 403
    at ve.fetchConfluenceData (/Applications/AnythingLLM.app/Contents/Resources/backend/collector.js:36:6340)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async ve.fetchAllPagesInSpace (/Applications/AnythingLLM.app/Contents/Resources/backend/collector.js:36:6579)
    at async ve.load (/Applications/AnythingLLM.app/Contents/Resources/backend/collector.js:36:5904)
    at async Cs (/Applications/AnythingLLM.app/Contents/Resources/backend/collector.js:42:1102)
    at async /Applications/AnythingLLM.app/Contents/Resources/backend/collector.js:42:9628

My first guess is when testing with curl, the wrong URL is used by the connector for on-prem Confluence. Because if I test the following command, it works fine:

curl -u username:"password" "https://confluence.example.com/rest/api/content/search?cql=space=AIINFRA&limit=25&start=0&expand=body.storage,version"

This would also be the way how to do it based on the Confluence API documentation: https://developer.atlassian.com/server/confluence/rest/v1000/intro/#how-to-perform-an-advanced-search

Any way this can be changed, or you see anything else that is wrong with my config?

Are there known steps to reproduce?

Configure the Confluence Data Connector with deployment type "Self-hosted".