Manually solve captcha

[screwyluie]

Description

When a captcha is detected offer a solution to manually solve it.

Possible solution

Open a window on the desktop to allow solving the captcha manually. Not sure how to do it in headless mode though.

[jef]

Not sure how to do it in headless mode though.

Definitely wouldn't happen in headless mode.

I could see some people wanting to do this, but more than often, it doesn't mean anything except that we've hit the website too many times.

[screwyluie]

the issue I'm running into is with amazon... no amount of time waited seems to resolve it. I gave it a rest for over an hour and deleted the chromium cache files and when I fired it back up it still hits the captcha. So it would be nice if there was a way to manually solve it so it can run again.

[manybot]

I get the same issue as @screwyluie

[geman220]

Have you tried changing your USER_AGENT? Some people have posted success with changing it.

[screwyluie]

tried that. didn't help

[joshuaballas]

I think a website module should sleep an x amount of minutes when it encounters a captcha.

[jef]

I think a website module should sleep an x amount of minutes when it encounters a captcha.

We do this currently. We have a random timer to sleep for an extra time.

| `PAGE_SLEEP_MIN` | Minimum sleep time between queries of the same store | In milliseconds, default: `5000` |
| `PAGE_SLEEP_MAX` | Maximum sleep time between queries of the same store | In milliseconds, default: `10000` |

[jef]

Not sure if solving a captcha moves passed it if it just asked for another captcha later on. Would have to test this.

I think updated the user-agent continually will help solve this issue as well.

[screwyluie]

with a different scraper I have noticed that if you're logged into your account on the browser it not longer gets captcha'd

That could be another option, if we could have the bot login somehow.

[jef]

We were doing this initially with nvidia. I suppose we could do something like this with other stores, but the list would continually grow. Not sure how I'd want to tackle this.