The AI response is very slow

[phasmid42]

Hi! I'm running it on a mid 2015 macbook pro with 16GB memory and 500G SSD.
It took ~30s to response in conversations. Is this normal or how it can be improved? What is the optimal system environment to run the program?

Actually I've tried to run it on Google Colab , hoping it would work in the way AIDundeon does. But it turned out that downloading the model from mega.nz took too much time and the server disconnects.

[MrReplikant]

As of now, no, there isn't much you can do. That being said, work is being done on the experimental branch, and right now I'm working on a much smaller and lighter model. Once that's out, you can definitely expect faster responses.

[naeu]

Responses are near instant on a R5 3600 / 16 GB / RTX 2060 / SSD.