please add support for text-generation-webui

[DarkReaperBoy]

this is the repo
https://github.com/oobabooga/text-generation-webui

[MatthewCroughan]

This is half-complete via #29 (comment) but please consider sponsoring the project or contributing, as I don't have time to complete it. This is one of our funding goals.

[pbsds]

This too? https://github.com/go-skynet/LocalAI

[dmadisetti]

What all needs to be done on the branch? Not clear from the PR

Interface and model inference seem to work for me (nvidia)

[dmadisetti]

Working with the most recent version: https://github.com/AnotherGroupChat/ai-flake/tree/dm/wip-text-generation-webui

I think patch hacks are going to have to be an upstream change

Tracking a pkgs solution here: NixOS/nixpkgs#231810

[max-privatevoid]

Resolved via https://github.com/nixified-ai/flake/releases/tag/2

[shpinog]

Resolved via https://github.com/nixified-ai/flake/releases/tag/2

No longer relevant, abandoned. Are there any workarounds?