For all Nextcloud Ai external apps: using localai and openai-api instead of local llm.

[AnjaSimons]

How to use GitHub

• Please use the 👍 reaction to show that you are interested into the same feature.
• Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
• Subscribe to receive notifications on status change and new comments.

---

Feature request

**Which Nextcloud Version are you currently using: 31.0.7

**Is your feature request related to a problem? Please describe.

I want to use the stt_2 whisper for speech to text and all other external ai apps. But I have only one server and one gpu. This gpu is used by my localai server, and this must not change.
So I can't use these apps.

Describe the solution you'd like
I would like have the features like in nextcloud assistant, set the url for the openai-api and api-key, so the apps don't need to install pytorch, llm's, gpu-interfaces and so on.

[kyteinsky]

hello,
a whisper model can be added to your existing local AI if there is space on your GPU for that, or even on your CPU/RAM. That model will then appear in the models list in integration openai's settings in the "Audio transcription" section. Selecting the model there should be enough to achieve this.
the integration_openai app is capable of that. This app can't be modified to work like that, but you can create a CPU deploy daemon and run this app on CPU if the speed is acceptable to you.