Can we use other models, say LLama or Gemini ?

[SwastikGorai]

Can we use models hosted in cloud, or gemini api? Or can we use Ollama if we are hosting the model locally?

[Goodnight77]

i used gemma2 locally where i installed it with ollama and also used mixtral from groq api

[jess-99]

how did you edit the source code to use other models, also did you tried to use other vectorstores than azure?

[jaigouk]

change settings.yaml. In my case, I was able to use Claude 3 haiku #471 (comment)

[natoverse]

Have a look at #657

[duongkstn]

Try litelm, it worked in my case !