Rag/rag transition 4

[joelpaulkoch]

See A RAG Library for Elixir

We want to turn chatbot_ex into a RAG system that answers question about ecto. Out of the box, chatbot_ex knows nothing about ecto.

In Step one, we ran the generator.
In Step two, we removed the LLM serving as we will use Ollama to generate responses.
In Step three. we set everything up to ingest ecto into our RAG system.

Langchain Integration

As we want to have an ongoing discussion about ecto with the chatbot, we integrate our RAG system with langchain.

Therefore, we need to remove the last step in our generation pipeline, the generation of a response.
Instead we feed the retrieved information into the next langchain message using a small helper function.