Skip to content

180 summarize conversation and store it in a vector form#202

Open
biniyam-29 wants to merge 58 commits intorelease-02from
180-summarize-conversation-and-store-it-in-a-vector-form
Open

180 summarize conversation and store it in a vector form#202
biniyam-29 wants to merge 58 commits intorelease-02from
180-summarize-conversation-and-store-it-in-a-vector-form

Conversation

@biniyam-29
Copy link
Copy Markdown
Collaborator

@biniyam-29 biniyam-29 commented Apr 15, 2025 •
edited
Loading

  • When new mentee comes it will talk with the moderator
  • the moderator uses function calling to extract topic and time of the conversation
  • the topic (only the topic) is compared with mentors expertise
  • it will extract all mentors except the bot mentor under that account then compares the mentors.expertise embeddings with the the topic
  • the conversation with the bot aka moderator is closed
  • new conversation with the selected mentor will be started

biniyam-29 added 30 commits March 28, 2025 18:13
@biniyam-29
boiler-plate for the moderator microservice
4335e85
@biniyam-29
send message to the moderator queue if no conversation has been created
34f3825
@biniyam-29
added an image for the moderator microservice into docker
02e021c
@biniyam-29
moderator queue creation logic as well as binding the queues
1ed2e46
@biniyam-29
debugged inequivalent arg 'x-dead-letter-exchange' for queue 'moderator'
8a1571a
@biniyam-29
returned making the routing key moderator so that to bind moderator q…
43b3106 
…ueue with the right routing routing key
@biniyam-29
rolled back the routing key to debug error inequivalent arg 'x-dead-l…
5f7fe96 
…etter-exchange' for queue 'database' in vhost '/': received 'moderator' but current is 'message'
@biniyam-29
Merge remote-tracking branch 'origin/163-revise-the-database-schema-f…
fe3303c 
…or-mentor-profile' into 175-converse-with-gemini-api-using-langchain
@biniyam-29
Merge branch '166-ai-bot' into 175-converse-with-gemini-api-using-lan…
0984cae 
…gchain
@biniyam-29
configuration to push conversation with the bot to the moderator queue
b0ae969
@biniyam-29
updated the database consumer so that it delegates new messages to a …
6947fdf 
…bot mentor
@biniyam-29
debugged (only one message was consumed from the moderator queue caus…
1f32303 
…e it was not getting and response from the consumer)
@biniyam-29
configured the moderator service to reply to conversations
4595818
@biniyam-29
included all dependencies in the moderator module
5044db3
@biniyam-29
debugging (I was trying to access the consumed message as object but …
3338b78 
…was throwing error cause it is stringfied, so placed a parser based on type)
@biniyam-29
debugging (picked only the text part from gemini response since the w…
7a89b61 
…hole response is non-sense when it is sent)
@biniyam-29
removed a log placed for debugging
7f052cc
@biniyam-29
updated env.example with new variables I've used but not included
6f3e827
@biniyam-29
a mentor is created everytime account is created
d564cd9
@biniyam-29
corrected how the role of the message was differentiated with langcha…
56daedb 
…in standardization
@biniyam-29
included the new message on the context that is sent to the ai
0d3ac89
@biniyam-29
removed un-necessary logs
0b0d42c
@biniyam-29
updated the schema to support vector embeddings
1b0b574
@biniyam-29
added vector extenstion to the postgres docker image
5dcb943
@biniyam-29
made the vector fields optional to avoid errors errors on creation wi…
3c3dea5 
…th out embeddings
@biniyam-29
migrated the new schema
6c907ed
@biniyam-29
installed GoogleGenerativeAIEmbeddings packages from langchain for em…
7426832 
…beding data
@biniyam-29
installed langchain for MemoryVectorStore
043843a
@biniyam-29
service for moderator mentor matching
5afecae
@biniyam-29
changed the search to a bit stricter manner so that it returns with c…
08fc3d5 
…ertain thershold
biniyam-29 and others added 25 commits March 31, 2025 23:47
@biniyam-29
removed un necessary duplicate invocation
7461e35
@biniyam-29
conversation summarization, mentor selection and new conversation ins…
29a77a9 
…tantiation
@biniyam-29
registered all dependencies
8976e9b
@biniyam-29
included apiKey for the embedding model
9e602a9
@biniyam-29
needs expertise when mentor creation
8943610
@biniyam-29
debugged how the prompt was being sent made the bot functional as int…
41dcf3b 
…ended
@biniyam-29
configured trigurring condition for function calling
e619279
@biniyam-29
updated prompt to get the summary in the correct format
07ad763
@biniyam-29
function calling with summary data
d3bbffd
@biniyam-29
configured mentor accepting and conversation handling logic
d936883
@biniyam-29
debugged how the mentor is picked
529907b
@biniyam-29
debugged (once it accepts new mentor it closes the old conversation a…
43c5325 
…nd creates a new active conversation with the new mentor)
@biniyam-29
takes the topic and conversationId then returns a mentor tha best sui…
65e0044 
…ts the topic
@biniyam-29
debugged conversation selection which used to not consider isActive f…
5446146 
…ield
@Bikilaketema
created a chat memory amangement using redis..minimizing the amount o…
ab00bf6 
…f time wasted accessing the DB every now and then
@Bikilaketema
Merge branch '180-summarize-conversation-and-store-it-in-a-vector-for…
461a424 
…m' into 181-create-a-chat-memory-management
@Bikilaketema
changed the redis logic to use langchain comaptible logic
04166ca
@Bikilaketema
addede session TTL from .env
09e97c9
@biniyam-29
tool calling using langchain
56a1e7f
@biniyam-29
implemented a service for mentor selection using embedding vector com…
e809682 
…parision
@biniyam-29
installed necessary packages for function calling
275fe00
@biniyam-29
Merge remote-tracking branch 'origin/181-create-a-chat-memory-managem…
7a50bb9 
…ent' into 180-summarize-conversation-and-store-it-in-a-vector-form
@biniyam-29
added new packages from the merged branch
675913d
@biniyam-29
updated the moderator service to use chain operation
1aa9847
@biniyam-29
updated the prompt for the current code structure
6cf4ecf
@biniyam-29 biniyam-29 linked an issue Apr 15, 2025 that may be closed by this pull request
Summarize conversation and store it in a vector form #180
Open
@biniyam-29 biniyam-29 requested a review from bengeos April 15, 2025 15:09
@biniyam-29 biniyam-29 self-assigned this Apr 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bengeos bengeos Awaiting requested review from bengeos

Assignees

@biniyam-29 biniyam-29

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Summarize conversation and store it in a vector form

2 participants

@biniyam-29 @Bikilaketema