[Feature Request] Enable metadata filter

[rlinlen]

Describe the solution you'd like

As an admin, when creating a bot I would like to limit the users to search only the relevant data in KB based on the metadata.

Why the solution needed

KB sometimes can contain too many information. To increase the relevancy, one way is to use metadata to filter on the content. e.g. I want to search only the pdf in 2024 if there were a year tag; I want to search only the csv created by HR if there were a department tag. It also helps protect the sensitive data from being searched, e.g. FIN KB can only be searched by finance users.

Additional context

Bedrock supports this natively so we just need to implement the UI and include the backend logic during bot creation. As a next step we may enable the user to add additional filter (ad-hoc filter) when searching.

Implementation feasibility

Are you willing to collaborate with us to discuss the solution, decide on the approach, and assist with the implementation?

• [v] Yes, I am able to implement the feature and create a pull request.