Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: More effective ways to add items to Evaluation Dataset. #516

Open
634750802 opened this issue Dec 18, 2024 · 0 comments
Open

Feature: More effective ways to add items to Evaluation Dataset. #516

634750802 opened this issue Dec 18, 2024 · 0 comments

Comments

@634750802
Copy link
Collaborator

634750802 commented Dec 18, 2024

Directly add an answer to an Evaluation Dataset

An answer could be added to evaluation dataset when:

  • The message was already finished
  • The message was NOT replying appended questions (the first answer to the question)

Answer page should add a new add to evaluation dataset interaction button for admin user.

There are two options to implement this feature:

  • Construct evaluation dataset item data from frontend and calling the create evaluation dataset api
  • Server provide a new api create evaluation dataset from chat message

Automatically add liked answer to configured Evaluation Dataset

Not sure how to deduplicate answers in current implementation

@634750802 634750802 added this to the Release v0.5.0 milestone Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant