You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Right now, the pooling method pools the embedding tokens to a fixed ratio.
We should allow users to set a threshold on the cosine similarity up to which the tokens can be merged.
This should allow us to adapt more to the data by compressing more sequences with a lot of redundant information and fewer the ones that do not.
The text was updated successfully, but these errors were encountered:
Right now, the pooling method pools the embedding tokens to a fixed ratio.
We should allow users to set a threshold on the cosine similarity up to which the tokens can be merged.
This should allow us to adapt more to the data by compressing more sequences with a lot of redundant information and fewer the ones that do not.
The text was updated successfully, but these errors were encountered: