0.0.5 Release: New model additions, remove transformers dependency, fix tokenizer bug
What's Changed
- Remove bulky
transformers
andtorch
dependencies, directly usestokenizer
fix errors by @generall in #13 - New models supported:
- sentence-transformers/all-MiniLM-L6-v2
- intfloat/multilingual-e5-large
- New Supported Models API
list_supported_models
. Existing models supported:- BAAI/bge-small-en
- BAAI/bge-base-en
- Adding model specific tests beyond
DefaultEmbedding
- Removes pooling and directly normalizes the model output
Contributors
- @Rishav-hub made their first contribution in #7
- @generall made their first major contribution in #13
Full Changelog: 0.0.3a1...0.0.5