Skip to content

0.0.5 Release: New model additions, remove transformers dependency, fix tokenizer bug

Compare
Choose a tag to compare
@NirantK NirantK released this 05 Oct 11:30
· 237 commits to main since this release
3139fb7

What's Changed

  • Remove bulky transformers and torch dependencies, directly uses tokenizer fix errors by @generall in #13
  • New models supported:
    • sentence-transformers/all-MiniLM-L6-v2
    • intfloat/multilingual-e5-large
  • New Supported Models API list_supported_models. Existing models supported:
    • BAAI/bge-small-en
    • BAAI/bge-base-en
  • Adding model specific tests beyond DefaultEmbedding
  • Removes pooling and directly normalizes the model output

Contributors

Full Changelog: 0.0.3a1...0.0.5