You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add async support to semantic cache extension (#214)
This PR introduces new async compliant methods to the semantic cache
class using lazy index construction. Because the `AsyncSearchIndex`
requires an async redis python client, we needed to construct that class
lazily upon first usage within the semantic cache class. This PR fixes
some unclosed connection errors and is also in support of
BerriAI/litellm#5412 at LiteLLM.
0 commit comments