feat: add lock to hf backend to prevent concurrent generation with conflicting weights#233
Closed
jakelorocco wants to merge 1 commit intomainfrom
Closed
feat: add lock to hf backend to prevent concurrent generation with conflicting weights#233jakelorocco wants to merge 1 commit intomainfrom
jakelorocco wants to merge 1 commit intomainfrom