Skip to content

Dynamic generation with outlines #14

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Jul 4, 2024
Merged

Dynamic generation with outlines #14

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
6347a00
Dynamic generation with outlines
isamu-isozaki Jul 2, 2024
6062beb
Change name
isamu-isozaki Jul 3, 2024
53700a1
Returned to original outlines file
isamu-isozaki Jul 3, 2024
340d4ed
Fixed token id
isamu-isozaki Jul 3, 2024
3855734
Remove unnecessary
isamu-isozaki Jul 3, 2024
c4b4c8f
Pass temperature with ExLlamaV2Sampler.Settings() and also made the E…
ManilShrestha Jul 4, 2024
f302126
Merge pull request #2 from ManilShrestha/feature/pass_temperature_and…
isamu-isozaki Jul 4, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion llm_exl2_client_multi_outlines.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -745,4 +745,4 @@ async def get_nvidia_smi():
if __name__ == "__main__":
import uvicorn

uvicorn.run(app, host=host, port=port, log_level="debug")
uvicorn.run(app, host=host, port=port, log_level="debug")
Loading