Skip to content

Commit

Permalink
Merge pull request #1059 from llmware-ai/doberst-patch-1
Browse files Browse the repository at this point in the history
Update agents-2-llmware_model_sampler_bling_dragon.py
  • Loading branch information
doberst authored Oct 17, 2024
2 parents 941c3aa + ddf9e12 commit 4a1b39d
Showing 1 changed file with 4 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -513,7 +513,10 @@ def llmware_bling_dragon_hello_world (model_name):
]

# for most use cases, we would recommend using the GGUF for faster inference

# NEW - if you are running on a Windows machine, then try substituting for one of the following:
# -- "bling-tiny-llama-ov" -> uses OpenVino model version - requires `pip install openvino` and `pip install openvino_genai`
# -- "bling-tiny-llama-onnx" -> uses ONNX model version - requires `pip install onnxruntime_genai`

my_model = bling_gguf[1]

llmware_bling_dragon_hello_world(my_model)
Expand Down

0 comments on commit 4a1b39d

Please sign in to comment.