We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 7178bc4 commit 2d6b9dfCopy full SHA for 2d6b9df
Popular_Models_Guide/DeepSeek/README.md
@@ -55,7 +55,6 @@ look like:
55
```json
56
{
57
"model":"deepseek-ai/DeepSeek-R1-Distill-Llama-8B",
58
- "disable_log_requests": true,
59
"gpu_memory_utilization": 0.9,
60
"enforce_eager": true
61
}
Popular_Models_Guide/Llama2/llama2vllm/1/model.json
@@ -2,6 +2,5 @@
2
"model":"meta-llama/Llama-2-7b-hf",
3
"trust_remote_code":true,
4
"download_dir":"/opt/tritonserver/model_repository/llama2vllm/hf-cache",
5
- "disable_log_requests": "true",
6
"gpu_memory_utilization": 0.5
7
Quick_Deploy/vLLM/README.md
@@ -73,7 +73,6 @@ The content of `model.json` is:
73
74
75
"model": "facebook/opt-125m",
76
77
78
79
```
0 commit comments