Skip to content

Commit 2d29cfb

Browse files
committed
Update server.py
1 parent 50273fc commit 2d29cfb

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

optillm/server.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -714,9 +714,12 @@ def proxy():
714714
request_config.update({
715715
"stream": stream,
716716
"n": n,
717-
"response_format": response_format, # Add response_format to config
718717
})
719718

719+
# Only add response_format if it's not None
720+
if response_format is not None:
721+
request_config['response_format'] = response_format
722+
720723
# Add token limits to request_config with proper priority
721724
if max_completion_tokens is not None:
722725
request_config['max_completion_tokens'] = max_completion_tokens

0 commit comments

Comments
 (0)