Skip to content

Conversation

elevran
Copy link

@elevran elevran commented Jul 16, 2025

Following llm-d/llm-d-inference-scheduler#244 when a user sets the prefill header value, EPP would replaces it with an invalid host target (e.g., an empty string or invalid host name. Unfortunately EPP can not remove the header completely).
This would result in a successful URL parse but invalid host in URL. Added function to do some sanity check on the resulting host in URL and return an error when invalid.

lionelvillard
lionelvillard previously approved these changes Jul 16, 2025
Signed-off-by: Etai Lev Ran <[email protected]>
Jooho pushed a commit to Jooho/llm-d-routing-sidecar that referenced this pull request Sep 4, 2025
…96 (llm-d#48)

Signed-off-by: konflux-internal-p02 <170854209+konflux-internal-p02[bot]@users.noreply.github.com>
Co-authored-by: konflux-internal-p02[bot] <170854209+konflux-internal-p02[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants