-
Notifications
You must be signed in to change notification settings - Fork 188
feat(Istio): integrate with Istio gateway via extproc #229
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
✅ Deploy Preview for vllm-semantic-router ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
I have tested .. this is working correctly with Istio based Envoy gateway. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- can you create a sparate dir under kubernetes like kubernetes/istio/xxx.yaml to put resource related istio?
- can you provide steps you install in kuberenetes with istio?
I was planning to add the istio docs as a separate PR .. anyway .. but sure .. will add that now via this PR. |
Signed-off-by: Sanjeev Rampal <[email protected]>
Done. And also updated the solution. I have tested that the PR works: Semantic Router using Istio-Envoy Gateway as the front-end via ExtProc without any other gateway. Please review/ approve. @rootfs @Xunzhuo @wangchen615 |
What type of PR is this?
What this PR does / why we need it:
This PR enables Semantic Router to work with Istio Envoy gateway via the ExtProc interface between Istio and Semantic Router
Which issue(s) this PR fixes:
This is one of multiple fixes needed for the issue #39. There will also be additional PRs needed in order to complete that issue/ Feature.
Release Notes: Yes