-
Notifications
You must be signed in to change notification settings - Fork 26
♻️ use defaults for all params for full_model marker #526
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Signed-off-by: Prashant Gupta <[email protected]>
👋 Hi! Thank you for contributing to vLLM support on Spyre.
Or this can be done with
Now you are good to go 🚀 |
bot:test |
1 similar comment
bot:test |
@waleedqk I think we'd need to run the |
@joerunde I was using an active PR to test the build and test process |
bot:test |
3 similar comments
bot:test |
bot:test |
bot:test |
bot:test |
Converting to a draft because we want to reimagine this with the vdpp marker that we are thinking about right now |
bot:test |
Description
Use defaults for all params for full_model marker. This enables us to use
full_model
marker which defaults to TP 4 and CB along with usingsendnn
and the full modelRelated Issues