Skip to content

Conversation

njhill
Copy link
Member

@njhill njhill commented Sep 30, 2025

Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request addresses a test failure in test_load_model within tests/v1/spec_decode/test_eagle.py, which was caused by recent changes for DeepSeek-V3.2 support. The fix involves updating the mock for get_layers_from_vllm_config to account for new calls retrieving DeepseekV32IndexerCache layers. The change correctly aligns the test mock's behavior with the updated load_model implementation, and the explanatory comment is helpful for future maintenance. The fix is accurate and well-contained. I have no further suggestions.

@njhill njhill added the ready ONLY add when PR is ready to merge/full CI is needed label Sep 30, 2025
@heheda12345 heheda12345 added this to the v0.11.0 Cherry Picks milestone Sep 30, 2025
@heheda12345
Copy link
Collaborator

@njhill CI still fails.

v1/spec_decode/test_eagle.py::test_propose[1-FLASH_ATTN-eagle] - AttributeError: 'EagleProposer' object has no attribute 'draft_indexer_metadata_builder'

@njhill
Copy link
Member Author

njhill commented Sep 30, 2025

:( sorry trying to do too many things at once, let me properly test this locally

Signed-off-by: Nick Hill <[email protected]>
@luccafong
Copy link
Collaborator

thanks for the fix, @njhill I have fix in another PR: #25982

@njhill
Copy link
Member Author

njhill commented Oct 1, 2025

The fixed have been included in #25982

@njhill njhill closed this Oct 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
deepseek Related to DeepSeek models ready ONLY add when PR is ready to merge/full CI is needed speculative-decoding v1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants