Skip to content

Conversation

@hwichan0720
Copy link
Contributor

@hwichan0720 hwichan0720 commented Nov 14, 2025

This PR adds support for retrieving reasoning_text from language model.
To achieve this, we introduce the following changes:

  • Add a reasoning_text field to the LMOutput data class
  • During generation, extract res.choices[0].message.reasoning_content and store it in this field.

Note: Currently, this modification is applied only to vllm_serve_lm (openai_api), not to vllm_model or hf_lm. As a result, reasoning_text is available only when using vllm_serve_lm.

@junya-takayama junya-takayama self-requested a review November 15, 2025 01:56
Copy link
Collaborator

@junya-takayama junya-takayama left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@junya-takayama junya-takayama merged commit 9da965a into main Nov 15, 2025
23 of 36 checks passed
@junya-takayama junya-takayama deleted the add-reasoning-text branch November 15, 2025 01:56
@h-asano h-asano mentioned this pull request Dec 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants