Skip to content

fix(tokenizer): inject tools_ts_str for Kimi-K2.5 chat templates #1448

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
key4ng wants to merge 18 commits into
base: main
Choose a base branch
from
Open

fix(tokenizer): inject tools_ts_str for Kimi-K2.5 chat templates #1448

Show file tree
Hide file tree
Changes from 17 commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
b97e7bd
docs(spec): add Kimi-K2.5 tool-format fix design
key4ng May 5, 2026
5cfc616
docs(spec): drop defensive HF branch from Kimi-K2.5 fix (YAGNI)
key4ng May 5, 2026
b2d2790
feat(tokenizer): add kimi_k25_tools module skeleton
key4ng May 5, 2026
509e702
test(tokenizer): add Kimi-K2.5 encoder fixture infrastructure
key4ng May 5, 2026
86408f1
feat(tokenizer): port Kimi-K2.5 encoder for scalars/objects/arrays
key4ng May 5, 2026
59b08da
fix(tokenizer): correct array item indent and bool default repr in Ki…
key4ng May 5, 2026
c4392d5
feat(tokenizer): add union encoding (enum, anyOf, type-list) for Kimi…
key4ng May 5, 2026
6edc522
feat(tokenizer): add $ref support and description fixtures for Kimi-K2.5
key4ng May 5, 2026
6715962
test(tokenizer): cover empty-params and unknown-type edge cases for K…
key4ng May 5, 2026
4eb2bfc
feat(tokenizer): implement apply_kimi_k25_tools renderer wrapper
key4ng May 5, 2026
5b9104a
feat(tokenizer): add Renderer enum and detection to tiktoken
key4ng May 5, 2026
ed0f623
feat(tokenizer): wire Kimi-K2.5 dispatch in tiktoken; add integration…
key4ng May 5, 2026
cc9cf53
test(tokenizer): prune Kimi-K2.5 fixtures to essential coverage
key4ng May 5, 2026
3cb28da
fix(tokenizer): correctness polish from final code review (Kimi-K2.5)
key4ng May 5, 2026
5ff646a
test(tokenizer): consolidate Kimi-K2.5 tests, drop design doc
key4ng May 6, 2026
99c9c81
refactor(tokenizer): drop intermediate Vec in Kimi-K2.5 arch detection
key4ng May 6, 2026
6fcd8e9
fix(tokenizer): address PR #1448 review feedback (Kimi-K2.5)
key4ng May 11, 2026
7171022
Merge branch 'main' into keyang/kimi_tool_parser
lightseek-bot May 12, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading