Skip to content

Commit febfe97

Browse files
committed
docs: update modern Qwen3 support boundary
1 parent 821d230 commit febfe97

2 files changed

Lines changed: 14 additions & 6 deletions

File tree

‎README.md‎

Lines changed: 10 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -41,11 +41,16 @@ Then build and install InfiniLM:
4141
python3 -m pip install . --no-build-isolation
4242
```
4343

44-
Automated migration coverage is limited to NVIDIA, dense non-quantized Qwen3,
45-
and the default static attention implementation. Other platforms and
46-
configurations remain gated for later validation.
44+
Current migration validation is limited to NVIDIA A100 and dense,
45+
non-quantized Qwen3 configurations without linear bias. Qwen3-0.6B has passed
46+
static and paged attention, eager and graph execution, single-request and
47+
batch-2 inference, greedy and non-greedy sampling, TP2, PP2, and combined
48+
TP2+PP2. Paged attention was validated with the default 256-token block size.
4749

48-
The modern operator closure currently supports `qwen3` within that boundary.
50+
Only `qwen3` can be instantiated by the modern model factory. Other model
51+
families, quantized models, and biased Qwen3 configurations remain gated.
52+
Other platforms and custom paged-cache block sizes have not yet been
53+
validated.
4954

5055
## Inference
5156

@@ -58,7 +63,7 @@ python examples/test_infer.py --device nvidia --model=/path/to/model
5863
For tensor-parallel inference:
5964

6065
```shell
61-
python examples/test_infer.py --device nvidia --model=/path/to/model --tp=4 --batch-size=16
66+
python examples/test_infer.py --device nvidia --model=/path/to/model --tp=2 --batch-size=2
6267
```
6368

6469
Start the OpenAI-compatible server:

‎test/static/test_infinicore_runtime_contracts.py‎

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -220,7 +220,10 @@ def test_modern_model_support_is_gated_before_rank_workers(self) -> None:
220220
self.assertLess(config_creation, rank_workers)
221221

222222
readme = read_source("README.md")
223-
self.assertIn("currently supports `qwen3`", readme)
223+
self.assertIn(
224+
"Only `qwen3` can be instantiated by the modern model factory",
225+
readme,
226+
)
224227

225228
xmake = read_source("xmake.lua")
226229
target_start = xmake.index('target("_infinilm")')

0 commit comments

Comments
 (0)