We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 8b1adb4 commit 67edeafCopy full SHA for 67edeaf
tripy/examples/nanogpt/README.md
@@ -63,9 +63,6 @@ Use `--quant-mode` in `example.py` to enable quantization. Supported modes:
63
64
- Weight-only `int4` quantization:
65
66
- **Warning**: For this model, `int4` quantization may result in poor accuracy.
67
- We include it only to demonstrate the workflow.
68
-
69
```bash
70
python3 example.py --input-text "What is the answer to life, the universe, and everything?" --seed=0 --quant-mode int4-weight-only
71
```
@@ -76,3 +73,6 @@ Use `--quant-mode` in `example.py` to enable quantization. Supported modes:
76
73
77
74
Tripy: TEST: EXPECTED_STDOUT End
78
75
-->
+
+> [!WARNING]
+> For this model, `int4` quantization may result in poor accuracy. We include it only to demonstrate the workflow.
0 commit comments