Search results

KeyError: 'packing' in Quantizer.dequantize after save/load round-trip with nbits=8

Status: Open.

#25 In huawei-csl/SINQ;

· NotShrirang opened on May 19, 2026

How to quantize models on multiple GPUs?

Status: Open.

#23 In huawei-csl/SINQ;

· sfbemerk opened on Mar 19, 2026

Using with Ollama and LLama.cpp

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#9 In huawei-csl/SINQ;

· VanGorg opened on Oct 16, 2025

建议: roadmap是否可以按时间倒排

Status: Open.

#6 In huawei-csl/SINQ;

· aiziyuer opened on Oct 11, 2025

请问 sinq 支持昇腾npu 吗

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#5 In huawei-csl/SINQ;

· jkl375 opened on Oct 10, 2025

Exllamav3 team up

Status: Open.

#3 In huawei-csl/SINQ;

· Potatooff opened on Oct 5, 2025

Utilizing SINQ for non-LLM architectures

Status: Open.

#2 In huawei-csl/SINQ;

· ogencoglu opened on Oct 4, 2025