Code

[WIP] HQQ Quant 4 bit#1738

Code

Open

minhthuc2502 wants to merge 10 commits intoOpenNMT:masterOpenNMT/CTranslate2:masterfrom minhthuc2502:dev/quantization_4_bitminhthuc2502/CTranslate2:dev/quantization_4_bitCopy head branch name to clipboard

+1,283-26

Commits

Commits on Jul 4, 2024

• test hqq quantization 4 bit

  minhthuc2502

  committed
  2c5da05

  Copy full SHA for 2c5da05

• fix dequantize gpu

  minhthuc2502

  committed
  253bceb

  Copy full SHA for 253bceb

• test gemm int4

  minhthuc2502

  committed
  836cd8e

  Copy full SHA for 836cd8e

• fix rebase

  minhthuc2502

  committed
  0b6e9cb

  Copy full SHA for 0b6e9cb

Commits on Jul 8, 2024

• hqq quant

  minhthuc2502

  committed
  4ea2e50

  Copy full SHA for 4ea2e50

• hqq quant

  minhthuc2502

  committed
  9b0d425

  Copy full SHA for 9b0d425

Commits on Jul 9, 2024

• update converter

  minhthuc2502

  committed
  2ea15c5

  Copy full SHA for 2ea15c5

Commits on Jul 11, 2024

• fix stuffs

  minhthuc2502

  committed
  f57a72f

  Copy full SHA for f57a72f

• fix stuffs

  minhthuc2502

  committed
  ae7a124

  Copy full SHA for ae7a124

• fix stuffs

  minhthuc2502

  committed
  f80e61f

  Copy full SHA for f80e61f