Mistral nemo (#1785)

minhthuc2502 · web-flow · commit 5ad036deba28 · 2024-09-20T13:51:30.000+02:00
* add config head_dim mistral nemo

* fix black
diff --git a/python/ctranslate2/converters/transformers.py b/python/ctranslate2/converters/transformers.py
@@ -1876,6 +1876,7 @@ def get_model_spec(self, model):
             quant_type=quant_type,
             quant_group_size=quant_group_size,
             quant_bits=quant_bits,
+            head_dim=model.config.head_dim,
         )
 
         self.set_decoder(spec.decoder, model.model, quant_type=quant_type)

Original file line number	Diff line number	Diff line change
`@@ -1876,6 +1876,7 @@ def get_model_spec(self, model):`
`1876`	`1876`	`quant_type=quant_type,`
`1877`	`1877`	`quant_group_size=quant_group_size,`
`1878`	`1878`	`quant_bits=quant_bits,`
	`1879`	`+ head_dim=model.config.head_dim,`
`1879`	`1880`	`)`
`1880`	`1881`
`1881`	`1882`	`self.set_decoder(spec.decoder, model.model, quant_type=quant_type)`