mikhail/llama.cpp-mtp-turboquant
1
0
Fork 0
Code Issues Pull Requests Actions 28 Packages Projects Releases Wiki Activity

convert : use n_groups instead of hardcoded values in reshape (#18929)

Browse Source 
* convert : use n_groups instead of hardcoded values in reshape

This commit modifies the conversion script for NemotronHModel to use
the 'n_groups' hyperparameter, and allow Python to calculate the the
last dimension, using -1, when reshaping the 'mixer.norm.weight' tensor.

* use self.n_group instead of self.hparams["n_groups"]
This commit is contained in:
Daniel Bevenius
2026-01-20 06:55:24 +01:00
committed by GitHub
parent 6df686bee6
commit 7dee9ff59a
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
convert_hf_to_gguf.py
+1 -1
View File
@@ -9212,7 +9212,7 @@ class NemotronHModel(GraniteHybridModel):
return [(mapped_name, reshaped_data)] return [(mapped_name, reshaped_data)]
if name.endswith("mixer.norm.weight"): if name.endswith("mixer.norm.weight"):
reshaped_data = data_torch.reshape(8, 512) reshaped_data = data_torch.reshape(self.n_group, -1)
mapped_name = self.map_tensor_name(name) mapped_name = self.map_tensor_name(name)
return [(mapped_name, reshaped_data)] return [(mapped_name, reshaped_data)]