mikhail/llama.cpp-mtp-turboquant
1
0
Fork 0
Code Issues Pull Requests Actions 36 Packages Projects Releases Wiki Activity

model : wire up Nemotron-H tensors for NVFP4 support (#20561)

Browse Source 
* wire up Nemotron-H tensors for NVFP4 support

* add ssm tensors

* alignment
This commit is contained in:
Sigbjørn Skjæret
2026-03-16 09:19:16 +01:00
committed by GitHub
parent 079e5a45f0
commit de8f01c2d7
4 changed files with 18 additions and 11 deletions
Download Patch File Download Diff File Expand all files Collapse all files
src/llama-model.h
+2 -1
View File
@@ -409,7 +409,8 @@ struct llama_layer {
struct ggml_tensor * ffn_gate_shexp_s = nullptr;
struct ggml_tensor * ffn_up_shexp_s = nullptr;
struct ggml_tensor * ffn_down_shexp_s = nullptr;
struct ggml_tensor * ssm_out_s = nullptr;
struct ggml_tensor * ssm_in_s = nullptr;
struct ggml_tensor * ssm_out_s = nullptr;
struct ggml_tensor * ssm_alpha_s = nullptr;
struct ggml_tensor * ssm_beta_s = nullptr;