ggml: add GATED_DELTA_NET op (#19504)

* ggml: add GATED_DELTA_NET op * remove the transpose * add KDA * add qwen35 dense * llama : check for fused gated delta net backend support --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2026-03-07 15:41:10 +08:00
parent 6fce5c6a7d
commit c5a778891b
15 changed files with 627 additions and 10 deletions
@@ -31,6 +31,8 @@ struct llama_cparams {
    bool offload_kqv;
    bool flash_attn;
    bool auto_fa;
+    bool fused_gdn_ar;       // use fused gated delta net (autoregressive)
+    bool fused_gdn_ch;       // use fused gated delta net (chunked)
    bool no_perf;
    bool warmup;
    bool op_offload;