[Model] Qwen3.5 dense and MoE support (no vision) (#19435)

* Unified delta net handling

* Remove old methods.

* Refactor and optimize

* Adapt autoregressive version from @ymcki

* Change to decay mask approach

* Fix bad permute

* Qwen 3.5 support

* Apply suggestions from code review

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

* Further fixes

* Use inheritance, remove unneeded conts

* Not like this!

* Remove ggml.h explicit import

* Remove transformers, fix the views

* ACTUALLY fix views, make super calls explicit in conversion.

* Fix conversion again

* Remove extra ggml.h imports

---------

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

This commit is contained in:

Piotr Wilkin (ilintar)

2026-02-09 00:24:08 +01:00

committed by

GitHub

parent e06088da0f

commit 39bf692af1

14 changed files with 1532 additions and 399 deletions

									
										src/models/kimi-linear.cpp
									
		-1
	
												View File
												
				@@ -1,5 +1,4 @@

				#include "models.h"

				#include "ggml.h"

				#define CHUNK_SIZE 64