-
fa0465954f
ggml: fix: macOS build with
-DGGML_BACKEND_DL=ON (#17581)
Gilad S.
2025-11-30 04:00:59 +02:00
-
5a6241feb0
common: update env var name (#17588)
ddh0
2025-11-29 19:59:25 -06:00
-
c7af376c29
CUDA: add stream-based concurrency (#16991)
Aman Gupta
2025-11-30 08:17:55 +08:00
-
00425e2ed1
cuda : add error checking for cudaMemcpyAsync in argsort (#17599)
Mahekk Shaikh
2025-11-29 19:16:28 -05:00
-
385c3da5e6
vulkan : fix FA mask load with bounds check (coopmat2) (#17606)
Acly
2025-11-30 01:03:21 +01:00
-
ab49f094d2
server: move server-context to its own cpp|h (#17595)
Xuan-Son Nguyen
2025-11-29 22:04:44 +01:00
-
8c32d9d96d
server: explicitly set the function name in lambda (#17538)
Haiyue Wang
2025-11-30 01:43:29 +08:00
-
0874693b44
common : fix json schema with '\' in literals (#17307)
Igor Smirnov
2025-11-29 21:06:32 +05:00
-
7d2add51d8
sycl : support to malloc memory on device more than 4GB, update the doc and script (#17566)
Neo Zhang
2025-11-29 20:59:44 +08:00
-
f698a79c63
ggml: replace hwcap with riscv_hwprobe for RVV detection (#17567)
ixgbe
2025-11-29 20:56:31 +08:00
-
47a268ea50
Vulkan: MMVQ Integer Dot K-Quant and MUL_MAT_ID support (#16900)
Ruben Ortlam
2025-11-29 09:37:22 +01:00
-
59d8d4e963
vulkan: improve topk perf for large k, fix overflow in unit tests (#17582)
Jeff Bolz
2025-11-29 01:39:57 -06:00
-
d82b7a7c1d
gguf-py : fix passing non-native endian tensors (editor-gui and new-metadata) (#17553)
Aleksei Nikiforov
2025-11-28 20:53:01 +01:00
-
03914c7ef8
common : move all common_chat_parse_* to chat-parser.cpp. (#17481)
DAN™
2025-11-28 13:29:36 -05:00
-
3ce7a65c2f
server: fix: /metrics endpoint returning JSON-escaped Prometheus format (#17386)
o7si
2025-11-29 02:14:00 +08:00
-
e072b2052e
ggml : add GGML_SCHED_NO_REALLOC option to disable reallocations in ggml_backend_sched (#17276)
Diego Devesa
2025-11-28 07:33:23 -08:00
-
c6f7a423c8
[MUSA] enable fp16/fast_fp16/bf16_mma on PH1 (#17551)
R0CKSTAR
2025-11-28 21:08:29 +08:00
-
2e7ef98f18
ggml-cuda: add stricter checking for fusion (#17568)
Aman Gupta
2025-11-28 20:34:51 +08:00
-
ddf9f94389
server : add Anthropic Messages API support (#17570)
Fredrik Hultin
2025-11-28 12:57:04 +01:00
-
ff55414c42
model : Qwen3 Next (#16095)
Piotr Wilkin (ilintar)
2025-11-28 12:02:56 +01:00
-
73955f7d2a
CUDA: no FP16 arithmetic for vector FA kernel (#17558)
Johannes Gäßler
2025-11-28 10:29:09 +01:00
-
35cf8887e1
vulkan: Implement GGML_OP_TRI (#17503)
Jeff Bolz
2025-11-28 03:07:29 -06:00
-
15d2b46b4d
rpc : cache and reuse compute graphs (#15405)
Radoslav Gerganov
2025-11-28 10:33:51 +02:00
-
6bca76ff5e
HIP: enable mul_mat_f for RDNA4 (#17437)
yulo
2025-11-28 15:24:30 +08:00
-
cd0e3a7a3b
SOLVE_TRI CUDA kernel for small matrices (#17457)
Piotr Wilkin (ilintar)
2025-11-28 05:15:32 +01:00
-
efaaccdd69
refactor pad_reflect_1d to make the UT case pass (#17204)
Neo Zhang Jianyu
2025-11-28 08:50:56 +08:00
-
4abef75f2c
vulkan: Implement SOLVE_TRI (#17486)
Jeff Bolz
2025-11-27 08:48:00 -06:00
-
c386114922
arch : add description about LLM_TENSOR_INFOS (#17550)
Georgi Gerganov
2025-11-27 16:34:13 +02:00
-
6783b11fb0
models : fix LFM2 tensors (#17548)
Georgi Gerganov
2025-11-27 16:04:29 +02:00
-
909072abcf
cuda : fix UMA detection on discrete GPUs. (#17537)
matt23654
2025-11-27 11:35:35 +00:00
-
cd8370b408
ggml-cpu: aarm64: q4_K repack gemm and gemv implementations (dotprod only) (#17494)
Alberto Cabrera Pérez
2025-11-27 11:25:14 +00:00
-
d21a76ac38
devops: Add build-essential to Ubuntu 26.04 image (#17531)
Eric Curtin
2025-11-27 10:35:47 +00:00
-
4fcd87cf7c
gguf-py : skip endian-conversion of MXFP4 data (#17523)
Aleksei Nikiforov
2025-11-27 11:35:38 +01:00
-
b78db3bd50
vulkan : move contiguous checks to device_supports_op (#17490)
Acly
2025-11-27 06:54:19 +01:00
-
142df17c9c
vulkan: use a fixed 1KB buffer for the add_rms_fusion opt (#17514)
Jeff Bolz
2025-11-26 23:32:30 -06:00
-
e509411cf1
server: enable jinja by default, update docs (#17524)
Xuan-Son Nguyen
2025-11-27 01:02:50 +01:00
-
7cba58bbea
opencl: add sqr, sqrt, mean and ssm_conv (#17476)
lhez
2025-11-26 13:29:58 -08:00
-
5449367b21
Fix chunks being too small with small matrix sizes (#17526)
Alberto Cabrera Pérez
2025-11-26 21:14:54 +00:00
-
1d594c295c
clip: (minicpmv) fix resampler kq_scale (#17516)
Han Qingzhe
2025-11-27 04:44:07 +08:00
-
eec1e33a9e
vulkan: allow graph_optimize for prompt processing workloads (#17475)
Jeff Bolz
2025-11-26 09:46:33 -06:00
-
879d673759
vulkan: Implement top-k (#17418)
Jeff Bolz
2025-11-26 09:45:43 -06:00
-
6ab4e50d9c
ggml-cpu : add RISC-V Zvfh impl for ggml_vec_mad_f16 (#17448)
xctan
2025-11-26 21:33:05 +08:00
-
2336cc4784
cmake : use EXCLUDE_FROM_ALL to avoid patch-boringssl.cmake (#17520)
Adrien Gallouët
2025-11-26 14:15:21 +01:00
-
e6923caaec
ggml : fix ARM feature verification (#17519)
Adrien Gallouët
2025-11-26 14:14:41 +01:00
-
3e18dba9fd
HIP: Patch failed testcase in WMMA-MMQ kernels for RDNA 4 (#17502)
Jiacheng (Jason) Chen
2025-11-26 05:18:48 -05:00
-
eeb5605de2
CANN: Add MROPE and IMROPE support (#17401)
hipudding
2025-11-26 16:44:19 +08:00
-
f3a848a3b1
chore: upgrade cpp-httplib from v0.27.0 to v0.28.0 (#17513)
o7si
2025-11-26 15:21:06 +08:00
-
b3b03a7baf
vulkan: Implement GGML_OP_CUMSUM (#17479)
Jeff Bolz
2025-11-26 00:08:10 -06:00
-
583cb83416
ggml : add ggml_top_k (#17365)
Georgi Gerganov
2025-11-25 15:31:43 +02:00
-
05872ac885
convert : fix big-endian conversion (#17431)
Aleksei Nikiforov
2025-11-25 14:18:16 +01:00
-
55ab25caf5
codeowners : remove slaren (#17492)
Diego Devesa
2025-11-25 04:00:23 -08:00
-
064c90d843
CANN: supports out_prod operator for F32 and F16 (#17406)
TianHao324
2025-11-25 17:39:06 +08:00
-
b1846f1c8e
webui: add rehype plugin to restore HTML in Markdown table cells (#17477)
Pascal
2025-11-25 08:01:02 +01:00
-
d414db02d3
vulkan: Use fewer rows for scalar FA when HS is not a multiple of 16 (#17455)
Jeff Bolz
2025-11-25 00:11:27 -06:00
-
877566d512
llama: introduce support for model-embedded sampling parameters (#17120)
Aaron Teo
2025-11-25 09:56:07 +08:00
-
3d07caa99b
vulkan: more FA details in vk_perf_logger (#17443)
Jeff Bolz
2025-11-24 15:25:24 -06:00
-
134e6940ca
llama : skip output reordering for single token batches (#17466)
Daniel Bevenius
2025-11-24 21:06:17 +01:00
-
0543f928a3
HIP: WMMA-MMQ kernels for RDNA 4 (#17156)
Jiacheng (Jason) Chen
2025-11-24 14:00:10 -05:00
-
b61de2b2df
convert : allow quantizing lora again (#17453)
Sigbjørn Skjæret
2025-11-24 15:50:55 +01:00
-
b8372eecd9
server: split server.cpp code into server/common/task/queue (#17362)
Xuan-Son Nguyen
2025-11-24 14:41:53 +01:00
-
6ab8eacddf
examples : add -kvu to batched usage example [no ci] (#17469)
Daniel Bevenius
2025-11-24 14:38:45 +01:00
-
2d50b9d8cb
sync : ggml
Georgi Gerganov
2025-11-24 14:28:37 +02:00
-
697edfeead
ggml : remove dirty flag from version string (ggml/1391)
Daniel Bevenius
2025-11-24 12:51:50 +01:00
-
dbb852b549
ggml-cpu: arm64: q4_K repack gemm and gemv implementations (i8mm) (#16739)
Alberto Cabrera Pérez
2025-11-24 11:08:11 +00:00
-
5f55c385cb
ggml: add RISC-V cpu-feats (#17461)
ixgbe
2025-11-24 19:07:14 +08:00
-
4902eebe33
models : Added support for RND1 Diffusion Language Model (#17433)
william pan
2025-11-23 22:16:56 -08:00
-
923ae3c619
hexagon: add support for ROPE_NEOX (#17458)
Max Krasnyansky
2025-11-23 18:55:56 -08:00
-
01ad35e6d6
CANN: Define
cann_graph_update_required before macro (#17434)
Raul Torres
2025-11-24 02:02:52 +00:00
-
fcb013847c
ggml-hexagon: Initial Hexagon v68/v69 support (#17394)
M. Mediouni
2025-11-24 01:54:49 +01:00
-
d5bc1ad110
ggml-hexagon: add
hex_supported_buffer for better buffer supported check (#17212)
nullname
2025-11-24 06:26:36 +08:00
-
0c7220db56
webui: minor settings reorganization and add disable autoscroll option (#17452)
Pascal
2025-11-23 18:42:00 +01:00
-
96ac5a2329
cuda : support non-contiguous i32 to i32 copy (#17326)
Sigbjørn Skjæret
2025-11-23 11:13:34 +01:00
-
bc809e9c53
vulkan: Update docker image to Ubuntu 26.04 to enable glslc features (#17439)
Eric Curtin
2025-11-23 09:29:36 +00:00
-
54d83bbe85
vulkan: remove a couple unnecessary switches (#17419)
Jeff Bolz
2025-11-22 23:29:40 -06:00
-
4949ac0f18
ci : switch to BoringSSL on Server workflow (#17441)
Adrien Gallouët
2025-11-22 21:38:19 +01:00
-
3f3a4fb9c3
Revive MUL_MAT_ID to perf testing (#17397)
Masato Nakasaka
2025-11-22 18:55:43 +09:00
-
028f93ef98
HIP: RDNA4 tensor core support for MMF (#17077)
yulo
2025-11-22 07:03:24 +08:00
-
8e9ddba610
opencl: refine condition for kqv mm (#17392)
lhez
2025-11-21 14:34:48 -08:00
-
23bc779a6e
model : detect GigaChat3-10-A1.8B as deepseek lite (#17420)
ubergarm
2025-11-21 08:51:38 -05:00
-
28175f857d
cmake : add option to build and link BoringSSL (#17205)
Adrien Gallouët
2025-11-21 11:46:45 +01:00
-
9cc4080441
ci : start using OpenSSL (#17235)
Adrien Gallouët
2025-11-21 11:45:00 +01:00
-
f1ffbba68e
vulkan: disable async for older Intel devices (#17369)
Jeff Bolz
2025-11-21 02:58:17 -06:00
-
2370665e56
CANN: Refactor
evaluate_and_capture_cann_graph (#17333)
Raul Torres
2025-11-21 08:23:29 +00:00
-
21d31e0810
ggml-hexagon: fix swiglu failure at
test-backend-ops (#17344)
nullname
2025-11-21 07:45:05 +08:00
-
dd0f321941
readme : add Unsloth exporting to GGUF in tools (#17411)
Daniel Han
2025-11-20 11:07:36 -08:00
-
054a45c3d3
grammar: fix regression caused by #17381 (#17412)
Xuan-Son Nguyen
2025-11-20 18:35:10 +01:00
-
4c91f2633f
Improved file naming & structure for UI components (#17405)
Aleksander Grygier
2025-11-20 14:07:31 +01:00
-
92c0b387a9
grammar : fix integer overflow (#17381)
Piotr Wilkin (ilintar)
2025-11-20 13:47:04 +01:00
-
2286a360ff
sync : ggml
Georgi Gerganov
2025-11-20 14:09:48 +02:00
-
1d321e592b
metal : fix compile on macos 11 (whisper/3533)
YangLe
2025-11-20 19:54:54 +08:00
-
196f5083ef
common : more accurate sampling timing (#17382)
Georgi Gerganov
2025-11-20 13:40:10 +02:00
-
5088b435d4
convert : fix TypeError when loading base model remotely in convert_lora_to_gguf (#17385)
o7si
2025-11-20 19:30:12 +08:00
-
845f200b28
ggml : Fix transposed SOLVE_TRI result (#17323)
Piotr Wilkin (ilintar)
2025-11-20 11:58:21 +01:00
-
a7784a8b1d
DGX Spark: UMA support (#17368)
Scott Fudally
2025-11-20 02:32:02 -08:00
-
79bb743512
ggml : remove useless and error-prone variadic macros (#17399)
Adrien Gallouët
2025-11-20 11:18:27 +01:00
-
3ae282a06f
kleidiai: fix zero-size array declaration (#17240)
sudhiarm
2025-11-20 09:45:49 +00:00
-
5be353ec4a
ggml-cpu:add RISC-V RVV (Zvfh) optimization for FP16 vector scaling (#17314)
ixgbe
2025-11-20 14:09:18 +08:00
-
7d77f07325
vulkan: implement ADD1, ARANGE, FILL, SOFTPLUS, STEP, ROUND, CEIL, FLOOR, TRUNC (#17319)
Giuseppe Scrivano
2025-11-19 17:29:45 +01:00
-
1fa4551af0
vulkan: support larger argsort (#17313)
Jeff Bolz
2025-11-19 10:25:50 -06:00
-
2eba631b81
vulkan: Add copy_transpose shader (#17371)
Jeff Bolz
2025-11-19 09:50:43 -06:00