Pasha Khosravi 7e72b38bc1 cuda: Q1_0 initial backend (#21629) ...

* [cuda] initial Q1_0 backend

* remove unused code, fix AMD MMA guard

* attempt to support dp4a

* Apply suggestions from code review

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

---------

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

2026-04-15 18:38:38 +02:00

..

ggml-blas

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-cann

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-cpu

ggml : fix ARM NEON nvfp4 dot product on non-dotprod targets (#21559)

2026-04-14 14:23:45 +03:00

ggml-cuda

cuda: Q1_0 initial backend (#21629)

2026-04-15 18:38:38 +02:00

ggml-hexagon

hexagon: optimization for HMX mat_mul (#21554)

2026-04-14 14:09:03 -07:00

ggml-hip

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-metal

metal : fix FA support logic (#21898)

2026-04-14 17:32:29 +03:00

ggml-musa

ggml-cuda: native bf16 flash attention for vec kernel (#20525)

2026-03-22 11:05:51 +01:00

ggml-opencl

opencl: add basic support for q5_k (#21593)

2026-04-11 01:46:19 -07:00

ggml-openvino

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-rpc

rpc : add native RDMA transport for RPC backend (RoCEv2) (#20590)

2026-04-15 16:44:02 +03:00

ggml-sycl

sycl: disable Q1_0 in backend and cleanup unused variables (#21807)

2026-04-13 09:44:58 +08:00

ggml-virtgpu

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-vulkan

vulkan: Programmatically add RoundingModeRTE to all shaders when the device supports it (#21572)

2026-04-14 15:17:45 +02:00

ggml-webgpu

ggml-webgpu: Fix dequantization helpers to not pass in pointers (#21872)

2026-04-15 09:14:40 -07:00

ggml-zdnn

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-zendnn

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

CMakeLists.txt

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-alloc.c

ggml : remove ggml-ext.h (#21869)

2026-04-14 17:32:58 +03:00

ggml-backend-dl.cpp

hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)

2026-01-29 12:33:21 -08:00

ggml-backend-dl.h

hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)

2026-01-29 12:33:21 -08:00

ggml-backend-impl.h

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-backend-meta.cpp

CUDA: manage NCCL communicators in context (#21891)

2026-04-15 15:58:40 +02:00

ggml-backend-reg.cpp

ggml : add OpenVINO backend (#15307)

2026-03-14 07:56:55 +02:00

ggml-backend.cpp

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-common.h

ggml: add Q1_0 1-bit quantization support (CPU) (#21273)

2026-04-06 20:55:21 +02:00

ggml-impl.h

llama: fix llama-model-saver (#20503)

2026-03-25 12:53:16 +02:00

ggml-opt.cpp

fix: free ctx_copy in ggml_opt_free to plug per-training-session leak (#21592)

2026-04-08 17:40:15 +02:00

ggml-quants.c

ggml: add Q1_0 1-bit quantization support (CPU) (#21273)

2026-04-06 20:55:21 +02:00

ggml-quants.h

ggml: add Q1_0 1-bit quantization support (CPU) (#21273)

2026-04-06 20:55:21 +02:00

ggml-threading.cpp

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.h

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)

2024-12-12 19:02:49 +01:00

ggml.c

ggml: add Q1_0 1-bit quantization support (CPU) (#21273)

2026-04-06 20:55:21 +02:00

ggml.cpp

ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)

2025-06-01 13:43:57 +03:00

gguf.cpp

llama: fix llama-model-saver (#20503)

2026-03-25 12:53:16 +02:00