Gaurav Garg fd6ae4ca1c Tensor-parallel: Fix delayed AllReduce on Gemma-4 MoE (#22129) ...

* Fix delayed AllReduce on Gemma-4 MoE

Skip forward past nodes that don't consume the current one, and allow a chain of MULs.

* Check for all sources before skipping nodes

* Address review comments

2026-04-20 18:25:39 +02:00

..

ggml-blas

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-cann

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-cpu

ggml-cpu: Optimized x86 and generic cpu q1_0 dot (follow up) (#21636)

2026-04-20 19:02:54 +03:00

ggml-cuda

TP: fix 0-sized tensor slices, AllReduce fallback (#21808)

2026-04-20 18:09:39 +02:00

ggml-hexagon

hexagon: optimize HMX matmul operations (#21071)

2026-04-16 13:48:34 -07:00

ggml-hip

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-metal

metal: Implement ROLL op (#21946)

2026-04-16 11:54:37 +03:00

ggml-musa

ggml-cuda: native bf16 flash attention for vec kernel (#20525)

2026-03-22 11:05:51 +01:00

ggml-opencl

opencl: refactor q8_0 set_tensor and mul_mat host side dispatch for Adreno (#21938)

2026-04-16 22:28:33 -07:00

ggml-openvino

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-rpc

rpc : refactor the RPC transport (#21998)

2026-04-19 10:21:53 +03:00

ggml-sycl

[SYCL] Fix reorder MMVQ assert on unaligned vocab sizes (#22035)

2026-04-20 08:39:45 +03:00

ggml-virtgpu

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-vulkan

vulkan: optimize im2col (#21713)

2026-04-15 19:04:51 +02:00

ggml-webgpu

ggml-webgpu: updated matrix-vector multiplication (#21738)

2026-04-20 07:37:17 -07:00

ggml-zdnn

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-zendnn

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

CMakeLists.txt

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-alloc.c

ggml : remove ggml-ext.h (#21869)

2026-04-14 17:32:58 +03:00

ggml-backend-dl.cpp

hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)

2026-01-29 12:33:21 -08:00

ggml-backend-dl.h

hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)

2026-01-29 12:33:21 -08:00

ggml-backend-impl.h

ggml: backend-agnostic tensor parallelism (experimental) (#19378)

2026-04-09 16:42:19 +02:00

ggml-backend-meta.cpp

Tensor-parallel: Fix delayed AllReduce on Gemma-4 MoE (#22129)

2026-04-20 18:25:39 +02:00

ggml-backend-reg.cpp

ggml : add OpenVINO backend (#15307)

2026-03-14 07:56:55 +02:00

ggml-backend.cpp

ggml: add graph_reused (#21764)

2026-04-16 17:21:28 +08:00

ggml-common.h

ggml: add Q1_0 1-bit quantization support (CPU) (#21273)

2026-04-06 20:55:21 +02:00

ggml-impl.h

ggml: add graph_reused (#21764)

2026-04-16 17:21:28 +08:00

ggml-opt.cpp

fix: free ctx_copy in ggml_opt_free to plug per-training-session leak (#21592)

2026-04-08 17:40:15 +02:00

ggml-quants.c

ggml: add Q1_0 1-bit quantization support (CPU) (#21273)

2026-04-06 20:55:21 +02:00

ggml-quants.h

ggml: add Q1_0 1-bit quantization support (CPU) (#21273)

2026-04-06 20:55:21 +02:00

ggml-threading.cpp

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.h

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)

2024-12-12 19:02:49 +01:00

ggml.c

ggml: add graph_reused (#21764)

2026-04-16 17:21:28 +08:00

ggml.cpp

ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)

2025-06-01 13:43:57 +03:00

gguf.cpp

llama: fix llama-model-saver (#20503)

2026-03-25 12:53:16 +02:00