Radoslav Gerganov 553a5c3a9f rpc : do not wait for response when sending RPC_CMD_SET_TENSOR (#12943) ...

RPC_CMD_SET_TENSOR always returns an empty response and we send this 4
times per token. We can improve TG speed if we don't wait for this empty
response.

The performance impact of this change depends on the network latency.

2025-04-25 10:08:08 +03:00

..

ggml-blas

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-cann

CANN: Add support for async operator submission (#12864)

2025-04-17 20:34:16 +08:00

ggml-cpu

ggml : Depthwise 2D convolution (ggml/1152)

2025-04-24 17:32:47 +03:00

ggml-cuda

CUDA: use switch statements in constexpr functions (#13095)

2025-04-24 15:57:10 +02:00

ggml-hip

CUDA/HIP: Share the same unified memory allocation logic. (#12934)

2025-04-15 11:20:38 +02:00

ggml-kompute

llama : add Qwen2VL support + multimodal RoPE (#10361)

2024-12-14 14:43:46 +02:00

ggml-metal

metal : fix floating-point range of attention scores in FA kernels (#13090)

2025-04-24 10:38:30 +03:00

ggml-musa

cuda : enable CUDA Graph on CUDA Toolkit < 12.x (#12394)

2025-03-17 20:25:13 +02:00

ggml-opencl

opencl: fix incorrect local_size index in profiling log (#12868)

2025-04-16 14:25:57 -07:00

ggml-rpc

rpc : do not wait for response when sending RPC_CMD_SET_TENSOR (#12943)

2025-04-25 10:08:08 +03:00

ggml-sycl

SYCL: Add non-contiguous support in ROPE (#12993)

2025-04-21 19:13:30 +05:30

ggml-vulkan

vulkan: matmul gcn tuning (#13016)

2025-04-24 09:18:33 +02:00

CMakeLists.txt

ggml : add SSE 4.2 and x64 base variant for CPUs without AVX (#12871)

2025-04-21 18:13:51 +02:00

ggml-alloc.c

ggml : upgrade init_tensor API to return a ggml_status (#11854)

2025-02-28 14:41:47 +01:00

ggml-backend-impl.h

ggml : upgrade init_tensor API to return a ggml_status (#11854)

2025-02-28 14:41:47 +01:00

ggml-backend-reg.cpp

ggml-backend : fix backend search path (#12330)

2025-03-11 14:25:17 +01:00

ggml-backend.cpp

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

ggml-common.h

musa: fix all warnings, re-enable -DLLAMA_FATAL_WARNINGS=ON in ci and update doc (#12611)

2025-03-30 10:59:38 +02:00

ggml-impl.h

ggml: don't include arm_neon.h when using CUDA 12 with ARM Neon (ggml/1187)

2025-04-11 00:17:47 +03:00

ggml-opt.cpp

ggml-opt: fix data corruption (ggml/1022)

2024-11-21 09:22:02 +02:00

ggml-quants.c

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

ggml-quants.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.cpp

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.h

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)

2024-12-12 19:02:49 +01:00

ggml.c

ggml : fix trailing whitespaces (#0)

2025-04-24 17:32:47 +03:00

gguf.cpp

Fix clang warning in gguf_check_reserved_keys (#12686)

2025-04-01 13:12:53 +02:00