Xuan-Son Nguyen 00c94083b3 server: (refactor) implement generator-based API for task results (#17174) ...

* server: (refactor) implement generator-based API for task results

* improve

* moving some code

* fix "Response ended prematurely"

* add sink.done before return false

* rm redundant check

* rm unused var

* rename generator --> reader

2025-11-12 18:50:52 +01:00

..

batched-bench

batched-bench : add "separate text gen" mode (#17103)

2025-11-10 12:59:29 +02:00

cvector-generator

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

export-lora

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

gguf-split

ci : use smaller model (#16168)

2025-09-22 09:11:39 +03:00

imatrix

Manually link -lbsd to resolve flock symbol on AIX (#16610)

2025-10-23 19:37:31 +08:00

llama-bench

bench : cache the llama_context state at computed depth (#16944)

2025-11-07 21:23:11 +02:00

main

memory: Hybrid context shift (#17009)

2025-11-10 17:14:23 +02:00

mtmd

cmake : add version to all shared object files (#17091)

2025-11-11 13:19:50 +02:00

perplexity

perplexity : show more kl-divergence data (#16321)

2025-09-29 09:30:45 +03:00

quantize

ci : use smaller model (#16168)

2025-09-22 09:11:39 +03:00

rpc

Install rpc-server when GGML_RPC is ON. (#17149)

2025-11-11 10:53:59 +00:00

run

Manually link -lbsd to resolve flock symbol on AIX (#16610)

2025-10-23 19:37:31 +08:00

server

server: (refactor) implement generator-based API for task results (#17174)

2025-11-12 18:50:52 +01:00

tokenize

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

tts

model : Apertus model implementation (#15852)

2025-10-02 20:43:22 +03:00

CMakeLists.txt

mtmd : rename llava directory to mtmd (#13311)

2025-05-05 16:02:55 +02:00