server : use different seeds for child completions (#18700)

* server : use different seeds for child completions * cont : handle default seed * cont : note
2026-01-09 09:33:50 +02:00
parent 8ece3836b4
commit f5f8812f7c
4 changed files with 12 additions and 8 deletions
@@ -1292,7 +1292,9 @@ extern "C" {
    // available samplers:

    LLAMA_API struct llama_sampler * llama_sampler_init_greedy(void);
-    LLAMA_API struct llama_sampler * llama_sampler_init_dist  (uint32_t seed);
+
+    /// seed == LLAMA_DEFAULT_SEED to use a random seed.
+    LLAMA_API struct llama_sampler * llama_sampler_init_dist(uint32_t seed);

    /// @details Top-K sampling described in academic paper "The Curious Case of Neural Text Degeneration" https://arxiv.org/abs/1904.09751
    /// Setting k <= 0 makes this a noop