mikhail/llama.cpp-mtp-turboquant
1
0
Fork 0
Code Issues Pull Requests Actions 34 Packages Projects Releases Wiki Activity
2,764 Commits 1 Branch 0 Tags
544f1f10adeec3d5ed91c4d3bd3f903904ecea63
Commit Graph

1 Commits

Author SHA1 Message Date
Johannes Gäßler 28103f4832 Server: fix seed for multiple slots (#6835) 
* Server: add tests for consistent results

* sampling: separate rng per sampling context
 2024-04-24 11:08:36 +02:00