This website requires JavaScript.
Explore
Help
Sign In
mikhail
/
llama.cpp-mtp-turboquant
Watch
1
Star
0
Fork
0
You've already forked llama.cpp-mtp-turboquant
Code
Issues
Pull Requests
Actions
27
Packages
Projects
Releases
Wiki
Activity
Files
e80f06d2a194be62ab5b1cd7ef7c7a5b241dd4fb
llama.cpp-mtp-turboquant
/
examples
/
speculative
T
History
Jeffrey Quesnelle
29eee40474
fix speculative decoding build on windows (
#5874
)
2024-03-04 22:23:06 -05:00
..
CMakeLists.txt
build : link against build info instead of compiling against it (
#3879
)
2023-11-02 08:50:16 +02:00
README.md
speculative : implement stochastic speculative sampling (
#5625
)
2024-03-04 20:24:00 +02:00
speculative.cpp
fix speculative decoding build on windows (
#5874
)
2024-03-04 22:23:06 -05:00
README.md
llama.cpp/examples/speculative
Demonstration of speculative decoding and tree-based speculative decoding techniques
More info:
https://github.com/ggerganov/llama.cpp/pull/2926
https://github.com/ggerganov/llama.cpp/pull/3624
https://github.com/ggerganov/llama.cpp/pull/5625
Reference in New Issue
View Git Blame
Copy Permalink
Jeffrey Quesnelle