mikhail/llama.cpp-mtp-turboquant
1
0
Fork 0
Code Issues Pull Requests Actions 29 Packages Projects Releases Wiki Activity
1 Commit 1 Branch 0 Tags
26c084662903ddaca19bef982831bfb0856e8257
T
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Georgi Gerganov 26c0846629 Initial release
2023-03-10 20:56:40 +02:00
.gitignore
Initial release
2023-03-10 20:56:40 +02:00
convert-pth-to-ggml.py
Initial release
2023-03-10 20:56:40 +02:00
ggml.c
Initial release
2023-03-10 20:56:40 +02:00
ggml.h
Initial release
2023-03-10 20:56:40 +02:00
main.cpp
Initial release
2023-03-10 20:56:40 +02:00
Makefile
Initial release
2023-03-10 20:56:40 +02:00
quantize.cpp
Initial release
2023-03-10 20:56:40 +02:00
utils.cpp
Initial release
2023-03-10 20:56:40 +02:00
utils.h
Initial release
2023-03-10 20:56:40 +02:00
S
Description
llama.cpp fork: upstream master + TurboQuant KV cache (MTP from upstream). Merge b34ac655.
344 MiB
Languages
C++ 55.2%
C 15.2%
Python 7.4%
Cuda 5.9%
TypeScript 3.1%
Other 12.9%