mikhail/llama.cpp-mtp-turboquant
1
0
Fork 0
Code Issues Pull Requests Actions 31 Packages Projects Releases Wiki Activity
400 Commits 1 Branch 0 Tags
3d59769c3bb7e72c915646ddb1e239b1face19f5
Commit Graph

2 Commits

Author SHA1 Message Date
slaren 2005469ea1 Add Q4_3 support to cuBLAS (#1086) 2023-04-20 20:49:53 +02:00
slaren 02d6988121 Improve cuBLAS performance by dequantizing on the GPU (#1065) 2023-04-20 03:14:14 +02:00