mikhail/llama.cpp-mtp-turboquant
1
0
Fork 0
Code Issues Pull Requests Actions 30 Packages Projects Releases Wiki Activity
397 Commits 1 Branch 0 Tags
12b5900dbc9743dee3ce83513cf5c3a44523a1b6
Commit Graph

2 Commits

Author SHA1 Message Date
slaren 2005469ea1 Add Q4_3 support to cuBLAS (#1086) 2023-04-20 20:49:53 +02:00
slaren 02d6988121 Improve cuBLAS performance by dequantizing on the GPU (#1065) 2023-04-20 03:14:14 +02:00