mikhail/llama.cpp-mtp-turboquant
1
0
Fork 0
Code Issues Pull Requests Actions 30 Packages Projects Releases Wiki Activity
1,398 Commits 1 Branch 0 Tags
4e82b2ea3fa6482915d147bc9f46e70b9ada7700
Commit Graph

2 Commits

Author SHA1 Message Date
Georgi Gerganov fcca0a7004 refact : fix convert script + zero out KV cache to avoid nans (#3523) 
* refact : fix convert script + zero out KV cache to avoid nans

* ggml : silu(-inf) should never happen

* metal : assert various kernel requirements
 2023-10-09 14:32:17 +03:00
ds5t5 f8c90cdbaa llm : add Refact model (#3329) 
* add refact model

* resolve comments

* rebase to the latest

* solve alibi cpu error

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-10-04 16:23:39 +03:00