Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-08-29 00:20:49 +02:00
Code Issues Packages Projects Releases Wiki Activity
2,961 Commits 3 Branches 252 Tags
e49d398f732e8c239cb91e32e50798bfda170b72
Commit Graph

58 Commits

Author SHA1 Message Date
Concedo c200b674f4 updated kobold lite, work on rwkv, added exe path to model load params, added launch parameter 2023-04-18 17:36:44 +08:00
Concedo 525184930d added a kobold API compatible implementation of stopping sequences 2023-04-16 18:37:49 +08:00
Concedo ad5676810a merge CLBlast improvements - GPU dequant 2023-04-16 01:17:40 +08:00
Concedo adb4df78d6 Added SmartContext mode, a way of prompt context manipulation that avoids frequent context recalculation. 2023-04-14 21:24:16 +08:00
Concedo 23c675b2e6 integrated optional (experimentl) CLBlast support 2023-04-11 23:33:44 +08:00
Concedo f53238f570 Merged the upstream updates for model loading code, and ditched the legacy llama loaders since they were no longer needed. 2023-04-10 12:00:34 +08:00
Concedo 085a9f90a7 still refactoring 2023-04-01 11:56:34 +08:00
Concedo 6b86f5ea22 halfway refactoring, wip adding other model types 2023-04-01 01:13:05 +08:00