Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-20 01:31:42 +02:00
Code Issues Packages Projects Releases Wiki Activity

added support for RNN models in smartcache

Browse Source
This commit is contained in:
Concedo
2025-12-19 16:36:25 +08:00
parent cde4791e36
commit e9ae0cb2dd
2 changed files with 158 additions and 20 deletions
Download Patch File Download Diff File Expand all files Collapse all files
model_adapter.h
+3 -1
View File
@@ -140,4 +140,6 @@ size_t gpttype_calc_old_state_tokencount(int slot);
size_t gpttype_save_state_kv(int slot);
bool gpttype_load_state_kv(int slot);
bool gpttype_clear_state_kv(bool shrink);
int get_oldest_slot(int excludeSlotId);
int get_oldest_slot(int excludeSlotId);
void touch_slot(int slot);
int get_identical_existing_slot();