Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-20 01:31:42 +02:00
Code Issues Packages Projects Releases Wiki Activity

fixed some old models failing due to tokenizer changes, update lite (+1 squashed commits)

Browse Source 
Squashed commits:

[9dee81ec] fixed some old models failing due to tokenizer changes, update lite tooltip (+3 squashed commit)

Squashed commit:

[5ab95a79] fixes

[a561d5e2] fixed some old models failing due to tokenizer changes

[95e65daf] lite updates
This commit is contained in:
Concedo
2023-10-21 11:33:32 +08:00
parent dd1d61ea6b
commit cff75061fe
4 changed files with 72 additions and 26 deletions
Download Patch File Download Diff File Expand all files Collapse all files
gpttype_adapter.cpp
+2 -2
View File
@@ -804,10 +804,10 @@ ModelLoadResult gpttype_load_model(const load_model_inputs inputs, FileFormat in
#endif
//compat for old falcon
if(file_format_meta.fileversion==1 && file_format==FileFormat::GGUF_FALCON)
if(file_format_meta.fileversion==1)
{
//apply compat fix
printf("\nUsing older tokenizer for Falcon...");
printf("\nUsing older tokenizer for GGUFv1...");
OldBPETokenizerMode = true;
}