Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-03 11:35:48 +02:00
Code Issues Packages Projects Releases Wiki Activity

add a space between the bench prompt to fix an issue with old bpe tokenizer stack overflow (+1 squashed commits)

Browse Source 
Squashed commits:

[44a689de] add a space between the bench prompt to fix an issue with old bpe tokenizer stack overflow
This commit is contained in:
Concedo
2024-08-10 17:40:10 +08:00
parent 86e687ae8b
commit da8a96199c
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
koboldcpp.py
+1 -1
View File
@@ -4234,7 +4234,7 @@ def main(launch_args,start_server=True):
else:
print(f"\nRunning benchmark (Not Saved)...")
if benchprompt=="":
benchprompt = "1111111111111111"
benchprompt = " 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1"
for i in range(0,14): #generate massive prompt
benchprompt += benchprompt
genout = generate(benchprompt,memory="",images=[],max_length=benchlen,max_context_length=benchmaxctx,temperature=benchtemp,top_k=benchtopk,rep_pen=benchreppen,ban_eos_token=benchbaneos)