Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-08-27 07:30:49 +02:00
Code Issues Packages Projects Releases Wiki Activity

move pipeline parallelism to a --pipelineparallel launch flag

Browse Source
This commit is contained in:
Concedo
2025-12-11 21:03:41 +08:00
parent b7428048fc
commit fd0d0cab03
5 changed files with 20 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
gpttype_adapter.cpp
+1
View File
@@ -2006,6 +2006,7 @@ ModelLoadResult gpttype_load_model(const load_model_inputs inputs, FileFormat in
kcpp_data->use_contextshift = inputs.use_contextshift;
kcpp_data->use_fastforward = inputs.use_fastforward;
kcpp_data->smartcache = inputs.smartcache;
kcpp_pipeline_parallelism = inputs.pipelineparallel;
if(!kcpp_data->use_fastforward && kcpp_data->smartcache)
{
kcpp_data->smartcache = false;