Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-19 09:15:18 +02:00
Code Issues Packages Projects Releases Wiki Activity

up to date merge, without vulkan-gen-shaders. They will be built before each release from now on, as they are very large

Browse Source
This commit is contained in:
Concedo
2024-12-13 17:18:01 +08:00
parent 595cc6975f d583cd03f6
commit ed75f8a741
24 changed files with 655 additions and 573 deletions
Download Patch File Download Diff File Expand all files Collapse all files
common/common.h
+2 -2
View File
@@ -282,8 +282,8 @@ struct common_params {
bool warmup = true; // warmup run
bool check_tensors = false; // validate tensor data
std::string cache_type_k = "f16"; // KV cache data type for the K
std::string cache_type_v = "f16"; // KV cache data type for the V
ggml_type cache_type_k = GGML_TYPE_F16; // KV cache data type for the K
ggml_type cache_type_v = GGML_TYPE_F16; // KV cache data type for the V
// multimodal models (see examples/llava)
std::string mmproj = ""; // path to multimodal projector // NOLINT