Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-19 09:15:18 +02:00
Code Issues Packages Projects Releases Wiki Activity

hacky patch for hidream on kobold to fix tensor type issues

Browse Source
This commit is contained in:
Concedo
2026-05-24 16:37:49 +08:00
parent c62d921f0a
commit d774184e9d
1 changed files with 5 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
otherarch/sdcpp/stable-diffusion.cpp
+5
View File
@@ -568,6 +568,11 @@ public:
? (ggml_type)sd_ctx_params->wtype
: GGML_TYPE_COUNT;
std::string tensor_type_rules = SAFE_STR(sd_ctx_params->tensor_type_rules);
//kcpp: patch hidream to fix broken images on vulkan https://github.com/leejet/stable-diffusion.cpp/issues/1496
if(version == VERSION_HIDREAM_O1 && tensor_type_rules.size()==0)
{
tensor_type_rules = "^model.language_model.layers.[0-9]+.mlp.down_proj.weight=bf16";
}
if (wtype != GGML_TYPE_COUNT || tensor_type_rules.size() > 0) {
model_loader.set_wtype_override(wtype, tensor_type_rules);
}