772 Commits

Author SHA1 Message Date
Wagner Bruna 3f0a418624 sd: fix video LoRAs (#2460) 2026-09-14 22:21:11 +08:00
Wagner Bruna da1a9d4f4c sd: merge upstream int8 convrot and fp8 scaled at master-841-6b3edaa (#2452)
Gated behind disabled macros KCPP_MAINLINE_INT8_CONVROT and
KCPP_MAINLINE_FP8_SCALED .
2026-09-14 22:11:37 +08:00
Concedo de926911e1 fixed a arm compile issue 2026-09-06 18:18:24 +08:00
Wagner Bruna 5ac1407e87 sd: free audio VAE weights after encoding and decoding (#2430) 2026-09-04 10:15:22 +08:00
Wagner Bruna b83cdc6f42 sd: cherry-pick changes up to master-841-6b3edaa (#2426)
fix: match exact weights in LLM config detection
feat: add LTX-2.5 support
fix: correct MiniMax H3 reference audio encoding
fix: correct MiniMax H3 audio Euler steps
feat: additional `--preview-interval` values
feat: support numbering for preview images
fix: use carrier sampling for MiniMax H3 audio
feat: generalize temporal tiling across video VAEs
2026-09-03 16:32:59 +08:00
Concedo 5f9ecb13a6 allow removing the clamp limits for flux1 too 2026-09-01 16:39:07 +08:00
Concedo e3dd9daf97 fixed ltx audio to video conditioning 2026-08-30 17:49:15 +08:00
Concedo cec13b80a4 wip on true media references for h3 video gen 2026-08-30 14:49:24 +08:00
Wagner Bruna 4ac5721b5e sd: cherry-pick changes up to master-827-97d2990 (#2408)
feat: add taeh3 support
fix: prevent gallocr hash overflow in tiny graph-cut segments
fix: re-clamp streaming VRAM budget to currently free memory
fix: mark graph cuts with both a prefix and a suffix
fix: make max_order of lms sampler configurable
fix: guard against missing sampler/scheduler names
chore: format code
2026-08-28 22:55:53 +08:00
Concedo dd4fa6718a dont set_preview_images within abort itself 2026-08-26 12:49:10 +08:00
Concedo eb6c7376a1 clear old preview when aborted 2026-08-25 20:56:42 +08:00
Wagner Bruna ad2b22a41d sd: set step as 0 for the first noisy preview (#2416)
The initial noisy preview is reported before denoising, so it shows the
ongoing step number; but we immediately switch to denoised previews or
progress callback info, which instead show concluded steps. So we
currently report step '1' during the first two inference steps.
2026-08-25 20:53:15 +08:00
Concedo b6a253517e fix whisper device selection 2026-08-22 18:16:59 +08:00
Concedo 2b78904b4a bug fixes for backend code 2026-08-22 17:28:48 +08:00
Wagner Bruna b9b3bbcec1 refactor: add new module for backend-specific code (#2308)
* refactor: add new module for backend-specific code

* replace ifdefs on rwkv_v3

* replace ifdefs on llama_v2

* replace ifdefs on llama_v3

* replace ifdefs on gpt2_v3

* replace ifdefs on gptj_v3

* replace ifdefs on mpt_v3

* replace ifdefs on neox_v3

* replace ifdefs on whisper

* adjust build for kcpp_backend

Mostly a:
sed 's/ gpttype_adapter\([^ ]*\)\.o / gpttype_adapter_default.o kcpp_backend\1.o /g' Makefile

and include variant objects for kcpp_backend.
2026-08-22 10:00:00 +08:00
Concedo 5b80635beb fix for https://github.com/LostRuins/koboldcpp/security/advisories/GHSA-qhvp-gj7g-rw26 2026-08-18 18:20:05 +08:00
Wagner Bruna 493f6e6d9c sd: fix progress report for second order samplers (#2403)
Each first half step is reported as negative.
2026-08-18 18:18:58 +08:00
Concedo d81ae290d2 move a print to debug 2026-08-14 21:22:42 +08:00
Wagner Bruna 7ec78d48e4 sd: sync with master-816-487de75 (#2395) 2026-08-12 21:35:09 +08:00
Concedo 75c8184210 hold the mutex for the whole step_callback function 2026-08-12 18:05:05 +08:00
Concedo 533aa18897 make preview sticky for sdcpp 2026-08-12 17:13:20 +08:00
Concedo 5925082d19 fix noisy callback no longer encodes a preview, and preview generation triggers only one-shot 2026-08-11 21:21:50 +08:00
Wagner Bruna c98c00f9ba sd: generation progress fixes (#2391)
* sd: generation progress fixes

The preview callback is not called if preview images are not enabled,
so when a preview image wasn't requested, the step count wouldn't be
updated. So move the update to the progress callback. Additionally,
adjust the total step count when the progress call reports a lower
total (e.g. for img2img).

Also remove the preview reset from inside the callback, since it
often caused a preview miss, depending on when the next preview
request arrived.

* sd: fix image preview behavior for VAE encoding / tiling

The progress callback is also called for VAE encoding and decoding,
receiving the number of tiles as step count, so there is no simple
way to detect the diffusion beginning. So we set up the first preview
callback to detect it, and transition to the decoding phase when
we reach the last step.
2026-08-11 21:03:11 +08:00
Concedo 16d9abb6b3 vae free buf fix sdcpp memory leak 2026-08-08 18:44:59 +08:00
Concedo 56368c0fd4 newline in debug (+1 squashed commits)
Squashed commits:

[dbc58568d] newline in debug
2026-08-07 18:42:09 +08:00
Concedo 569532f7e4 improve image gen display 2026-08-07 15:21:42 +08:00
Concedo d49b7a62e8 fixed compile order 2026-08-07 14:44:54 +08:00
Concedo 28e98198db handle race condition for image preview 2026-08-07 10:21:20 +08:00
Concedo 61bfce83de fix some issues with the preview image: Preview generation is disabled by default and only done when requested
Cleared stale generation state at job start/end.
Fixed the animated preview GIF buffer leak.
2026-08-07 00:19:39 +08:00
Wagner Bruna e3cb5e9e44 sd: support for the /sdapi/v1/progress endpoint (#2316)
Co-authored-by: LostRuins Concedo <39025047+LostRuins@users.noreply.github.com>
2026-08-06 23:52:31 +08:00
Concedo 910ab962eb load lora at runtime, to solve eager/lazy loading bug 2026-08-06 23:43:49 +08:00
Wagner Bruna 0ddb9190c8 sd: sync with master-812-ea7f0c8 (#2371)
* sd: sync with master-801-9cfe2af

* sd: sync with master-802-e92e86f

* sd: sync with master-805-e31a86c

* sd: sync with master-810-db99efd

* sd: sync with master-812-ea7f0c8

* sd: minimax-h3 support
2026-08-06 23:42:23 +08:00
Concedo 7a69646196 qwen3tts support languages 2026-07-27 22:45:04 +08:00
Concedo 133411c3fd fixed incorrect line removal 2026-07-25 19:06:56 +08:00
Wagner Bruna fd44ba2c61 sd: sync with master-795-87a0177 (#2338)
* sd: sync with master-782-b290693

* sd: sync with master-788-8a51eb9

* sd: sync with master-789-5114672

* sd: sync with master-795-87a0177

* sd: expose ref_image_args and make it trigger edit mode
2026-07-25 19:04:50 +08:00
Concedo 49dbdaaab5 Merge branch 'upstream' into concedo_experimental
# Conflicts:
#	AGENTS.md
#	CODEOWNERS
#	CONTRIBUTING.md
#	docs/backend/OPENCL.md
#	docs/development/HOWTO-add-model.md
#	examples/training/finetune.cpp
#	ggml/src/ggml-hexagon/ggml-hexagon.cpp
#	ggml/src/ggml-hexagon/htp-drv.cpp
#	ggml/src/ggml-hexagon/htp/act-ops.c
#	ggml/src/ggml-hexagon/htp/dma-queue.c
#	ggml/src/ggml-hexagon/htp/dma-queue.h
#	ggml/src/ggml-hexagon/htp/flash-attn-ops.c
#	ggml/src/ggml-hexagon/htp/flash-attn-ops.h
#	ggml/src/ggml-hexagon/htp/hmx-mm-kernels-tiled.h
#	ggml/src/ggml-hexagon/htp/htp-ctx.h
#	ggml/src/ggml-hexagon/htp/htp-ops.h
#	ggml/src/ggml-hexagon/htp/htp-tensor.c
#	ggml/src/ggml-hexagon/htp/htp-tensor.h
#	ggml/src/ggml-hexagon/htp/hvx-fa-kernels.h
#	ggml/src/ggml-hexagon/htp/hvx-reduce.h
#	ggml/src/ggml-hexagon/htp/main.c
#	ggml/src/ggml-hexagon/htp/matmul-ops.c
#	ggml/src/ggml-hexagon/htp/matmul-ops.h
#	ggml/src/ggml-hexagon/htp/unary-ops.c
#	ggml/src/ggml-hexagon/htp/unary-ops.h
#	ggml/src/ggml-opencl/CMakeLists.txt
#	ggml/src/ggml-opencl/ggml-opencl.cpp
#	scripts/compare-llama-bench.py
#	scripts/snapdragon/ggml-hexagon-profile.py
#	scripts/snapdragon/ggml-hexagon-trace.py
#	scripts/sync_vendor.py
#	tests/test-arg-parser.cpp
#	tests/test-chat.cpp
#	tests/test-model-load-cancel.cpp
#	tests/test-quantize-stats.cpp
#	tools/cli/README.md
#	tools/completion/README.md
#	tools/llama-bench/llama-bench.cpp
#	tools/server/README.md
#	tools/ui/src/lib/constants/settings-registry.ts
2026-07-25 12:20:51 +08:00
Concedo 68db0dda84 fixed a qwen image edit regression from https://github.com/LostRuins/koboldcpp/pull/2251 2026-07-21 22:20:48 +08:00
Concedo d7ca5a4d01 use u8 helper 2026-07-19 17:32:43 +08:00
Wagner Bruna 1f9dd9c398 sd: sync with master-775-b5d8120 (#2321)
* sd: expose extra_sample_args parameter

* sd: sync with master-773-1b04283

* sd: sync with master-775-b5d8120
2026-07-13 20:42:22 +08:00
Concedo d067fc6d28 fixed kcpp sdcpp file location 2026-07-13 20:40:48 +08:00
Concedo 75ada7102f exclude z-image from reference image list 2026-07-13 20:32:58 +08:00
Concedo b368c874e9 fixed int8 convrot loading 2026-07-13 18:39:32 +08:00
Concedo 60f0e18cb0 added int8 convrot support 2026-07-12 21:43:36 +08:00
Concedo 70a9d58fff fixed sefi loading 2026-07-12 14:25:14 +08:00
Concedo 062a2d0bd3 added support for qwen3tts aliases, replaces https://github.com/LostRuins/koboldcpp/pull/2315 2026-07-12 11:49:33 +08:00
Wagner Bruna c43c27c838 sd: cancel image generation on client disconnect (#2318) 2026-07-11 12:28:04 +08:00
Wagner Bruna e11d3ddef0 sd: sync with master-767-885f01a (#2310)
* sd: minor API path handling cleanup

* sd: sync with master-749-b11c95a

* sd: use original API parameters at the internal C++ API

* sd: split_mode and auto_fit backend support

* sd: sync with master-758-c674225

* sd: sync with master-765-bb84971

* sd: sync with master-767-885f01a
2026-07-08 17:08:19 +08:00
Concedo fd38fec594 save lora info when generating image 2026-07-03 17:32:48 +08:00
Wagner Bruna 6482a596e1 sd: sync with master-746-2574f59 (#2291)
* sd: clean up SD_USE_ defines

* sd: sync with master-721-8caa3f9+5 (9956436)

* sd: simplify taehv selection

* sd: sync with master-731-9f855c9

* sd: sync with master-737-3b6c9ca

* sd: sync with master-741-484baa4

* sd: sync with master-743-3590aa8

* sd: sync with master-746-2574f59

* sd: fix ggml_ext_pad_ext call
2026-07-03 15:28:51 +08:00
Concedo 40e4459147 load sd weights eagerly 2026-06-25 14:22:04 +08:00