28bd5e8d74
fix(lora): materialize balanced-offload modules before touching weights
...
Under a pressed balanced offload, dispatched modules hold meta tensors
whose data lives in the accelerate offload map. The factor path raised
trying to move a meta svd tensor and aborted activation mid-pass; the
legacy requantize path silently skipped those layers. Both left the
model with a partially applied network.
Rebuild the offload state with apply_balanced_offload(force) at
activate and deactivate entry: modules come back real on cpu with
hooks intact and the execution device unchanged, so both paths see
usable tensors and the next forward re-onloads under the watermark.
2026-08-10 02:42:28 +01:00
5b694d3300
fix(lora): default dyn_dim to none when caller omits dyn_dims
...
network_load seeded net.dyn_dim with extra_networks_default_multiplier
when no dyn_dims list was passed, so a float multiplier landed where
consumers expect a rank and slice with it. The prompt path always builds
a per-network list of ints or None, which is why the crash never fired
from the UI; any direct network_load caller hits it in both
rebuild_conventional and the sdnq factor path.
2026-08-10 02:42:05 +01:00
4c85a60c3e
perf(lora): skip the discarded init when building lora modules
...
create_module built each up/down module with the default constructor,
which kaiming-initializes the parameter, then copied the stored weight
over the whole thing. The init is thrown away every time and costs about
four times the copy: 22.1ms per module against 2.5ms, or 5.8s against
0.7s over a 264-module lora, on every load.
skip_init constructs on meta and materializes uninitialized, so the copy
still fully defines the parameter. Dtype, device and values are
unchanged, including the fp32 upcast of bf16 files that the copy performs.
2026-08-10 02:42:05 +01:00
562be970ae
reorder env vars
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-10 00:43:15 +02:00
ca955ba1c2
update handlers for all authenticated workflows
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-09 22:47:17 +02:00
a882ce945b
detailer.next
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-09 15:05:00 +02:00
33416f6f82
Accept SDNQConfig in post load quant
2026-08-09 15:58:01 +03:00
ab9a8151e6
handle rocm version checks with rocm 7.14
2026-08-08 19:59:20 +03:00
e10ec40e2c
detailer enable vl models
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-08 16:24:00 +02:00
44eebcd19b
update submodules
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-07 19:06:01 +02:00
d77bb29bc1
Merge pull request #5010 from vladmandic/master
...
dev update
2026-08-07 18:50:54 +02:00
22a119ffbf
pre-merge update
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-07 18:43:42 +02:00
48cf0166f3
separate progress monitoring from live preview, live preview improvements, progress details
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-07 11:41:40 +02:00
b092cf7318
unauthenticated path traversal in /thumbs
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-06 18:45:06 +02:00
0b64c4f981
update changelog
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-06 18:34:37 +02:00
08b2729c22
AMD takes forever to compile with num_stages > 1
2026-08-06 15:20:14 +03:00
5d71061946
Merge pull request #5007 from liutyi/dev
...
Microsoft Mage 4B reference images
2026-08-06 13:38:42 +02:00
d00e64e0be
Microsoft Mage 4B reference images
2026-08-06 11:29:33 +00:00
6e448de56c
switch to internally managed uvicorn
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-06 13:24:48 +02:00
0efd18aed5
skip sdnq openvino on non-cpu devices
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-05 20:10:51 +02:00
7fdaefda0b
aux prevent race condition
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-05 14:38:37 +02:00
c26149b80e
krea2 add inpaint and detailer support
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-05 13:07:24 +02:00
84905f77da
improve server monitor and profiling
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-05 12:19:07 +02:00
a1df374773
add support for nunchaku-lite models and engine
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-04 15:31:05 +02:00
9a7fa12218
SDNQ add minimum_allowed_channel_size
2026-08-04 15:46:38 +03:00
a83795273e
prompt enhance and caption use llm-context
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-04 14:21:53 +02:00
808a25749f
update sefi model and add rl variant
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-04 12:40:55 +02:00
beacd02487
cleanup
2026-08-04 13:09:07 +03:00
c55a1f1e11
lazy init ov_core
2026-08-04 13:01:11 +03:00
55ba386941
torch reset dynamo cache on model reload
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-04 10:58:32 +02:00
b76ec32ac0
cleanup
2026-08-04 11:18:54 +03:00
89d2bef078
Add device checks on kernel_wrappers and support OpenVINO MM for CPU and Triton MM for GPU at the same time
2026-08-04 11:16:53 +03:00
514a68b1af
add storage analyzer
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-02 11:22:12 +02:00
78f843f969
networks avoid slow yield
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-01 09:10:15 +02:00
37dfedb8ff
update changelog
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-31 15:20:45 +02:00
81ea0a835a
test flag also test linked previews
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-31 15:20:45 +02:00
b96456bb2c
add sefi-image model
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-31 15:20:45 +02:00
2b442bfabb
add mage-flow
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-31 15:20:45 +02:00
e532958ad4
cleanup openvino mm
2026-07-31 08:44:45 +03:00
59f077604c
rembg add lucida
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-30 14:39:30 +02:00
1b1f6c5863
Update SDNQ and Diffusers to support SDNQ in native upstream Diffusers
2026-07-30 11:24:27 +03:00
6941122a96
update packages
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-29 08:57:52 +02:00
9056b88f69
fix select network checkpoint
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-29 08:13:45 +02:00
c6dc750a81
remove resolution from some reference models
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-28 14:18:55 +02:00
e280938e79
add prompt enhance to ltx and fix audio
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-28 13:11:21 +02:00
7a6fa28484
prompt enhance video support
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-28 12:27:40 +02:00
6f79aae7d2
modernui update
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-28 11:10:29 +02:00
9dec85040e
video: support for scripts/extensions
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-28 10:43:58 +02:00
fcbef8f55a
cleanup
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-27 21:30:40 +02:00
456306eb06
fix wildcards again
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-07-27 20:33:51 +02:00
CalamitousFelicitousness
Vladimir Mandic
Dity0
Oleksandr Liutyi