Vladimir Mandic
068f63badc
add model parallel load option
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-13 21:18:57 -04:00
Vladimir Mandic
706bc9e2e7
cleanup
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-13 20:55:26 -04:00
Vladimir Mandic
ff2c03538d
add mtime to reference models
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-13 20:53:39 -04:00
Vladimir Mandic
5cd88e93ed
Merge pull request #4115 from CalamitousFelicitousness/patch-1
...
LoRA load Torch tuple and string version checking
2025-08-13 20:25:43 -04:00
Vladimir Mandic
114d097bb4
add wildcards to networks ui
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-13 20:23:35 -04:00
CalamitousFelicitousness
70672d3267
Move tuple/string versioning fix for BnB to loader.py
2025-08-14 00:31:10 +01:00
CalamitousFelicitousness
afe900537d
Revert lora_load.py commit
2025-08-14 00:25:56 +01:00
CalamitousFelicitousness
6123655ac2
LoRA load Torch tuple and string version checking
...
Due to BitsandBytes trying to use tuple and comparison to check Torch version which is given as a string, using LoRA with a quantized model results in a TypeError. This commit adds support for both.
2025-08-13 23:39:18 +01:00
Vladimir Mandic
e30e8cbf4f
fix loading custom transformer safetensors
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-13 16:27:52 -04:00
Vladimir Mandic
41ae06bd90
fix loading custom t5
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-13 16:06:25 -04:00
Disty0
8ca74d0cd2
SDNQ rename unused param_name arg to op
2025-08-13 22:10:30 +03:00
Vladimir Mandic
4d95cf47ce
restore default sampler on mismatch
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-13 14:49:11 -04:00
Vladimir Mandic
867c5abc5c
add qwen img2img and inpaint
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-13 14:35:06 -04:00
Vladimir Mandic
e8002df534
generate api endpoints allow set model
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-13 13:49:23 -04:00
Vladimir Mandic
562799314d
change default hfcache folder
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-13 13:04:14 -04:00
Vladimir Mandic
8e9244939b
calc folder size
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-13 12:23:29 -04:00
Disty0
cb0c5414a3
SDNQ use uint with minimum_bits <= 4
2025-08-13 00:37:44 +03:00
Disty0
7085db9add
Update changelog
2025-08-13 00:17:15 +03:00
Disty0
15cb8fe9f8
SDNQ add modules_dtype_dict and fix Qwen Image with quants less than 5 bits
2025-08-13 00:07:36 +03:00
Vladimir Mandic
a52316b24c
fix flex.2
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-12 15:55:43 -04:00
Vladimir Mandic
863e172aad
add Qwen/Qwen2.5-VL-3B-Instruct
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-12 15:09:08 -04:00
Vladimir Mandic
2aa917b58e
add /sdapi/v1/modules endpoint
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-12 15:09:08 -04:00
Vladimir Mandic
a36676a5a9
cleanup lora api
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-12 08:49:38 -04:00
Vladimir Mandic
669f9874a0
increase ui default timeouts
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-12 08:19:22 -04:00
Vladimir Mandic
6312b3d0ac
add Qwen3-4B-Instruct-2507 llm and Flash-FlowMatch scheduler
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-11 16:35:16 -04:00
Disty0
9992338187
sdnq fix convs
2025-08-11 23:24:13 +03:00
Disty0
26461f1d8d
fix conv in8 matmul
2025-08-11 23:15:30 +03:00
Vladimir Mandic
87bd347116
cleanup flux loader
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-11 16:05:39 -04:00
Vladimir Mandic
dc8a72947d
fix meissonic
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-11 16:05:39 -04:00
Vladimir Mandic
e42a27a0e4
fix chroma
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-11 16:05:39 -04:00
Vladimir Mandic
a181c18123
fix omnigen
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-11 16:05:39 -04:00
Vladimir Mandic
d7daefb8ac
update cogview links, fix auraflow and hidream loaders
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-11 16:05:39 -04:00
Vladimir Mandic
2a85c05689
refactor pipeline loaders to generic methods and introduce te_shared_t5 option
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-11 16:05:39 -04:00
Disty0
f45e3342e6
Cleanup
2025-08-11 15:11:29 +03:00
Disty0
afb3a5a06d
SDNQ move non_blocking to quant config
2025-08-11 15:07:02 +03:00
Disty0
dc7b25d387
Cleanup SDNQ and add SDNQ_USE_TENSORWISE_FP8_MATMUL env var
2025-08-11 14:50:17 +03:00
Vladimir Mandic
abddac23d9
add qwen-lightning
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-10 15:40:15 -04:00
Disty0
3f45c4e570
Cleanup SDNQ and skip transpose on packed int8 matmul
2025-08-10 19:31:34 +03:00
Vladimir Mandic
3e0fee01f9
cleanup
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-10 11:06:37 -04:00
Vladimir Mandic
752d636324
add /sdapi/v1/network
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-10 10:53:28 -04:00
Vladimir Mandic
41640773e5
fix global state tracking
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-10 09:19:49 -04:00
Vladimir Mandic
e5637c3e8d
add pag to namegen
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-10 07:58:25 -04:00
Vladimir Mandic
73049f7bb8
add load-checkpoint api endpoint and test all models script
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-09 14:06:54 -04:00
Vladimir Mandic
44a20a47c1
update todo
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-09 12:15:36 -04:00
Vladimir Mandic
338129b7c1
calculate vae-scale-factor and use everywhere
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-09 11:31:13 -04:00
Vladimir Mandic
2efadd2630
add numpy error handler to loader
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-09 10:14:35 -04:00
Vladimir Mandic
db6eb07230
update requirements and handle NEP50
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-09 10:03:11 -04:00
Vladimir Mandic
45d5189b83
add privacy blur for tokens in ui
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-09 09:03:02 -04:00
Disty0
69db77e365
SDNQ remove eps
2025-08-09 02:39:01 +03:00
Disty0
22d86acda3
Make SDNQ MatMul listen to the dequantize fp32 setting
2025-08-09 01:10:07 +03:00