Disty0
|
25303bb182
|
cleanup
|
2025-10-08 01:16:25 +03:00 |
|
Disty0
|
bdcd07f713
|
Add add_module_skip_keys to pre-load quant too
|
2025-10-08 01:11:40 +03:00 |
|
Disty0
|
7fdf400e8b
|
cleanup
|
2025-10-08 00:41:04 +03:00 |
|
Disty0
|
df03ea9ba8
|
SDNQ add sdnq_post_load_quant and update Qwen keys
|
2025-10-08 00:29:36 +03:00 |
|
Vladimir Mandic
|
962cb7115d
|
infra for full-model load/save with quant
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-07 14:30:45 -04:00 |
|
Vladimir Mandic
|
e4120bd4d6
|
detect sdnq saved model
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-07 10:57:17 -04:00 |
|
Vladimir Mandic
|
0092a8b86b
|
add quantization_config for post-load
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-07 10:14:31 -04:00 |
|
Vladimir Mandic
|
7fdc880a73
|
sdnq patches
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-07 09:43:34 -04:00 |
|
Vladimir Mandic
|
25e28050c3
|
update swagger docs
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-07 08:21:05 -04:00 |
|
Vladimir Mandic
|
fe41d7da2a
|
use shared llama
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-07 08:14:11 -04:00 |
|
Vladimir Mandic
|
3fe1d090e4
|
add configurable layers to taehv
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-06 19:13:30 -04:00 |
|
Disty0
|
1cd7b6d63a
|
fix upcast scale check
|
2025-10-07 01:27:54 +03:00 |
|
Disty0
|
aa0c10440f
|
SDNQ make the loader don't touch the model options by default
|
2025-10-07 00:15:23 +03:00 |
|
Disty0
|
5306376b2a
|
improve contiguous mm performance
|
2025-10-06 19:05:46 +03:00 |
|
Disty0
|
be91bbff75
|
SDNQ add SVD support for Convs
|
2025-10-06 18:26:42 +03:00 |
|
Disty0
|
c931bf9efa
|
SDNQ add dtype casting to loader
|
2025-10-06 17:44:52 +03:00 |
|
Disty0
|
5c042c5fb8
|
cleanup
|
2025-10-06 11:30:26 +03:00 |
|
Vladimir Mandic
|
a315a004e9
|
linting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-05 20:25:33 -04:00 |
|
Vladimir Mandic
|
28e3ae0480
|
experimental xomni
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-05 20:17:32 -04:00 |
|
Vladimir Mandic
|
3e47f3dd9a
|
video prompt enhance
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-05 20:17:32 -04:00 |
|
Vladimir Mandic
|
58b0ab9da6
|
unified video save
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-05 20:17:32 -04:00 |
|
Vladimir Mandic
|
d7d86ed286
|
ltx job tracking
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-05 20:17:32 -04:00 |
|
Vladimir Mandic
|
7dad90b385
|
video use shared t5
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-05 20:17:32 -04:00 |
|
Vladimir Mandic
|
50c3385cf9
|
fix ltx model selection
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-05 20:17:32 -04:00 |
|
Disty0
|
23f2deaa58
|
fix enable_quantized_mamtul
|
2025-10-06 02:04:28 +03:00 |
|
Disty0
|
1f81a37e8e
|
Set the default svd rank to 32
|
2025-10-06 01:27:29 +03:00 |
|
Disty0
|
ebb26ac123
|
SDNQ make load file name configurable
|
2025-10-06 01:04:00 +03:00 |
|
Disty0
|
0acb571472
|
SDNQ ass load and save model funcs
|
2025-10-06 00:57:23 +03:00 |
|
Disty0
|
9e52d0c1fb
|
SDNQ add SVDQuant quantization method
|
2025-10-05 22:50:30 +03:00 |
|
Vladimir Mandic
|
268798a24e
|
add framepack granular job tracking
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-05 10:39:55 -04:00 |
|
Disty0
|
428600613a
|
SDNQ fix new transformers again
|
2025-10-05 15:30:15 +03:00 |
|
Disty0
|
a164f3e0c2
|
SDNQ Improve UINT3 and below quant speed
|
2025-10-05 03:12:05 +03:00 |
|
Vladimir Mandic
|
8325e886c7
|
add typo to legacy compatibility options
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-04 18:11:52 -04:00 |
|
Vladimir Mandic
|
c530167cbe
|
qwen multi-image edits
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-04 18:06:50 -04:00 |
|
Vladimir Mandic
|
8b698ed67f
|
upadte qwen pruning and allow hf models in subfolders
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-04 15:49:20 -04:00 |
|
Disty0
|
f2e12a682f
|
SDNQ remove use_contiguous_mm path in re_quant
|
2025-10-04 19:17:05 +03:00 |
|
Disty0
|
df142afe81
|
don't use triton mm for nvidia
|
2025-10-04 18:48:03 +03:00 |
|
Disty0
|
5c5d7d5a86
|
cleanup
|
2025-10-04 18:38:18 +03:00 |
|
Disty0
|
99113947bf
|
SDNQ add RDNA2 INT8 support via Triton
|
2025-10-04 18:31:25 +03:00 |
|
Vladimir Mandic
|
54ae18a611
|
update nunchaku
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-03 12:23:24 -04:00 |
|
Disty0
|
95a7da7e75
|
SDNQ use non-contiguous re-quantize
|
2025-10-03 18:54:58 +03:00 |
|
Vladimir Mandic
|
a6108dd6df
|
add qwen pruning variants
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-03 11:36:14 -04:00 |
|
Disty0
|
54acf1760b
|
Make SDNQ scales compatible with balanced offload
|
2025-10-03 18:13:55 +03:00 |
|
Disty0
|
c5cab96223
|
SDNQ simplify check_mats
|
2025-10-03 02:58:17 +03:00 |
|
Vladimir Mandic
|
7325f9dbae
|
dont import guiders until needed
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-02 16:28:34 -04:00 |
|
Disty0
|
34c2a624aa
|
SDNQ autodetect fp8 tw fallback and disable dynamic compile
|
2025-10-02 19:40:07 +03:00 |
|
Vladimir Mandic
|
f245506bf2
|
cleanup hf login
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-02 08:17:35 -04:00 |
|
CalamitousFelicitousness
|
78711fb1d4
|
Merge branch 'dev' into patch-2
|
2025-10-01 20:58:58 +01:00 |
|
CalamitousFelicitousness
|
78820a14dc
|
Allow VLM temp setting temperature to 0
Allow VLM temp setting temperature to 0
|
2025-10-01 20:52:04 +01:00 |
|
Disty0
|
81bb2b99ef
|
update florence promptgen repo ids
|
2025-10-01 21:43:02 +03:00 |
|