Commit Graph

7326 Commits

Author SHA1 Message Date
Disty0 25303bb182 cleanup 2025-10-08 01:16:25 +03:00
Disty0 bdcd07f713 Add add_module_skip_keys to pre-load quant too 2025-10-08 01:11:40 +03:00
Disty0 7fdf400e8b cleanup 2025-10-08 00:41:04 +03:00
Disty0 df03ea9ba8 SDNQ add sdnq_post_load_quant and update Qwen keys 2025-10-08 00:29:36 +03:00
Vladimir Mandic 962cb7115d infra for full-model load/save with quant
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-07 14:30:45 -04:00
Vladimir Mandic e4120bd4d6 detect sdnq saved model
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-07 10:57:17 -04:00
Vladimir Mandic 0092a8b86b add quantization_config for post-load
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-07 10:14:31 -04:00
Vladimir Mandic 7fdc880a73 sdnq patches
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-07 09:43:34 -04:00
Vladimir Mandic 25e28050c3 update swagger docs
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-07 08:21:05 -04:00
Vladimir Mandic fe41d7da2a use shared llama
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-07 08:14:11 -04:00
Vladimir Mandic 3fe1d090e4 add configurable layers to taehv
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-06 19:13:30 -04:00
Disty0 1cd7b6d63a fix upcast scale check 2025-10-07 01:27:54 +03:00
Disty0 aa0c10440f SDNQ make the loader don't touch the model options by default 2025-10-07 00:15:23 +03:00
Disty0 5306376b2a improve contiguous mm performance 2025-10-06 19:05:46 +03:00
Disty0 be91bbff75 SDNQ add SVD support for Convs 2025-10-06 18:26:42 +03:00
Disty0 c931bf9efa SDNQ add dtype casting to loader 2025-10-06 17:44:52 +03:00
Disty0 5c042c5fb8 cleanup 2025-10-06 11:30:26 +03:00
Vladimir Mandic a315a004e9 linting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-05 20:25:33 -04:00
Vladimir Mandic 28e3ae0480 experimental xomni
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-05 20:17:32 -04:00
Vladimir Mandic 3e47f3dd9a video prompt enhance
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-05 20:17:32 -04:00
Vladimir Mandic 58b0ab9da6 unified video save
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-05 20:17:32 -04:00
Vladimir Mandic d7d86ed286 ltx job tracking
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-05 20:17:32 -04:00
Vladimir Mandic 7dad90b385 video use shared t5
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-05 20:17:32 -04:00
Vladimir Mandic 50c3385cf9 fix ltx model selection
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-05 20:17:32 -04:00
Disty0 23f2deaa58 fix enable_quantized_mamtul 2025-10-06 02:04:28 +03:00
Disty0 1f81a37e8e Set the default svd rank to 32 2025-10-06 01:27:29 +03:00
Disty0 ebb26ac123 SDNQ make load file name configurable 2025-10-06 01:04:00 +03:00
Disty0 0acb571472 SDNQ ass load and save model funcs 2025-10-06 00:57:23 +03:00
Disty0 9e52d0c1fb SDNQ add SVDQuant quantization method 2025-10-05 22:50:30 +03:00
Vladimir Mandic 268798a24e add framepack granular job tracking
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-05 10:39:55 -04:00
Disty0 428600613a SDNQ fix new transformers again 2025-10-05 15:30:15 +03:00
Disty0 a164f3e0c2 SDNQ Improve UINT3 and below quant speed 2025-10-05 03:12:05 +03:00
Vladimir Mandic 8325e886c7 add typo to legacy compatibility options
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-04 18:11:52 -04:00
Vladimir Mandic c530167cbe qwen multi-image edits
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-04 18:06:50 -04:00
Vladimir Mandic 8b698ed67f upadte qwen pruning and allow hf models in subfolders
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-04 15:49:20 -04:00
Disty0 f2e12a682f SDNQ remove use_contiguous_mm path in re_quant 2025-10-04 19:17:05 +03:00
Disty0 df142afe81 don't use triton mm for nvidia 2025-10-04 18:48:03 +03:00
Disty0 5c5d7d5a86 cleanup 2025-10-04 18:38:18 +03:00
Disty0 99113947bf SDNQ add RDNA2 INT8 support via Triton 2025-10-04 18:31:25 +03:00
Vladimir Mandic 54ae18a611 update nunchaku
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-03 12:23:24 -04:00
Disty0 95a7da7e75 SDNQ use non-contiguous re-quantize 2025-10-03 18:54:58 +03:00
Vladimir Mandic a6108dd6df add qwen pruning variants
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-03 11:36:14 -04:00
Disty0 54acf1760b Make SDNQ scales compatible with balanced offload 2025-10-03 18:13:55 +03:00
Disty0 c5cab96223 SDNQ simplify check_mats 2025-10-03 02:58:17 +03:00
Vladimir Mandic 7325f9dbae dont import guiders until needed
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-02 16:28:34 -04:00
Disty0 34c2a624aa SDNQ autodetect fp8 tw fallback and disable dynamic compile 2025-10-02 19:40:07 +03:00
Vladimir Mandic f245506bf2 cleanup hf login
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-02 08:17:35 -04:00
CalamitousFelicitousness 78711fb1d4 Merge branch 'dev' into patch-2 2025-10-01 20:58:58 +01:00
CalamitousFelicitousness 78820a14dc Allow VLM temp setting temperature to 0
Allow VLM temp setting temperature to 0
2025-10-01 20:52:04 +01:00
Disty0 81bb2b99ef update florence promptgen repo ids 2025-10-01 21:43:02 +03:00