103 Commits

Author SHA1 Message Date
Vladimir Mandic 3f69bee9dd refactor modular
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-08-12 14:24:09 +02:00
Vladimir Mandic 5409df20a8 cleanup lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-07-15 20:30:27 +02:00
Vladimir Mandic 7214ee9d42 triton/dynamo/inductor cache location and timer stats
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-07-15 15:06:40 +02:00
Vladimir Mandic fcee7e23f2 add experimental pruna
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-07-02 11:25:33 +02:00
Vladimir Mandic 4b2f38ab7f complete refactor javascript to typescript and reorg frontend files and folders
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-05-20 18:08:10 +02:00
Vladimir Mandic 632032308d add pruna placeholders
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-05-16 09:18:39 +02:00
Vladimir Mandic e368472cbb add scale_noise and improve set_timesteps to multiple schedulers
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-05-13 09:46:39 +02:00
Vladimir Mandic 02a403eba9 fix torch.compile
Co-authored-by: Copilot <copilot@github.com>
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-05-10 08:55:44 +02:00
vladmandic 8070e51777 openvino backend
Signed-off-by: vladmandic <mandic00@live.com>
2026-04-12 19:07:20 +02:00
vladmandic 939eea1cd9 merge: modules/sd_models_compile.py 2026-03-12 14:16:51 +01:00
Vladimir Mandic 216558185b update installer usage 2026-02-19 12:21:46 +01:00
Vladimir Mandic e5c494f999 cleanup logger 2026-02-19 11:09:13 +01:00
Vladimir Mandic a3074baf8b unified logger 2026-02-19 09:46:42 +01:00
Vladimir Mandic bfe014f5da modernize typing 2026-02-19 09:15:37 +01:00
Disty0 5d01cb5c2c Unify compile Upscaler compile command 2025-09-03 18:51:21 +03:00
Vladimir Mandic 287c3600d7 torch compile for llm
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 12:07:30 -04:00
Vladimir Mandic 27ce0dea9a torch.compile use repeated blocks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 08:44:25 -04:00
Disty0 1acbabb276 Upate OpenVINO to PyTorch 2.6 and fix mismatched shapes error on too many resolution changes 2025-02-09 01:17:06 +03:00
Disty0 62e1826faf OpenVINO safety check for compiled_model_state 2025-01-31 18:35:36 +03:00
Vladimir Mandic d0d9759840 compile traceback
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-31 09:11:11 -05:00
Vladimir Mandic 06ba03cf80 settings option to disable reference models
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-23 15:19:43 -05:00
Disty0 9b579bfd96 Move quant functions to model_quant.py 2025-01-23 21:50:26 +03:00
Vladimir Mandic 935cac62a8 lint fixes
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-31 12:28:53 -05:00
Disty0 1998997189 OpenVINO fix shapes resolution change and disable re-compile 2024-12-31 17:45:23 +03:00
Vladimir Mandic ed3e5f06d6 linting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-20 18:48:06 -05:00
Disty0 468c7d6bc8 Use apply_compile_model with torchao 2024-12-17 22:24:25 +03:00
Vladimir Mandic fd7fe8cea5 add torchao
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-17 13:29:36 -05:00
Vladimir Mandic 164ce252dc add sd35 controlnets
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-28 08:46:10 -05:00
Vladimir Mandic ae4591ac0b reimplement torchao quantization
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-18 09:34:04 -04:00
Vladimir Mandic 6bb688c371 add set_accelerate
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-14 13:57:05 -04:00
Vladimir Mandic ea0dfebe2d better handle any quant lib requirements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-12 13:36:16 -04:00
Disty0 012a7f3572 Update OpenVINO to 2024.3.0 2024-09-13 03:57:06 +03:00
Vladimir Mandic f2c5cbbb36 lint updates and diffusers installer 2024-09-06 14:10:53 -04:00
Vladimir Mandic 85b26e03ff minor updates 2024-09-06 10:13:32 -04:00
Vladimir Mandic 5ed58ac7cc end-to-end update flux, see changelog and wiki 2024-08-28 08:04:24 -04:00
Disty0 963940b9ae Fix no half vae 2024-08-21 22:45:02 +03:00
Disty0 b706083541 Quanto Activations fix Diffuser's model offload bug 2024-08-21 20:48:32 +03:00
Disty0 e40e13a330 Quanto fix Flux activations 2024-08-21 20:04:05 +03:00
Disty0 c3ff21c15e Quanto freeze the model before calibration 2024-08-21 19:18:57 +03:00
Disty0 694d25c161 Fix quanto 2024-08-21 19:17:04 +03:00
Disty0 16d6c03d45 Optimum Quanto activations support 2024-08-21 17:30:45 +03:00
Disty0 3f5c3ba0d8 Add warning to Quanto with balanced and sequential offload 2024-08-16 02:58:43 +03:00
Disty0 f3f721e39a Quanto disable gemm kernels 2024-08-14 20:26:46 +03:00
Disty0 e3b087b6c0 Add balanced offload mode and make offload modes a single choice list 2024-08-11 17:27:30 +03:00
Disty0 7eacec4c39 Quant send to gpu with shuffle option on high vram systems 2024-08-04 23:01:58 +03:00
Disty0 dc9e60aa67 Quant add shuffle models option 2024-08-04 04:46:06 +03:00
Disty0 bb707e4509 FLUX support 2024-08-02 18:22:06 +03:00
Disty0 9965ef75e7 De-dupe Cascade 2024-08-01 18:12:02 +03:00
Disty0 b50a8601fe Fix T5 INT8 and add QINT8 2024-07-30 18:23:21 +03:00
Disty0 6c75bcca0a Optimum Quanto support 2024-07-30 17:35:56 +03:00