Commit Graph

6459 Commits

Author SHA1 Message Date
Disty0 3d8390de9b IPEX return devices.dtype instead of bf16 2025-05-18 04:44:51 +03:00
Disty0 d0e6f01286 IPEX remove GradScaler and use torch.amp instead 2025-05-18 04:39:48 +03:00
Disty0 a009e17d2b NNCF use per token input quantization with int8 matmul 2025-05-17 19:46:47 +03:00
Disty0 219970d47d Add Anisora 5B RL 2025-05-16 12:00:54 +03:00
Disty0 8487b5f263 Add Anisora 5B 2025-05-15 23:21:39 +03:00
Disty0 cf716e1c97 NNCF fix CogVideo 2025-05-15 22:51:35 +03:00
Vladimir Mandic c371ec91b4 fix nncf with controlnet
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-15 15:26:55 -04:00
Disty0 0ab28a6106 IPEX fix cogvideo 2025-05-15 22:08:50 +03:00
Vladimir Mandic 4157336238 rename vae
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-15 08:59:49 -04:00
Vladimir Mandic 39135c1d0a ui-defaults match correct prompt component
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-15 08:51:03 -04:00
Vladimir Mandic 5c0e3b635c update diffusers and lint/changelog/todo
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-14 13:30:52 -04:00
Seunghoon Lee 8330052d19 zluda 3.9.5 & torch 2.7.0 2025-05-14 13:22:26 +09:00
Disty0 18c10883b8 Move NNCF above in the settings list 2025-05-14 05:19:11 +03:00
Vladimir Mandic 8473bae0fc 1000 papercuts
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-13 21:51:33 -04:00
Disty0 115d81cc8c NNCF change zero_point formula and use torch.addcmul on decompress_asym 2025-05-14 00:58:33 +03:00
Disty0 361e952a64 Cleanup 2025-05-14 00:14:24 +03:00
Vladimir Mandic f07c2e6117 nncf-lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-13 12:35:33 -04:00
Vladimir Mandic bfda37903c update nncf linting and changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-13 12:11:10 -04:00
Disty0 4e4557d81c NNCF set min matmul shape to 32 2025-05-13 18:50:23 +03:00
Disty0 b9ad55857d NNCF INT8 MatMul don't force FP32 with FP16 scales 2025-05-13 05:08:22 +03:00
Disty0 129c701b3d NNCF use torch.compile directly on int8_matmul instead of sub functions 2025-05-13 04:28:37 +03:00
Disty0 f1eefe97a4 NNCF use inplace ops 2025-05-13 03:49:30 +03:00
Vladimir Mandic 47862fef08 prompt enhance nsfw allow/disallow
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-12 20:33:16 -04:00
Disty0 98ccce68a1 Merge branch 'master' into master 2025-05-13 03:28:51 +03:00
chrismuzyn 299d189276 When using the openvino backend, do not look for an nvidia gpu. 2025-05-12 19:14:26 -04:00
Disty0 f4e3a81a84 NNCF experimental direct INT8 MatMul support 2025-05-12 21:41:49 +03:00
Vladimir Mandic 91080f349f latent-diffusion-upscale n-steps
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-12 11:12:36 -04:00
Vladimir Mandic a6e6c6ce5e support sdxl packaged without vae
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-11 14:49:27 -04:00
Disty0 4eedeab9f8 NNCF use group size instead of number of groups and set default group size for int4 to 64 2025-05-11 20:38:01 +03:00
Disty0 03d05b6243 NNCF fix very large number of groups 2025-05-11 18:43:19 +03:00
Disty0 9cfdc3c079 Remove NNCF device hijack 2025-05-11 18:30:10 +03:00
Disty0 0673689d5b NNCF set the default group size to 128 for INT4 2025-05-11 08:45:27 +03:00
Disty0 4af570bfd4 Cleanup 2025-05-11 08:10:13 +03:00
Disty0 8d27d34969 NNCF don't clip the zero_point 2025-05-11 07:57:51 +03:00
Disty0 98308fa187 NNCF fix group size calculation 2025-05-11 07:08:21 +03:00
Disty0 020e1aa374 Cleanup 2025-05-11 06:56:36 +03:00
Disty0 03a6d7f9bf NNCF add number of quantization groups 2025-05-11 05:55:58 +03:00
Vladimir Mandic 6036ff2105 modernui framepack and history tabs
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-10 10:21:37 -04:00
Vladimir Mandic aa04dd900a fix modernui disabled
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-10 08:53:30 -04:00
Vladimir Mandic f0d81ee1e0 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-10 08:28:19 -04:00
Seunghoon Lee 6d2b5fc37c Merge pull request #3921 from alexsarmiento/patch-1
Update fwd_prefill.py
2025-05-10 11:47:26 +09:00
Disty0 a1491a660c Cleanup 2025-05-09 23:36:50 +03:00
Disty0 1ee9832e05 NNCF silence the pytorch version warning 2025-05-09 23:16:55 +03:00
Disty0 b0e5a6c4df Add devices.has_triton() and enable NNCF compile if triton is available 2025-05-09 22:24:36 +03:00
AS 399a630778 Merge branch 'dev' into patch-1 2025-05-09 11:18:25 -07:00
Disty0 a4d4462e2a NNCF add decompress using toch.compile option 2025-05-09 21:02:24 +03:00
Seunghoon Lee 45c0bd6ec6 basic windows native pytorch support 2025-05-09 22:23:07 +09:00
Vladimir Mandic 51716bbaba update diffusers
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-09 09:04:21 -04:00
Vladimir Mandic 808462fdab update changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-09 08:18:40 -04:00
Seunghoon Lee a27abf7363 zluda fix old cards 2025-05-09 20:02:45 +09:00