 Disty0
|
a46f32b354
|
pull sdnq version from .common
|
2025-11-28 01:10:05 +03:00 |
|
|
Disty0
|
55cf627ac6
|
add version to sdnq
|
2025-11-28 00:45:24 +03:00 |
|
|
Disty0
|
df03ea9ba8
|
SDNQ add sdnq_post_load_quant and update Qwen keys
|
2025-10-08 00:29:36 +03:00 |
|
|
Disty0
|
0acb571472
|
SDNQ ass load and save model funcs
|
2025-10-06 00:57:23 +03:00 |
|
|
Disty0
|
9e52d0c1fb
|
SDNQ add SVDQuant quantization method
|
2025-10-05 22:50:30 +03:00 |
|
|
Disty0
|
428600613a
|
SDNQ fix new transformers again
|
2025-10-05 15:30:15 +03:00 |
|
|
Disty0
|
99113947bf
|
SDNQ add RDNA2 INT8 support via Triton
|
2025-10-04 18:31:25 +03:00 |
|
|
Disty0
|
95a7da7e75
|
SDNQ use non-contiguous re-quantize
|
2025-10-03 18:54:58 +03:00 |
|
|
Disty0
|
54acf1760b
|
Make SDNQ scales compatible with balanced offload
|
2025-10-03 18:13:55 +03:00 |
|
|
Disty0
|
c5cab96223
|
SDNQ simplify check_mats
|
2025-10-03 02:58:17 +03:00 |
|
|
Disty0
|
03382bdd4c
|
SDNQ simplify check_mats
|
2025-10-01 01:35:51 +03:00 |
|
|
Disty0
|
0c1d34721c
|
SDNQ use contiguous for intel
|
2025-09-30 02:37:58 +03:00 |
|
|
Disty0
|
6b67a9d0c4
|
SDNQ add check_mats to matmul
|
2025-09-30 01:58:13 +03:00 |
|
|
Disty0
|
503a178794
|
Don't load rocm hsa on non wsl envs and remove unused lib hijacks
|
2025-09-27 11:39:24 +03:00 |
|
|
Disty0
|
71fde8a897
|
ROCm and Zluda don't fallback to CPU and clenup strings
|
2025-09-27 11:32:46 +03:00 |
|
 Vladimir Mandic
|
ae25cb8880
|
linting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-09-25 14:33:21 -04:00 |
|
|
Disty0
|
a776c7c615
|
SDNQ fix new transformers
|
2025-09-24 21:32:30 +03:00 |
|
|
Disty0
|
41e297ba2c
|
SDNQ fix new transformers
|
2025-09-23 16:17:09 +03:00 |
|
|
Disty0
|
39027ccfea
|
SDNQ fix conv matmul
|
2025-09-16 17:12:04 +03:00 |
|
|
Disty0
|
a12edc1e90
|
SDNQ use nan_to_num_ with fp8 quantization in case of zeros
|
2025-09-15 20:22:39 +03:00 |
|
|
Vladimir Mandic
|
8cd5fbc926
|
lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-09-12 16:28:53 -04:00 |
|
|
Disty0
|
a8b850adf4
|
move hf quantizer hijacks to sdnq
|
2025-09-12 20:54:44 +03:00 |
|
|
Disty0
|
4f2b829450
|
cleanup
|
2025-09-11 15:42:36 +03:00 |
|
|
Disty0
|
9035f4299c
|
SDNQ fix new transformers
|
2025-08-30 22:44:57 +03:00 |
|
|
Disty0
|
a20ab65359
|
SDNQ override matmul group size with int8 as well
|
2025-08-29 22:54:38 +03:00 |
|
|
Disty0
|
a8de3f7282
|
SDNQ add quantized matmul support for all quantization types and group sizes
|
2025-08-29 22:26:47 +03:00 |
|
|
Disty0
|
36bf998302
|
cleanup
|
2025-08-29 18:15:28 +03:00 |
|
|
Disty0
|
6e68dff381
|
Fix AuraFlow quant
|
2025-08-29 18:13:53 +03:00 |
|
|
Disty0
|
f324b7c0e5
|
SDNQ remove unnecessary .contiguous()
|
2025-08-21 02:21:05 +03:00 |
|
|
Disty0
|
e49814098e
|
Add sdnq_modules_dtype_dict
|
2025-08-20 14:58:54 +03:00 |
|
|
Disty0
|
0946710662
|
Add sdnq_modules_to_not_convert to UI settings
|
2025-08-20 04:38:20 +03:00 |
|
|
Disty0
|
47ff01fd3b
|
SDNQ add "*" support and upcast only the first and last layer's img_mod to 6 bit with Qwen Image
|
2025-08-20 03:24:19 +03:00 |
|
|
Disty0
|
47154db8b1
|
SDNQ Flux lora, use shape from sdnq_dequantizer
|
2025-08-18 19:53:57 +03:00 |
|
|
Vladimir Mandic
|
fc547a3ccd
|
sdnq with diffusers lora loader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-08-18 10:29:01 -04:00 |
|
|
Disty0
|
85d494ee84
|
revert .t_().contiguous().t_()
|
2025-08-17 05:19:44 +03:00 |
|
|
Disty0
|
8460be662c
|
SDNQ use inplace transpose and use view instead of reshape
|
2025-08-17 05:07:55 +03:00 |
|
|
Disty0
|
8ca74d0cd2
|
SDNQ rename unused param_name arg to op
|
2025-08-13 22:10:30 +03:00 |
|
|
Disty0
|
cb0c5414a3
|
SDNQ use uint with minimum_bits <= 4
|
2025-08-13 00:37:44 +03:00 |
|
|
Disty0
|
7085db9add
|
Update changelog
|
2025-08-13 00:17:15 +03:00 |
|
|
Disty0
|
15cb8fe9f8
|
SDNQ add modules_dtype_dict and fix Qwen Image with quants less than 5 bits
|
2025-08-13 00:07:36 +03:00 |
|
|
Disty0
|
f45e3342e6
|
Cleanup
|
2025-08-11 15:11:29 +03:00 |
|
|
Disty0
|
afb3a5a06d
|
SDNQ move non_blocking to quant config
|
2025-08-11 15:07:02 +03:00 |
|
|
Disty0
|
3f45c4e570
|
Cleanup SDNQ and skip transpose on packed int8 matmul
|
2025-08-10 19:31:34 +03:00 |
|
|
Disty0
|
69db77e365
|
SDNQ remove eps
|
2025-08-09 02:39:01 +03:00 |
|
|
Disty0
|
aa0652caa9
|
SDNQ fix new transformers
|
2025-08-07 00:18:24 +03:00 |
|
|
Disty0
|
ab8badfe0d
|
SDNQ use non-blocking ops
|
2025-08-06 17:07:36 +03:00 |
|
|
Disty0
|
1d5dce1fb1
|
cleanup
|
2025-08-02 17:41:53 +03:00 |
|
|
Disty0
|
c3d007b02c
|
SDNQ split forward.py into layers and cleanup
|
2025-08-02 17:36:55 +03:00 |
|
|
Vladimir Mandic
|
fa44521ea3
|
offload-never and offload-always per-module and new highvram profile
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-07-31 11:40:24 -04:00 |
|
|
Disty0
|
30af1f8fb0
|
Use inference_context with SDNQ
|
2025-07-14 13:07:44 +03:00 |
|