Commit Graph

329 Commits

Author SHA1 Message Date
Disty0 e1ac9650b7 Make SDNQ Triton kernels trigger way less tuning and fix accuracy issues on SDNQ Atten 2026-07-01 17:31:57 +03:00
Disty0 f0ef201882 cleanup 2026-06-28 22:16:53 +03:00
Disty0 693639a7d3 SDNQ atten fix enable_gqa + is_causal 2026-06-28 22:07:37 +03:00
Disty0 e89f1a1fe8 SDNQ add causal atten support 2026-06-28 20:08:40 +03:00
Disty0 2622291de7 SDNQ Atten Fix FP16 PV 2026-06-27 15:39:58 +03:00
Disty0 7c5238bf41 fix shapes 2026-06-27 01:56:50 +03:00
Disty0 66116ad1a5 cleanup 2026-06-27 01:43:59 +03:00
Disty0 13c1bcff3f cleanup 2026-06-27 01:40:11 +03:00
Disty0 b92ccf4adf Make triton atten and mm require less tuning 2026-06-27 01:15:09 +03:00
Disty0 db43551ab6 use tl.exp2 instead of tl.math.exp2 2026-06-25 19:19:34 +03:00
Disty0 a0752f527b SDNQ Atten fix shape mismatches 2026-06-25 04:13:09 +03:00
Disty0 426a06d916 fix fp16 pv nans 2026-06-24 19:56:05 +03:00
Disty0 fba98cbf71 add stage 4 2026-06-24 18:17:07 +03:00
Disty0 8029156fa2 SDNQ Atten use simple row-wise quant instead 2026-06-24 17:59:38 +03:00
Disty0 2c44dca2be reduce warp range 2026-06-24 13:23:00 +03:00
Disty0 e7f11ed772 cleanup 2026-06-23 20:44:37 +03:00
Disty0 0af57a0af1 And no quant atten 2026-06-23 20:41:19 +03:00
Vladimir Mandic 81437ff051 cleanup seedvr
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-06-23 13:55:47 +02:00
Disty0 72a4d2c2bd Add Hadamard support to SDNQ Atten 2026-06-23 14:17:34 +03:00
Disty0 dfa713e6fc Add SDNQ attention 2026-06-23 08:10:02 +03:00
Disty0 2c7924ad3e SDNQ set NPU as the default for CPU + OpenVINO 2026-06-21 03:37:02 +03:00
Disty0 3cda283bd4 assume fp16 instead 2026-06-20 23:06:25 +03:00
Disty0 6e13c74e3b SDNQ add fp_mm_torch for non CUDA 2026-06-20 22:55:27 +03:00
Disty0 d2d0efbc48 SDQN add OpenVINO FP16 MM and add update_torch_dtype to SDNQQuantizer 2026-06-20 21:41:34 +03:00
Disty0 440aa0d105 typing 2026-06-19 03:28:09 +03:00
Disty0 bd3eac047f SDNQ fix NPU accuracy 2026-06-19 02:59:21 +03:00
Disty0 7d14e814bd SDNQ revert NPU default 2026-06-19 01:55:06 +03:00
Disty0 38820cbbd9 SDNQ add NPU support and default to NPU on CPUs with OpenVINO 2026-06-19 00:12:22 +03:00
Disty0 8a9f5c0761 sdnq fix use_contiguous_mm check with openvino 2026-06-18 20:03:47 +03:00
Disty0 5244f63554 SDNQ add OpenVINO MM for CPUs 2026-06-18 18:15:57 +03:00
Disty0 4b89d65639 Remove CPU from use_contiguous_mm 2026-06-17 22:10:50 +03:00
Disty0 8214b044e3 SDNQ show a warining for no Triton instead and stop overriding matmul to false 2026-06-17 02:17:21 +03:00
Disty0 d227a46406 SDNQ handle hf_quantizer and modules_to_not_use_matmul in loader 2026-06-15 22:04:43 +03:00
Disty0 e5a15ab6e1 Update SDNQConfig docstring 2026-06-15 19:39:03 +03:00
Vladimir Mandic 5aea60ab71 lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-06-15 12:06:43 +02:00
Disty0 c8458ae0af SDNQ fix conv1d 2026-06-14 19:25:22 +03:00
Disty0 099b4e4214 SDNQ fix Diffusers API change breaking Transformers 2026-06-13 03:03:14 +03:00
Disty0 55f811e837 SDNQ add N4 Hadamard and set Hadamard Group Size to 256 2026-06-13 00:56:50 +03:00
Disty0 d1ed1f7c93 SDNQ add Ideogram4Transformer2DModel keys 2026-06-10 03:20:57 +03:00
Vladimir Mandic fefa1f210d fix sdnq svd
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-06-08 10:12:17 +02:00
Disty0 f0c93defb8 SDNQ add RuntimeError for post-load quantizing a pre-quant 2026-06-07 17:51:48 +03:00
Disty0 809f24aa13 Remove unset_config_on_save 2026-06-07 17:28:17 +03:00
Disty0 1247f871d3 SDNQ fix quantization_config being lost on pre-quants 2026-06-07 17:02:08 +03:00
Disty0 e5249c7a4b Cleanup SDNQ 2026-06-07 16:14:52 +03:00
Vladimir Mandic 1f24513507 optimize sdnq quant-on-load and add platform stats
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-06-07 11:43:46 +02:00
Vladimir Mandic 5e99dee3c2 full codespell coverage
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-06-04 12:36:10 +02:00
Vladimir Mandic 2af67b76d0 lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-06-02 17:13:08 +02:00
Vladimir Mandic 113d4efae8 add lens img2img and inpaint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-05-25 10:40:20 +02:00
Vladimir Mandic d5650184fc add str to sdnqconfig
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2026-05-25 10:40:20 +02:00
Disty0 1377495998 lint 2026-05-22 18:21:22 +03:00