10011 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Disty0	b4e615e760	SDNQ add FP8 row wise scaling workaround for SM89 on Windows	2025-05-30 00:16:54 +03:00
Disty0	54154cf698	Cleanup	2025-05-29 20:22:49 +03:00
Disty0	90324f9c8c	SDNQ fix lora with quant matmul	2025-05-29 18:25:12 +03:00
Disty0	df8b31fcfc	Don't downcast scale with fp8 matmul	2025-05-29 16:35:40 +03:00
Disty0	2351efb8f7	Remove redundant shape check	2025-05-29 14:58:00 +03:00
Disty0	14893b7617	Don't make the weights contiguous with int8 matmul	2025-05-29 03:43:57 +03:00
Disty0	cf2d1e56a6	Update changelog	2025-05-29 03:32:11 +03:00
Disty0	2cc5a58b0f	Update changelog	2025-05-29 03:26:47 +03:00
Disty0	67e0f4d833	Cleanup	2025-05-29 03:22:40 +03:00
Disty0	3698f8bb84	SDNQ add experimental FP8 matmul	2025-05-29 03:11:59 +03:00
Disty0	dd33c4d583	Fix scale and zero_point not being moved by tensor.to	2025-05-28 17:46:06 +03:00
Disty0	dd0dbc476f	SDNQ fix asym quant formula for dtypes with non zero minimums	2025-05-28 17:25:38 +03:00
Disty0	e06cbea7aa	Cleanup	2025-05-28 15:55:08 +03:00
Disty0	d8e8f47ce5	SDNQ add an option to toggle quantize with GPU	2025-05-28 15:18:39 +03:00
Disty0	1961e88c13	Set SDPA as the default on all backends and enable Dyn SDPA on ROCm, DML, CPU and MPS	2025-05-28 13:42:29 +03:00
Disty0	569e9099d7	Use torch.amax instead of torch.max	2025-05-28 12:44:07 +03:00
Disty0	0b564e2373	Cleanup	2025-05-28 04:07:45 +03:00
Disty0	1433dfe3de	SDNQ fix high RAM usage with pre mode	2025-05-28 03:16:29 +03:00
Disty0	4ed15f5cce	SDNQ revert device_map = gpu	2025-05-27 23:32:58 +03:00
Disty0	d3e3fb98b0	Don't override user set device_map	2025-05-27 21:45:52 +03:00
Disty0	b1b29e9001	SDNQ disable device_map = gpu with TE and LLM	2025-05-27 21:32:32 +03:00
Disty0	b724cd7c57	Update changelog	2025-05-27 21:21:42 +03:00
Disty0	5d3c1832b2	SDNQ add FP8 quants	2025-05-27 20:29:15 +03:00
Disty0	3618e39cff	SDNQ use device_map = gpu	2025-05-27 19:46:30 +03:00
Disty0	73999ac710	Add soft gc to nncf quant layer	2025-05-27 16:24:04 +03:00
Disty0	e94128a02e	SDNQ add force torch_gc to pre load mode	2025-05-27 16:11:04 +03:00
Disty0	dece497f10	Refactor SDNQ to use weights_dtype and rename decompress_int8_matmul to use_quantized_matmul	2025-05-27 15:49:21 +03:00
Disty0	79bb348927	SDNQ sort quant schemes by recommended order	2025-05-27 13:06:17 +03:00
Disty0	dec460e665	SDNQ use torch.bitwise ops instead of python	2025-05-27 03:02:36 +03:00
Disty0	280be31883	SDNQ fix Lora change	2025-05-27 00:08:32 +03:00
Disty0	4d9c2a8608	Cleanup	2025-05-26 22:41:12 +03:00
Disty0	84ddfb2868	SDNQ fix lora apply	2025-05-26 22:39:20 +03:00
Disty0	6dee9f5ac7	Fix HiDream teacache not reseting	2025-05-26 21:21:01 +03:00
Disty0	742cd61d1f	Add TeaCache for HiDream	2025-05-26 19:59:43 +03:00
Disty0	687c50dcc8	SDNQ fix Lora	2025-05-26 19:48:45 +03:00
Disty0	ccf9deaf28	Move SDNQ to the top of the settings list	2025-05-26 18:30:50 +03:00
Disty0	02f15b28cc	Cleanup	2025-05-26 15:57:17 +03:00
Disty0	91bb07f650	SDNQ remove unused args and simplify decompressors	2025-05-26 15:51:53 +03:00
Disty0	d2159af10e	cleanup	2025-05-26 04:24:28 +03:00
Disty0	4ad404182d	cleanup	2025-05-26 04:17:22 +03:00
Disty0	3f8ae754a0	Update readme	2025-05-26 03:35:25 +03:00
Disty0	46e9a9a631	IPEX disable Dynamic Attention by default on PyTorch 2.7	2025-05-26 03:03:17 +03:00
Disty0	5fcd0be79c	Update changelog	2025-05-26 02:50:05 +03:00
Disty0	e314a7ca19	Update changelog	2025-05-26 02:49:12 +03:00
Disty0	17df7ba83b	Cleanup whitespace	2025-05-26 02:41:29 +03:00
Disty0	4453efee76	Rename NNCF to SDNQ and rename quant schemes	2025-05-26 02:39:51 +03:00
Disty0	9c2e15433e	NNCF set required_packages to None	2025-05-26 01:39:09 +03:00
Disty0	cbc1bfe710	Cleanup	2025-05-26 01:24:06 +03:00
Disty0	2d79380bd7	NNCF implement better layer hijacks and remove all NNCF imports	2025-05-26 01:12:28 +03:00
Vladimir Mandic	af3a44ccbe	optional skimage ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-05-24 08:58:04 +02:00