22 Commits

Author	SHA1	Message	Date
Disty0	3698f8bb84	SDNQ add experimental FP8 matmul	2025-05-29 03:11:59 +03:00
Disty0	dd33c4d583	Fix scale and zero_point not being moved by tensor.to	2025-05-28 17:46:06 +03:00
Disty0	dd0dbc476f	SDNQ fix asym quant formula for dtypes with non zero minimums	2025-05-28 17:25:38 +03:00
Disty0	e06cbea7aa	Cleanup	2025-05-28 15:55:08 +03:00
Disty0	d8e8f47ce5	SDNQ add an option to toggle quantize with GPU	2025-05-28 15:18:39 +03:00
Disty0	569e9099d7	Use torch.amax instead of torch.max	2025-05-28 12:44:07 +03:00
Disty0	0b564e2373	Cleanup	2025-05-28 04:07:45 +03:00
Disty0	1433dfe3de	SDNQ fix high RAM usage with pre mode	2025-05-28 03:16:29 +03:00
Disty0	5d3c1832b2	SDNQ add FP8 quants	2025-05-27 20:29:15 +03:00
Disty0	3618e39cff	SDNQ use device_map = gpu	2025-05-27 19:46:30 +03:00
Disty0	73999ac710	Add soft gc to nncf quant layer	2025-05-27 16:24:04 +03:00
Disty0	e94128a02e	SDNQ add force torch_gc to pre load mode	2025-05-27 16:11:04 +03:00
Disty0	dece497f10	Refactor SDNQ to use weights_dtype and rename decompress_int8_matmul to use_quantized_matmul	2025-05-27 15:49:21 +03:00
Disty0	dec460e665	SDNQ use torch.bitwise ops instead of python	2025-05-27 03:02:36 +03:00
Disty0	4d9c2a8608	Cleanup	2025-05-26 22:41:12 +03:00
Disty0	84ddfb2868	SDNQ fix lora apply	2025-05-26 22:39:20 +03:00
Disty0	687c50dcc8	SDNQ fix Lora	2025-05-26 19:48:45 +03:00
Disty0	02f15b28cc	Cleanup	2025-05-26 15:57:17 +03:00
Disty0	91bb07f650	SDNQ remove unused args and simplify decompressors	2025-05-26 15:51:53 +03:00
Disty0	d2159af10e	cleanup	2025-05-26 04:24:28 +03:00
Disty0	4ad404182d	cleanup	2025-05-26 04:17:22 +03:00
Disty0	4453efee76	Rename NNCF to SDNQ and rename quant schemes	2025-05-26 02:39:51 +03:00