17 Commits

Author	SHA1	Message	Date
Disty0	e19fb2d833	SDNQ keep the quant configs inside the module subfolder, add dtype cast and don't send to GPU	2025-10-09 19:34:48 +03:00
Vladimir Mandic	70defe6d06	handle load shards ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-10-09 11:29:36 -04:00
Vladimir Mandic	6907fcd320	speedup prequant model load ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-10-08 13:47:36 -04:00
Disty0	bdcd07f713	Add add_module_skip_keys to pre-load quant too	2025-10-08 01:11:40 +03:00
Disty0	7fdf400e8b	cleanup	2025-10-08 00:41:04 +03:00
Disty0	df03ea9ba8	SDNQ add sdnq_post_load_quant and update Qwen keys	2025-10-08 00:29:36 +03:00
Vladimir Mandic	962cb7115d	infra for full-model load/save with quant ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-10-07 14:30:45 -04:00
Vladimir Mandic	7fdc880a73	sdnq patches ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-10-07 09:43:34 -04:00
Disty0	1cd7b6d63a	fix upcast scale check	2025-10-07 01:27:54 +03:00
Disty0	aa0c10440f	SDNQ make the loader don't touch the model options by default	2025-10-07 00:15:23 +03:00
Disty0	c931bf9efa	SDNQ add dtype casting to loader	2025-10-06 17:44:52 +03:00
Disty0	5c042c5fb8	cleanup	2025-10-06 11:30:26 +03:00
Vladimir Mandic	a315a004e9	linting ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-10-05 20:25:33 -04:00
Disty0	23f2deaa58	fix enable_quantized_mamtul	2025-10-06 02:04:28 +03:00
Disty0	1f81a37e8e	Set the default svd rank to 32	2025-10-06 01:27:29 +03:00
Disty0	ebb26ac123	SDNQ make load file name configurable	2025-10-06 01:04:00 +03:00
Disty0	0acb571472	SDNQ ass load and save model funcs	2025-10-06 00:57:23 +03:00