5823 Commits

Author	SHA1	Message	Date
Vladimir Mandic	bd540efb73	lora: absolute path, hf download, flux controlnet loras ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-11 18:10:51 -05:00
Vladimir Mandic	8f21e96f73	update bnb and increase ui timeouts ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-11 15:22:51 -05:00
Vladimir Mandic	e9f951b2c5	offload logging ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-11 14:20:01 -05:00
Vladimir Mandic	8cea43f7db	lora add erorr handler for partial offload ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-11 13:10:05 -05:00
Vladimir Mandic	c3b0c0a3bf	add SD_NO_CACHE env variable ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-11 12:32:34 -05:00
Vladimir Mandic	9a588d9c91	update balanced offload ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-11 12:06:03 -05:00
Vladimir Mandic	f4847f1b8a	optimize balanced offload ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-10 15:49:20 -05:00
Vladimir Mandic	beea969fd3	update lora ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-10 12:34:27 -05:00
Vladimir Mandic	944408e93b	warn on quanto with offload ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-10 10:39:13 -05:00
Vladimir Mandic	042178fedb	reorg settings ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-10 10:20:00 -05:00
Vladimir Mandic	383d7052ac	lora split te apply ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-09 15:23:22 -05:00
Vladimir Mandic	7c88bfb60a	fix preview choice ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-09 14:16:26 -05:00
Vladimir Mandic	1185950c4a	yet another lora refactor ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-09 13:40:19 -05:00
AI-Casanova	6c9101dfaf	lora low memory mode: switching requires manual model reload	2024-12-06 22:54:08 -06:00
Vladimir Mandic	28eeb00432	remove non-blocking ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-06 09:15:37 -05:00
Vladimir Mandic	2a1fbd904f	handle os err ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-06 07:36:20 -05:00
Vladimir Mandic	16ab1e2ae8	safer lora unapply ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-06 07:23:31 -05:00
Vladimir Mandic	2934948413	lora one more safe cast ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-05 09:04:42 -05:00
Vladimir Mandic	2965045993	change offload and upcast defaults ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-05 07:58:55 -05:00
Disty0	6f6ba0b598	Merge pull request #3617 from vladmandic/master ... Pin ultralytics	2024-12-05 11:44:44 +03:00
Disty0	0f714c6339	pin ultralytics	2024-12-05 11:42:24 +03:00
Vladimir Mandic	ca06002602	lora maintain device ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-04 09:25:57 -05:00
Vladimir Mandic	e41d9f52cd	add offload warning ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-04 08:47:22 -05:00
Vladimir Mandic	e3f06734d0	samplers add custom sigma ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-03 08:52:53 -05:00
Vladimir Mandic	bd192d2991	remove tracemalloc ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-02 16:27:22 -05:00
Vladimir Mandic	cfafa2b271	Merge branch 'dev' into lora-refactor	2024-12-02 11:23:15 -05:00
Vladimir Mandic	4eac263055	add bdia sampler ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-02 11:21:39 -05:00
Vladimir Mandic	7e2034c4ff	lora add fuse ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-02 10:51:41 -05:00
Vladimir Mandic	f3761032cf	cleanup ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-01 17:26:34 -05:00
Vladimir Mandic	106f93f079	memory optimizations ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-01 17:13:55 -05:00
Disty0	82eb924486	Reduce balanced offload max gpu memory to 0.70	2024-12-02 00:29:01 +03:00
Vladimir Mandic	023b13b6cb	balanced offload improvements ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-01 15:34:25 -05:00
Vladimir Mandic	507636d0a1	lora-refactor ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-12-01 10:54:51 -05:00
Vladimir Mandic	e74c038f64	interruptible lora apply ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-11-30 19:53:10 -05:00
Disty0	4089af7c03	Fix NaNs on Intel with Lora + Offloading	2024-12-01 03:52:57 +03:00
Vladimir Mandic	c5cd3cb623	reinit offoad instance on change ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-11-30 19:15:50 -05:00
Vladimir Mandic	b7aff134a2	add low/high threshold to balanced offload ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-11-30 19:03:51 -05:00
Vladimir Mandic	22982f3126	update stats ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-11-30 18:10:10 -05:00
Vladimir Mandic	bccb277dcb	update lora apply weights and xyz ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-11-30 17:26:52 -05:00
Disty0	81a95d04cf	Skip apply_balanced_offload if not needed	2024-11-30 21:12:26 +03:00
Disty0	b55e746fca	Improve balanced offload pre forward performance	2024-11-30 20:49:57 +03:00
Vladimir Mandic	eee85e5a4e	lora refactor in progress ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-11-30 12:29:58 -05:00
Disty0	6ec93f2d46	Disable load lora gpu with medvram too	2024-11-30 17:04:35 +03:00
Vladimir Mandic	eacd4e9357	add stats ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-11-30 09:02:47 -05:00
Vladimir Mandic	1e90312982	update lora ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-11-30 08:50:25 -05:00
Disty0	63ba83d361	ZLUDA enable Dynamic attention by default	2024-11-30 01:15:49 +03:00
Disty0	881fa1183c	Fix offload issues with lora	2024-11-30 00:16:38 +03:00
Vladimir Mandic	797ad1f20f	lora stats ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-11-29 15:40:23 -05:00
Disty0	e52019104d	revert sd_models.py	2024-11-29 22:55:15 +03:00
Disty0	9187418358	revert networs.py	2024-11-29 22:53:17 +03:00