Commit Graph

5990 Commits

Author SHA1 Message Date
Vladimir Mandic a7e0723dcf profiling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-18 13:02:22 -05:00
Vladimir Mandic 85805f969a add sana chi
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-18 09:16:14 -05:00
Seunghoon Lee 4b35dfc2a2 zluda HIP SDK 6.2 support 2024-12-18 23:06:18 +09:00
Vladimir Mandic ecf6aff1c2 update wiki
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-18 08:29:14 -05:00
Disty0 fc63de6958 IPEX enable empty_cache fix for WSL on PyTorch 2024-12-17 22:43:30 +03:00
Disty0 468c7d6bc8 Use apply_compile_model with torchao 2024-12-17 22:24:25 +03:00
Vladimir Mandic fd7fe8cea5 add torchao
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-17 13:29:36 -05:00
Vladimir Mandic 191a720902 update sana and changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-17 09:05:06 -05:00
Vladimir Mandic 84f6ec7189 update sana
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-16 15:55:52 -05:00
Vladimir Mandic 7b258468f0 add ufogen
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-16 15:40:54 -05:00
Vladimir Mandic ab07788ab5 add sana
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-16 11:30:15 -05:00
Vladimir Mandic b1f1864099 lint updates
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-15 13:12:35 -05:00
Vladimir Mandic 3e8dec9297 add freescale
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-15 12:40:54 -05:00
Vladimir Mandic 814161cb21 major controlnet work, xinsir promax and tiling support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-14 17:29:51 -05:00
Disty0 7d7bcb9684 Fix balanced offload with Cascade 2024-12-13 23:01:53 +03:00
Disty0 8a6e5617ba Fix IPEX 2.5 2024-12-13 22:05:13 +03:00
Disty0 7a213fe69a IPEX fix Flux 2024-12-13 00:12:40 +03:00
Vladimir Mandic bd540efb73 lora: absolute path, hf download, flux controlnet loras
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-11 18:10:51 -05:00
Vladimir Mandic 8f21e96f73 update bnb and increase ui timeouts
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-11 15:22:51 -05:00
Vladimir Mandic e9f951b2c5 offload logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-11 14:20:01 -05:00
Vladimir Mandic 8cea43f7db lora add erorr handler for partial offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-11 13:10:05 -05:00
Vladimir Mandic c3b0c0a3bf add SD_NO_CACHE env variable
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-11 12:32:34 -05:00
Vladimir Mandic 9a588d9c91 update balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-11 12:06:03 -05:00
Vladimir Mandic f4847f1b8a optimize balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-10 15:49:20 -05:00
Vladimir Mandic beea969fd3 update lora
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-10 12:34:27 -05:00
Vladimir Mandic 944408e93b warn on quanto with offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-10 10:39:13 -05:00
Vladimir Mandic 042178fedb reorg settings
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-10 10:20:00 -05:00
Vladimir Mandic 383d7052ac lora split te apply
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-09 15:23:22 -05:00
Vladimir Mandic 7c88bfb60a fix preview choice
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-09 14:16:26 -05:00
Vladimir Mandic 1185950c4a yet another lora refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-09 13:40:19 -05:00
AI-Casanova 6c9101dfaf lora low memory mode: switching requires manual model reload 2024-12-06 22:54:08 -06:00
Vladimir Mandic 28eeb00432 remove non-blocking
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-06 09:15:37 -05:00
Vladimir Mandic 2a1fbd904f handle os err
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-06 07:36:20 -05:00
Vladimir Mandic 16ab1e2ae8 safer lora unapply
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-06 07:23:31 -05:00
Vladimir Mandic 2934948413 lora one more safe cast
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-05 09:04:42 -05:00
Vladimir Mandic 2965045993 change offload and upcast defaults
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-05 07:58:55 -05:00
Disty0 6f6ba0b598 Merge pull request #3617 from vladmandic/master
Pin ultralytics
2024-12-05 11:44:44 +03:00
Disty0 0f714c6339 pin ultralytics 2024-12-05 11:42:24 +03:00
Vladimir Mandic ca06002602 lora maintain device
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-04 09:25:57 -05:00
Vladimir Mandic e41d9f52cd add offload warning
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-04 08:47:22 -05:00
Vladimir Mandic e3f06734d0 samplers add custom sigma
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-03 08:52:53 -05:00
Vladimir Mandic bd192d2991 remove tracemalloc
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-02 16:27:22 -05:00
Vladimir Mandic cfafa2b271 Merge branch 'dev' into lora-refactor 2024-12-02 11:23:15 -05:00
Vladimir Mandic 4eac263055 add bdia sampler
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-02 11:21:39 -05:00
Vladimir Mandic 7e2034c4ff lora add fuse
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-02 10:51:41 -05:00
Vladimir Mandic f3761032cf cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-01 17:26:34 -05:00
Vladimir Mandic 106f93f079 memory optimizations
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-01 17:13:55 -05:00
Disty0 82eb924486 Reduce balanced offload max gpu memory to 0.70 2024-12-02 00:29:01 +03:00
Vladimir Mandic 023b13b6cb balanced offload improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-01 15:34:25 -05:00
Vladimir Mandic 507636d0a1 lora-refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-01 10:54:51 -05:00