Commit Graph

5623 Commits

Author SHA1 Message Date
Midcoastal 6eae768fb0 Gather HTML parts as list to append in the end
Somehow, significant increase in speed (size of text append was slowing large loads down.
2023-08-15 23:08:26 -04:00
Midcoastal 05850c2344 Upgrade Lora/TI model listers to use cache 2023-08-15 23:06:23 -04:00
Midcoastal 7e4aed7948 Add a FS directory/path cacher
- Added FS dir/path mechanism to 'modules.modelloader'
- Refactored 'modules.modelloader.load_models' to use the cache
- Refactored 'modules.ui_extra_networks.find_*' methods to use the cache
- Added progress indicator to 'modules.ui_extra_networks.create_html'

The cache, as implimented, will always ensure it is up-to-date (per 'directory_has_changed') and significantly improves loading speed (when used with 'model_loader' and the 'find_*' methods) with large model directories.

Overall load speed tested with ~10k models (mix of checkpoints, loras, lycoris, and embeddings) and ~40k secndary files (images, descriptions, CivitAI Info, etc).  Loading speeds went from ~1 hour and 45 minutes to ~5 minutes.

Confounding variable to loading speeds: this is over a fiber-attached storage device.  Connection is 10gbe full-duplex, remote source has an NVMe raid cache.  Saturation of the network is the norm, but laintency is a factor.  Regardless, small-scale local-storage testing also shows measurable improvements, so this should be a welcome addition.
2023-08-15 16:07:41 -04:00
vladmandic 79c0131158 Deploying to master from @ vladmandic/automatic@b1ea529c08 🚀 2023-08-15 12:25:08 +00:00
Disty0 86ae8175e0 Seperate OpenVINO from IPEX 2023-08-15 15:22:54 +03:00
Disty0 b1ea529c08 Cleanup 2023-08-15 00:50:46 +03:00
Disty0 66394c8cd9 IPEX add OpenVINO as compile backend 2023-08-14 21:54:21 +03:00
Vladimir Mandic fce48be440 update changelog 2023-08-14 07:58:42 +00:00
Vladimir Mandic 30bc2160d5 Merge pull request #2002 from are-we-gfx1100-yet/merge/rocm_installer_for_navi
Improved ROCm installer for Navi 3x and ROCm 5.5+ (and experimental Navi 2x support)
2023-08-14 09:57:18 +02:00
Vladimir Mandic 048f68bd40 update wiki 2023-08-14 07:50:46 +00:00
Vladimir Mandic eeca263bd2 update stored metadata 2023-08-14 07:50:12 +00:00
evshiron bb6b3e2e3f fix: fix tensorflow installer for navi 3x 2023-08-14 00:58:07 +08:00
evshiron b3029200f5 refactor: refactor rocm installer 2023-08-13 20:18:57 +08:00
evshiron 414acda2e9 feat: improved rocm installer for navi 3x and rocm 5.5+ (and experimental navi 2x support) 2023-08-13 19:02:08 +08:00
Vladimir Mandic 88fff06c9e downgrade warn to info 2023-08-13 10:58:02 +00:00
Vladimir Mandic 357b5dac60 add dpm++ 3m sde sampler 2023-08-13 10:19:33 +00:00
Vladimir Mandic d4b5c487fe fix img2img resize 2023-08-13 09:54:09 +00:00
Vladimir Mandic c5c817f482 img2img batching 2023-08-13 09:19:39 +00:00
Vladimir Mandic 23efa8f0a5 fix init_image 2023-08-13 08:22:03 +00:00
Seunghoon Lee 7e81355741 Fix pdh.dll not found. (WSL+DirectML) 2023-08-13 15:40:15 +09:00
Vladimir Mandic 83d1ee77bd revert long prompt 2023-08-13 00:32:03 +02:00
Vladimir Mandic 392f51cff3 add long prompts 2023-08-12 23:04:46 +02:00
Vladimir Mandic 1cfebbb717 skip uninstall on experimental 2023-08-12 22:16:37 +02:00
Vladimir Mandic 69eaf4c664 fix batch 2023-08-12 08:32:19 +00:00
Vladimir Mandic 5d5f22e6e1 remove invalid downloaded files 2023-08-12 08:07:13 +00:00
Vladimir Mandic 83f38c6333 update 2023-08-12 07:36:48 +00:00
Vladimir Mandic fc8eca1c34 deallocate images on batch 2023-08-12 07:18:19 +00:00
Aptronymist 605988f520 Removed annoyance
Took out the print statement 'no image data blocks found' as it happens frequently as embeddings rarely have image data.
2023-08-11 19:51:42 -04:00
Vladimir Mandic 9fc70cb329 Merge pull request #1985 from vladmandic/dev
merge dev into master
2023-08-11 08:14:14 +02:00
Vladimir Mandic 7ffb66491c update changelog 2023-08-11 08:10:57 +02:00
Disty0 307e08653c Fix compel install 2023-08-11 01:15:16 +03:00
Vladimir Mandic a156751857 fix pipeline autodetect 2023-08-10 21:56:26 +00:00
Vladimir Mandic f52249d5a8 fix prompt parser for sdxl and enable offloading 2023-08-10 21:20:56 +00:00
Vladimir Mandic 5bcd65d4c2 revert meta 2023-08-10 19:00:04 +00:00
Disty0 0a7105d524 Fix SDXL LoRa offloading and SD 1.5 parsing 2023-08-10 16:02:45 +03:00
Vladimir Mandic 0b5dd46d79 Merge pull request #1976 from tcmaps/master
pip --no-cache-dir
2023-08-10 08:28:02 +02:00
Vladimir Mandic b94af77d29 update 2023-08-10 08:22:43 +02:00
Disty0 a9726b3319 Send to meta when unloading 2023-08-10 01:23:39 +03:00
unknown b4ea0fa0fa PIP_EXTRA_ARGS 2023-08-09 21:08:00 +02:00
Disty0 839bd27956 Pass device to Compel 2023-08-09 19:15:38 +03:00
Vladimir Mandic 161bd6af42 update idle script 2023-08-09 11:29:51 +00:00
Vladimir Mandic 627677ce61 update cli 2023-08-09 11:17:22 +00:00
Vladimir Mandic ea04f8feba update changelog 2023-08-09 10:32:24 +00:00
Vladimir Mandic 16725ab38f fix compel to full and add batch sizes 2023-08-09 10:28:44 +00:00
Vladimir Mandic e2b0d981ac quick taesd vae decode 2023-08-09 09:34:59 +00:00
Vladimir Mandic a77fa4c12e add job info 2023-08-09 08:42:26 +00:00
Vladimir Mandic a5f95f4b38 civitai model search and download 2023-08-09 08:01:37 +00:00
Aptronymist 417ef54003 Merge pull request #1971 from Aptronymist/master 2023-08-08 12:05:30 -04:00
Aptronymist 196fa29ee0 Update ui_extra_networks.py
Added fix to thumbnail images that exceed 70kb to address slowdowns and wasted memory.
2023-08-08 11:43:38 -04:00
Disty0 ff2d846667 IPEX Diffusers fix Model CPU Offload 2023-08-08 00:51:23 +03:00