Commit Graph

5671 Commits

Author SHA1 Message Date
Vladimir Mandic c4263da0e6 fix refiner reload/unload 2023-08-26 13:35:59 +00:00
Vladimir Mandic d48a13a118 settings compact layour 2023-08-26 08:02:07 +02:00
Vladimir Mandic 2e13c98868 update css 2023-08-25 21:15:41 +02:00
Vladimir Mandic e810d59fb8 update gradio and add batch img2img 2023-08-25 16:36:45 +00:00
Disty0 8ef4aa7a4a OpenVINO fix resolution change 2023-08-25 16:12:10 +03:00
Vladimir Mandic 0512e2973c refactor settings ui 2023-08-24 10:01:39 +02:00
Vladimir Mandic 89a3994c30 wrap final sample processing 2023-08-23 09:12:13 +00:00
Vladimir Mandic 84f343687d fix python 3.9 compatibility 2023-08-23 08:18:40 +00:00
Vladimir Mandic 3d1bcf88a2 fix hashing 2023-08-23 07:26:57 +00:00
Disty0 863fa38c24 OpenVINO fix model reloading 2023-08-23 00:31:43 +03:00
Vladimir Mandic 6a4d4ea5b7 update logging and model hashinh 2023-08-22 18:28:09 +00:00
Disty0 80d2cc46e8 Add precompile as an option 2023-08-22 13:21:25 +03:00
Disty0 374307dd8a Cleanup 2023-08-22 10:39:38 +03:00
Disty0 12fd9151a7 Fix openvino_override_opts 2023-08-22 03:26:08 +03:00
Disty0 e70520efa9 Add --use-openvino 2023-08-22 03:02:19 +03:00
Disty0 ebf7b90e3e OpenVINO fixes 2023-08-21 21:34:53 +03:00
Disty0 698c8d56cd Ipexrun use jemalloc 2023-08-21 17:21:55 +03:00
Vladimir Mandic 93bf3bb263 set default settings 2023-08-21 08:31:50 +00:00
Vladimir Mandic 53dcf157fb switch abs to relative paths 2023-08-21 08:11:30 +00:00
Vladimir Mandic 464810be9f fix unknown settings 2023-08-21 06:06:01 +00:00
Vladimir Mandic 8d97b35834 update changelog 2023-08-20 15:51:14 +02:00
Vladimir Mandic 607f2d480b Merge pull request #2048 from vladmandic/dev
merge dev to master
2023-08-20 15:40:11 +02:00
Vladimir Mandic eb7916b7fd update github templates 2023-08-20 13:10:00 +00:00
Vladimir Mandic 4826197d5b Merge pull request #2047 from vladmandic/master
update dev
2023-08-20 14:43:09 +02:00
Disty0 70395fb63a IPEX Diffusers remove BF16 fixes 2023-08-20 15:16:06 +03:00
Disty0 5b7f873fad Fix sequential offloading 2023-08-19 22:07:10 +03:00
Disty0 1666ee68ad IPEX change default dtype to BF16 2023-08-19 19:44:58 +03:00
Disty0 05084a5f53 Diffusers fix dtypes 2023-08-19 19:27:06 +03:00
Disty0 f9718f068c Seperate OpenVINO from IPEX 2023-08-19 17:52:15 +03:00
Vladimir Mandic 87bb354f4c implement hires for diffusers 2023-08-19 12:25:41 +00:00
Vladimir Mandic 5eac99d3f5 optimize diffusers memory handling 2023-08-18 20:41:34 +00:00
Disty0 05c3bd075a IPEX update OpenVINO 2023-08-18 16:57:14 +03:00
Vladimir Mandic 20ba9aa649 update lint 2023-08-15 08:29:04 +02:00
Vladimir Mandic ebc1243238 Merge pull request #2014 from midcoastal/Issue1563/FS-Path-Cache
Add a FS directory/path cacher
2023-08-18 07:45:06 +02:00
Midcoastal 67f369ed25 A walk() optimization and lint fixes 2023-08-17 16:49:42 -04:00
Midcoastal 89da66207a I guess I didn't quite understand Lint error C416
Seems like a rather pedantic check, if you ask me...  Oh well.
2023-08-16 00:25:27 -04:00
Midcoastal 03363ce866 Resolve Lint Errors: C416 (x2), W291 and F541 2023-08-15 23:20:00 -04:00
Midcoastal c9bdd0344d Allow JPEG image files
JPEG is allowed and searched for when looking for previews/thumbs, and therefore should be allowed to view.
2023-08-15 23:10:30 -04:00
Midcoastal 873e864640 Ooof, modelloader changes needed for TI upgrade 2023-08-15 23:09:24 -04:00
Midcoastal 6eae768fb0 Gather HTML parts as list to append in the end
Somehow, significant increase in speed (size of text append was slowing large loads down.
2023-08-15 23:08:26 -04:00
Midcoastal 05850c2344 Upgrade Lora/TI model listers to use cache 2023-08-15 23:06:23 -04:00
Midcoastal 7e4aed7948 Add a FS directory/path cacher
- Added FS dir/path mechanism to 'modules.modelloader'
- Refactored 'modules.modelloader.load_models' to use the cache
- Refactored 'modules.ui_extra_networks.find_*' methods to use the cache
- Added progress indicator to 'modules.ui_extra_networks.create_html'

The cache, as implimented, will always ensure it is up-to-date (per 'directory_has_changed') and significantly improves loading speed (when used with 'model_loader' and the 'find_*' methods) with large model directories.

Overall load speed tested with ~10k models (mix of checkpoints, loras, lycoris, and embeddings) and ~40k secndary files (images, descriptions, CivitAI Info, etc).  Loading speeds went from ~1 hour and 45 minutes to ~5 minutes.

Confounding variable to loading speeds: this is over a fiber-attached storage device.  Connection is 10gbe full-duplex, remote source has an NVMe raid cache.  Saturation of the network is the norm, but laintency is a factor.  Regardless, small-scale local-storage testing also shows measurable improvements, so this should be a welcome addition.
2023-08-15 16:07:41 -04:00
vladmandic 79c0131158 Deploying to master from @ vladmandic/automatic@b1ea529c08 🚀 2023-08-15 12:25:08 +00:00
Disty0 86ae8175e0 Seperate OpenVINO from IPEX 2023-08-15 15:22:54 +03:00
Vladimir Mandic 3d914688cc update metadata 2023-08-15 05:50:15 +02:00
Disty0 81129cc4b7 IPEX remove torchvision from Windows 2023-08-17 11:46:49 +03:00
Disty0 fcff59122c Merge pull request #1970 from Nuullll/ipex-native-win
[IPEX] Fix native windows setup
2023-08-17 08:44:54 +03:00
Disty0 8ddac64958 Merge branch 'master' into ipex-native-win 2023-08-16 20:27:57 +03:00
Disty0 2caee04b9a IPEX fix System Info 2023-08-16 19:45:13 +03:00
Disty0 209f9a19c6 IPEX fixes 2023-08-16 18:56:50 +03:00