Commit Graph

7034 Commits

Author SHA1 Message Date
Seunghoon Lee 3fb21306f6 ONNX Stable Diffusion Inpaint WIP
ONNX Stable Diffusion XL Img2Img WIP
ONNX Stable Diffusion XL Refiner WIP
and lots of fixes.
2024-02-01 01:13:21 +09:00
Seunghoon Lee 364c3beb2e Fix onnx model downloading & more fixes. 2024-02-01 01:13:21 +09:00
Seunghoon Lee 4e5f0d3dde Add static dims option. 2024-02-01 01:13:21 +09:00
Seunghoon Lee 2fc7a94c7e Add pass for QUInt8 Quantization. 2024-02-01 01:13:20 +09:00
Seunghoon Lee bdd6b2b8f7 vae override for onnx 2024-02-01 01:13:20 +09:00
Seunghoon Lee 208c877cd7 Add ui for olive 2024-02-01 01:13:20 +09:00
Seunghoon Lee 34ffba96e3 other devices 2024-02-01 01:13:20 +09:00
Seunghoon Lee 286ec8e753 Integrate Olive into compile backend. 2024-02-01 01:13:19 +09:00
Seunghoon Lee 3cad532d81 SDXL Turbo with Olive optimization.
[WIP] SDXL Refiner with Olive optimization.
2024-02-01 01:13:19 +09:00
Seunghoon Lee 7ac30fb731 minor 2024-02-01 01:13:19 +09:00
Seunghoon Lee 82523bd799 separate onnx & add pipeline for SDXL Img2Img 2024-02-01 01:13:19 +09:00
Seunghoon Lee f10b257dd9 Olive SDXL optimization. 2024-02-01 01:13:18 +09:00
Seunghoon Lee 86b56d2d2c follow up 2024-02-01 01:13:18 +09:00
Seunghoon Lee 106a1ea68f batch size 2024-02-01 01:13:18 +09:00
Seunghoon Lee 88faafe6de wip: sdxl optimization 2024-02-01 01:13:18 +09:00
Seunghoon Lee 68b31782bf update configs 2024-02-01 01:13:17 +09:00
Seunghoon Lee 9d602ea90c load pipeline before removing temp dir 2024-02-01 01:13:17 +09:00
Seunghoon Lee 5b2f77811c reduce memory usage (conversion/optimization) 2024-02-01 01:13:17 +09:00
Seunghoon Lee f832f62773 add onnx pipeline for inpaint 2024-02-01 01:13:17 +09:00
Seunghoon Lee d685426e5b refactor onnx/olive 2024-02-01 01:13:16 +09:00
Seunghoon Lee cef798bf57 implement olive img2img 2024-02-01 01:13:16 +09:00
Seunghoon Lee c8814c4898 img2img wip 2024-02-01 01:13:16 +09:00
Seunghoon Lee 6507491d8f refactor onnx and olive 2024-02-01 01:13:14 +09:00
Seunghoon Lee b70258c926 add sdxl configs 2024-02-01 01:13:01 +09:00
Seunghoon Lee ba66bf7900 add sdxl configs 2024-02-01 01:13:01 +09:00
Seunghoon Lee af4302ddfa update olive by #2429 2024-02-01 01:13:01 +09:00
Disty0 8c819df207 ONNX OpenVINO fixes 2024-02-01 01:13:00 +09:00
Seunghoon Lee 5ce83bbfc4 specify provider 2024-02-01 01:13:00 +09:00
Seunghoon Lee ee818d9990 fixes 2024-02-01 01:13:00 +09:00
Seunghoon Lee 84f2a9df95 make olive optional 2024-02-01 01:12:58 +09:00
Seunghoon Lee e954695b5a fix olive not found 2024-02-01 01:12:12 +09:00
Seunghoon Lee 204d9b7738 vae channels last 2024-02-01 01:12:12 +09:00
Seunghoon Lee f154c7824a directly load submodels 2024-02-01 01:12:11 +09:00
Seunghoon Lee 583116e66e fix cached model pipeline 2024-02-01 01:12:11 +09:00
Seunghoon Lee ae5e40785e fix ep option save 2024-02-01 01:12:11 +09:00
Seunghoon Lee 507f8c24e7 add license of olive 2024-02-01 01:12:11 +09:00
Seunghoon Lee 18e2579842 update footprint filename of cpuep 2024-02-01 01:12:10 +09:00
Seunghoon Lee 98ee5848f2 customizable execution provider. 2024-02-01 01:12:10 +09:00
Seunghoon Lee b7cfd09d50 add optimization on gpu 2024-02-01 01:12:10 +09:00
Disty0 150c3ad078 Use get_raw_openvino_device with ONNX 2024-02-01 01:12:10 +09:00
Seunghoon Lee fd2c1e2546 add onnxruntime-openvino support. 2024-02-01 01:12:09 +09:00
Seunghoon Lee df021b3982 support more backends 2024-02-01 01:12:09 +09:00
Seunghoon Lee c327331312 update olive configs 2024-02-01 01:12:09 +09:00
Seunghoon Lee b22d5521b7 optimized model downloading 2024-02-01 01:12:08 +09:00
Seunghoon Lee f22bc3f53c remove optimize error log 2024-02-01 01:12:08 +09:00
Seunghoon Lee ff6acb4e3f olive_cache_optimized 2024-02-01 01:12:08 +09:00
Seunghoon Lee b7cce01222 cleanup 2024-02-01 01:12:08 +09:00
Seunghoon Lee def8a30017 Initial Olive implementation. 2024-02-01 01:12:07 +09:00
Vladimir Mandic 21516c3ba3 cleanup 2024-01-31 10:29:11 -05:00
Vladimir Mandic f7842d959e fix typo 2024-01-31 10:29:01 -05:00