Commit Graph

9727 Commits

Author SHA1 Message Date
Disty0 a6ea26fb8d Use transformers QuantoConfig for TE and LLM 2025-04-16 19:16:35 +03:00
Disty0 68d1262836 Fix live previews with HiDream 2025-04-16 18:40:50 +03:00
Vladimir Mandic ebe62a30a6 lint fixes and update requirements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-16 09:24:39 -04:00
Vladimir Mandic c5fb7f179d Merge branch 'master' into dev 2025-04-16 09:20:32 -04:00
Vladimir Mandic 38a3b62553 modularize hidream loader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-16 09:11:43 -04:00
Vladimir Mandic 87defaac61 add lcm-flowmatch sampler and fix hunyuanvideo-i2v
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-16 07:29:41 -04:00
Vladimir Mandic 59a8a5cdb0 update changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-15 14:42:29 -04:00
Vladimir Mandic 15f8e70e89 add nunchaku prototype
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-15 14:39:24 -04:00
Vladimir Mandic ee1a4c607d offload cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-15 10:06:34 -04:00
Vladimir Mandic ecdd37747c Merge pull request #3874 from Disty0/dev
[HiDream] Offload the TE right away with balanced offload
2025-04-15 08:05:52 -04:00
Disty0 1541a19d89 Offload the TE right away 2025-04-15 02:28:44 +03:00
Disty0 7a4848dada Fix NNCF not applying for TE only quant 2025-04-15 02:16:18 +03:00
Disty0 3564b34e0d Prompt cache support for HiDream 2025-04-15 00:59:46 +03:00
Vladimir Mandic c2f2f5da5f Merge pull request #3871 from vladmandic/dev
merge dev
2025-04-14 10:28:15 -04:00
Vladimir Mandic aaa4d6891b Merge branch 'master' into dev 2025-04-14 10:27:37 -04:00
Vladimir Mandic b63afc80fa explicitly flag h1 as large model
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-14 10:25:31 -04:00
Vladimir Mandic ac76138616 update changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-14 10:18:17 -04:00
Vladimir Mandic 762be6e369 cleanup te hijack
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-14 10:16:16 -04:00
Vladimir Mandic 8f7a397a32 fix unipc-flowmatch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-14 10:14:26 -04:00
Vladimir Mandic 59efc95e00 flux-cfgzero map autopipeline
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-14 10:03:33 -04:00
Vladimir Mandic a38f7cbca0 general te hijack
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-14 09:46:03 -04:00
Vladimir Mandic cf1606ea11 update diffusers
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-14 09:10:01 -04:00
Vladimir Mandic 76b5709f51 add unipc-flowmatch, cfgzero for hidream
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-14 08:50:01 -04:00
Vladimir Mandic 06f4879be9 fix logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-14 08:28:35 -04:00
Vladimir Mandic 5c3ab983c0 update changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-13 10:06:23 -04:00
Vladimir Mandic 94848cbc2b add native hf auth check
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-13 10:05:15 -04:00
Vladimir Mandic e9a31a92c9 hidream warn on gated model
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-13 09:53:25 -04:00
Vladimir Mandic 4aa17ca745 networks regex pattern(s) for skip-scan
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-13 09:10:11 -04:00
Vladimir Mandic a8abed125e xyz grid allow bool
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-13 08:39:31 -04:00
Vladimir Mandic 90415a7469 add cfgzero to additional pipelines
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-13 07:56:32 -04:00
Vladimir Mandic 9b82bf900e fix typo
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-13 07:25:47 -04:00
Vladimir Mandic 6f2891afbd add cfgzero for flux
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-12 19:20:27 -04:00
Vladimir Mandic 054a28d25a cleanup logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-12 18:07:17 -04:00
Vladimir Mandic 83730a2b1e update
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-12 18:05:40 -04:00
Vladimir Mandic d9a72be74c display reference models with subdued color
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-12 17:59:24 -04:00
Vladimir Mandic 7364bc364b cleanup cogview loader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-12 17:36:51 -04:00
Vladimir Mandic 77a87c0b34 Merge pull request #3866 from vladmandic/dev
merge dev
2025-04-12 11:37:38 -04:00
Vladimir Mandic c03a6068c0 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-12 11:37:14 -04:00
Vladimir Mandic baa46cd3ac Merge branch 'master' into dev 2025-04-12 11:36:36 -04:00
Vladimir Mandic 8cef04801a update changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-12 11:35:59 -04:00
Vladimir Mandic fb48f5e60b hidream remote-vae
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-12 11:11:25 -04:00
Vladimir Mandic 6dd37753db hidream bump max-token-length from 128 to 256
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-12 09:24:38 -04:00
Vladimir Mandic 8390ac02a2 update changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-11 23:39:41 -04:00
Vladimir Mandic 3533258980 hidream whitelist samplers
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-11 22:32:57 -04:00
Vladimir Mandic 0f595d4cc5 cleanup multiple model loaders
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-11 22:16:05 -04:00
Vladimir Mandic 78d8bfeba7 hidream allow custom llama
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-11 21:27:48 -04:00
Vladimir Mandic 1591773dec update todo
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-11 15:21:16 -04:00
Disty0 51c46339d6 IPEX fix Flux and HiDream 2025-04-11 22:17:18 +03:00
Vladimir Mandic 0439e5652d add shared.opts.device_map
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-11 14:53:42 -04:00
Disty0 72918eb94d Fix quanto needing to re-quant when moving to gpu 2025-04-11 21:50:06 +03:00