diff --git a/CHANGELOG.md b/CHANGELOG.md index f3a2dfde6..bf5e6331c 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -5,6 +5,7 @@ TODO: - AuraFlow/LavenderFlow: https://github.com/huggingface/diffusers/pull/8796 - Kolors: https://github.com/huggingface/diffusers/issues/8801 - FlowMatchHeunDiscreteScheduler +- ControlNet Union: https://huggingface.co/xinsir/controlnet-union-sdxl-1.0 ## Update for 2024-07-07 @@ -16,7 +17,8 @@ Support for new models: - [Kwai Kolors](https://huggingface.co/Kwai-Kolors/Kolors) - [HunyuanDiT 1.2](https://huggingface.co/Tencent-Hunyuan/HunyuanDiT-v1.2-Diffusers) -New fast-install mode, support for DoRA networks, additional VLM models, new AuraSR upscaler, and more... +What else? Just a bit... ;) +New **fast-install** mode, new **controlnet-union** *all-in-one* model, support for **DoRA** networks, additional **VLM** models, new **AuraSR** upscaler, and more... ### New Models @@ -31,6 +33,8 @@ New fast-install mode, support for DoRA networks, additional VLM models, new Aur however, this new encoder does support both English and Chinese prompting - [HunyuanDiT 1.2](https://huggingface.co/Tencent-Hunyuan/HunyuanDiT-v1.2-Diffusers) to use, simply select from *networks -> reference +- [Xinsir ControlNet++ Union](https://huggingface.co/xinsir/controlnet-union-sdxl-1.0 + new SDXL all-in-one controlnet that can process any kind of preprocessors! - [CogFlorence 2 Large](https://huggingface.co/thwri/CogFlorence-2-Large-Freeze) VLM model to use, simply select in process -> visual query - [AuraSR](https://huggingface.co/fal/AuraSR) high-quality 4x GAN-style upscaling model diff --git a/TODO.md b/TODO.md index fd704b838..1a63122ec 100644 --- a/TODO.md +++ b/TODO.md @@ -10,7 +10,7 @@ Main ToDo list can be found at [GitHub projects](https://github.com/users/vladma - init latents: variations, img2img - diffusers public callbacks - include reference styles -- lora: sc lora, dora, etc +- lora: sc lora, etc ## Experimental diff --git a/modules/control/units/controlnet.py b/modules/control/units/controlnet.py index 138c5fba9..ec99b7bd6 100644 --- a/modules/control/units/controlnet.py +++ b/modules/control/units/controlnet.py @@ -51,8 +51,10 @@ predefined_sdxl = { 'Depth Mid XL': 'diffusers/controlnet-depth-sdxl-1.0-mid', 'OpenPose XL': 'thibaud/controlnet-openpose-sdxl-1.0/bin', # 'OpenPose XL': 'thibaud/controlnet-openpose-sdxl-1.0/OpenPoseXL2.safetensors', + 'Xinsir Union XL': 'xinsir/controlnet-union-sdxl-1.0', 'Xinsir OpenPose XL': 'xinsir/controlnet-openpose-sdxl-1.0', 'Xinsir Canny XL': 'xinsir/controlnet-canny-sdxl-1.0', + 'Xinsir Depth XL': 'xinsir/controlnet-depth-sdxl-1.0', 'Xinsir Scribble XL': 'xinsir/controlnet-scribble-sdxl-1.0', 'Xinsir Anime Painter XL': 'xinsir/anime-painter', # 'StabilityAI Canny R128': 'stabilityai/control-lora/control-LoRAs-rank128/control-lora-canny-rank128.safetensors',