CalamitousFelicitousness
005fc5c86e
The core took reference images only, so no api caller could send the video and audio references the ref2va workflow conditions on, and the marshalling that handles them existed solely in the MiniMax tab. validate_references now gates on the workflow and hands the entries to the architecture that owns them, which accepts decoded images and local file paths in any mix and preserves their order, since order fixes the labels a prompt addresses. reference_caps exposes the same limits the validation enforces, so a client reads them instead of mirroring the numbers. - MAX_IMAGE_REFERENCES is gone: the limits now cover all three kinds and a total - the run body no longer builds reference objects or knows their class - an image is converted where it is built rather than at the call site, so a reference decoded from a file and one posted as base64 arrive the same way - pipeline args summarize a reference list by kind, since a decoded video would otherwise print its frames into the per-generation log line - the video endpoint documents what it actually accepts: images alone, because video and audio decode from files rather than from the wire, and an upload reference only where an extension provides the store that resolves one
SD.Next: All-in-one WebUI
SD.Next is a state-of-the-art, open-source server application and web interface (WebUI) for AI image and video generation, built on Stable Diffusion and supporting dozens of advanced models. Create, refine, caption, upscale and process images and videos with a modern, cross-platform application — perfect for artists, researchers, and AI enthusiasts.
Table of contents
- Documentation
- Why SD.Next?
- Screenshots
- Supported Workflows
- Supported AI Models
- Supported Platforms & Hardware
- Getting started
- Community and Support
- Credits
- Development and Contributing
Why SD.Next?
SD.Next is feature-rich open-source AI art generation platform with a focus on performance, flexibility, and user experience.
In addition to supporting all popular workflows, a wide range of platforms and models, SD.Next includes many features not found in other WebUIs, such as:
- Support for many Diffusion models!
- Automatic model download: simply select a model from the list of reference models and it will be downloaded and ready to use
Or download and add your own models and they will be automatically detected and available in the UI - SDNQ: State-of-the-Art model quantization engine Use pre-quantized or run with quantization on-the-fly for up to 4x VRAM reduction with no or minimal quality and performance impact
- Balanced Offload: Dynamically balance CPU and GPU memory to run larger models on limited hardware
- Caption and Enhance with 25+ built-in LLM and VLM models, OpenCLiP models, Tagger with WaifuDiffusion and DeepDanbooru models
- Image Processing with full image correction color-grading suite of tools
- Multi-platform!
Platform specific auto-detection and tuning performed on install - Fully Localized to ~15 languages and with support for many UI themes!
- Desktop and mobile interfaces
- Built in installer with automatic updates and dependency management
Screenshots
Supported Workflows
- Generate with Text-to-Image, Image-to-Image, Text-to-Video, Image-to-Video, etc.
- Edit with Detailer, HiRes/Refine, Image-Edit, Inpainting, Outpainting, etc.
- Enhance guidance with LoRA, ControlNet, IPAdapters, Prompt Enhance, etc.
- Process with Caption, Tag, Upscale, Interpolate, Colorize, Filter, etc.
- and many more with support for custom scripts and extensions
Supported AI Models
SD.Next supports broad range of models and its frequently updated with latest models
For full list, see supported models and model specs
Supported Platforms and Hardware
SD.Next is designed to run on a wide range of hardware and platforms, with optimizations for various GPU architectures with acceleration and support for CPU-only execution. Supported platforms include:
- nVidia GPUs using CUDA libraries on both Windows and Linux
- AMD GPUs using ROCm libraries on both Linux and Windows
- AMD GPUs on Windows using ZLUDA libraries
- Intel Arc GPUs using OneAPI with IPEX XPU libraries on both Windows and Linux
- Any CPU/GPU or device compatible with OpenVINO libraries on both Windows and Linux
- Any GPU compatible with DirectX on Windows using DirectML libraries
- Apple M1/M2 on OSX using built-in support in Torch with MPS optimizations
- ONNX/Olive
Plus Docker container recipes for: CUDA, ROCm, Intel IPEX and OpenVINO
Getting started
- Get started with SD.Next by following the installation instructions
- For more details, check out advanced installation guide
- List and explanation of command line arguments
- Install walkthrough video
Tip
And for platform specific information, check out
WSL | Intel Arc | DirectML | OpenVINO | ONNX & Olive | ZLUDA | AMD ROCm | MacOS | nVidia | Docker
Quick Start
git clone https://github.com/vladmandic/sdnext
cd sdnext
./webui.sh # Linux/Mac
webui.bat # Windows
webui.ps1 # PowerShell
Warning
If you run into issues, check out troubleshooting and debugging guides
Community and Support
If you're unsure how to use a feature, best place to start is Docs and if its not there,
check ChangeLog for when feature was first introduced as it will always have a short note on how to use it
And for any question, reach out on Discord or open an issue or discussion
Credits
Main credit goes to Automatic1111 WebUI for the original codebase
Development and Contributing
Please see Dev Home for details on how to contribute to this project