diff --git a/ui/locale/locale_en.json b/ui/locale/locale_en.json index 002dd834d..c6fdfdc5f 100644 --- a/ui/locale/locale_en.json +++ b/ui/locale/locale_en.json @@ -942,8 +942,8 @@ {"id":"","label":"Model load model direct to GPU","localized":"","hint":"","ui":"settings_sd"}, {"id":"","label":"Model offload mode","localized":"","hint":"Controls how model components move between VRAM and system RAM to fit larger models on less VRAM.
- none: keeps everything on the GPU; fastest, but only works if the whole model fits in VRAM
- balanced: the recommended default; offloads only when VRAM use crosses a threshold, so it suits almost any GPU (tuned by the watermarks below)
- group: offloads groups of layers via diffusers group offloading; an alternative middle ground with optional stream prefetch
- model: offloads whole components such as the VAE or text encoder when idle; a more compatible fallback when balanced or group are unsupported, with smaller savings
- sequential: offloads layer by layer; the most memory saving but slowest, for when even balanced runs out of memory

Command-line flags override the automatic choice:
- --lowvram: forces sequential
- --medvram: forces balanced with low watermark 0

With no flag, balanced is the automatic default on any GPU, with watermarks set by GPU memory (low / high):
- 12 GB or less: 0 / 0.6
- 12-24 GB: 0.2 / 0.6
- 24 GB or more: 0.2 / 0.8
(or none if no GPU is detected)","reload":"model","ui":"settings_offload"}, {"id":"","label":"Model types not to offload","localized":"","hint":"Model architectures to skip when offloading, separated by spaces or commas.
Useful for model types that misbehave when offloaded.

Applies only to balanced offload.

Default is empty.","ui":"settings_offload"}, - {"id":"","label":"Modules to always offload","localized":"","hint":"Module names that are always offloaded in balanced mode, separated by spaces, commas, or semicolons, regardless of the watermarks.

Applies only to balanced offload.

Default by GPU memory: the large text encoders (T5, UMT5) are added at roughly 4-12 GB and at 24 GB or more; empty otherwise.","ui":"settings_offload"}, - {"id":"","label":"Modules to never offload","localized":"","hint":"Module names that are never offloaded in balanced mode, separated by spaces, commas, or semicolons, keeping them resident in VRAM.

Applies only to balanced offload.

Default by GPU memory: the CLIP text encoders and the VAE are kept resident at 24 GB or more; empty otherwise.","ui":"settings_offload"}, + {"id":"","label":"Modules to always offload","localized":"","hint":"Module names that are always offloaded in balanced mode, separated by spaces, commas, or semicolons, regardless of the watermarks.

Applies only to balanced offload.

Default by GPU memory: the large text encoders (T5, UMT5) are added at roughly 4-12 GB and at 24 GB or more; empty otherwise.","reload":"model","ui":"settings_offload"}, + {"id":"","label":"Modules to never offload","localized":"","hint":"Module names that are never offloaded in balanced mode, separated by spaces, commas, or semicolons, keeping them resident in VRAM.

Applies only to balanced offload.

Default by GPU memory: the CLIP text encoders and the VAE are kept resident at 24 GB or more; empty otherwise.","reload":"model","ui":"settings_offload"}, {"id":"","label":"Model types not to quantize","localized":"","hint":"","ui":"settings_quantization"}, {"id":"","label":"Modules to not convert","localized":"","hint":"Names of modules to leave unquantized (kept in original precision), separated by spaces, commas, or semicolons.
Useful for layers that are sensitive to quantization, such as gate or projection layers. Example: proj_out, x_embedder.

Some models already exclude sensitive modules by default; entries here extend that built-in list rather than replacing it.

Default is empty.","reload":"model","ui":"settings_quantization"}, {"id":"","label":"Modules dtype dict","localized":"","hint":"Advanced: JSON mapping a quantization type to a list of module names, to quantize specific modules at a different type than the global Quantization type. Example: {\"uint4\": [\"proj_out\"]}.

Some models already assign certain modules a specific type by default; entries here merge with those built-in mappings rather than replacing them.

Default is empty.","reload":"model","ui":"settings_quantization"},