diff --git a/ui/locale/locale_en.json b/ui/locale/locale_en.json index c319a8504..04c7ae34c 100644 --- a/ui/locale/locale_en.json +++ b/ui/locale/locale_en.json @@ -1476,8 +1476,8 @@ {"id":"","label":"Sparse Attention minimum sequence","localized":"","hint":"Shortest sequence that is sparsified. Below it attention stays dense, because choosing the tiles costs more than skipping them saves.
Sequence length is not resolution: a diffusion transformer sees roughly (width/16) x (height/16) tokens for an image, so 1024x1024 is about 4k tokens and 2048x2048 about 16k, and video multiplies that by the frame count.

0 sparsifies every sequence that reaches the stage.
Default 8192, around 1450x1450 for an image.","ui":"settings_cuda"}, {"id":"","label":"Sparse Attention dense steps","localized":"","hint":"Number of steps at the start and end of sampling that receive a larger budget, where composition and fine detail are set. Counted at each end, and capped at half the run.

Only takes effect when Sparse Attention dense step bonus is above 0.
0 applies one budget to every step.
Default 0.","ui":"settings_cuda"}, {"id":"","label":"Sparse Attention dense step bonus","localized":"","hint":"Percentage points added to the budget on the dense steps, capped at 100.

Only takes effect when Sparse Attention dense steps is above 0.
Default 30, so a budget of 30 rises to 60 on those steps.","ui":"settings_cuda"}, - {"id":"","label":"Sparse Attention share selection across heads","localized":"","hint":"Computes one selection for all attention heads rather than one per head, by averaging the heads before scoring. Cheaper to select and coarser in what it keeps, since heads that attend to different regions are served by a single compromise.
Worth trying when selection is itself a visible share of the cost, which happens on models with many heads.

Disabled by default.","ui":"settings_cuda"}, - {"id":"","label":"Sparse Attention excluded models","localized":"","hint":"Models that stay dense no matter how the rest of this section is set. Comma separated, matched case insensitively against the architecture, the pipeline class and the denoiser class, so whichever of those names is to hand works as an entry.
The class names appear in the model load log; the architecture is the short name used elsewhere in the settings, such as f1 or anima.

Listed by default is CosmosTransformer3DModel, the transformer Anima runs, which returns banded noise at every budget tested against a sound dense baseline. The class is listed rather than the architecture because the other models built on it have not been checked.
A model whose output breaks up rather than merely softening belongs here.

Default CosmosTransformer3DModel.","ui":"settings_cuda"} + {"id":"","label":"Sparse Attention share selection across heads","localized":"","hint":"Computes one selection for all attention heads rather than one per head, by averaging the heads before scoring. Cheaper to select and coarser in what it keeps, since heads that attend to different regions are served by a single compromise.
Worth trying when selection is itself a visible share of the cost, which happens on models with many heads.
Also the first thing to try when a model breaks up into bands under sparse attention: some architectures need every head to see one consistent context, and per-head selection is what breaks them.

Disabled by default.","ui":"settings_cuda"}, + {"id":"","label":"Sparse Attention excluded models","localized":"","hint":"Models that stay dense no matter how the rest of this section is set. Comma separated, matched case insensitively against the architecture, the pipeline class and the denoiser class, so whichever of those names is to hand works as an entry.
The class names appear in the model load log; the architecture is the short name used elsewhere in the settings, such as f1 or anima.

Listed by default is CosmosTransformer3DModel, the transformer Anima runs, which collapses into banded noise when each head selects its own tiles and stays degraded even with Sparse Attention share selection across heads enabled. The class is listed rather than the architecture because the other models built on it have not been checked.
A model whose output breaks up rather than merely softening belongs here.

Default CosmosTransformer3DModel.","ui":"settings_cuda"} ], "t": [ {"id":"txt2img_nav","label":"T2I","localized":"","hint":"Create image from text
Legacy interface that mimics original text-to-image interface and behavior"},