CalamitousFelicitousness 7cd9fbc321 fix(offload): budget pinned memory from available ram ...

The guard compared component size against half of total system memory and
silently dropped to unpinned streaming above that. Total is the wrong
quantity: a component that fits comfortably in free memory gets denied, and
unpinned leaf streaming is slow out of proportion to its size because every
per-leaf transfer pays staging cost.

Budget against memory free at apply time less a reserve, and cache the
verdict on the module since a granted pin lowers the same reading it derives
from. A denied pin now also drops streams and falls back to block_level,
since leaf plus stream is only the right shape when weights are pinned, and
logs the per-step transfer volume so the cost of the slow path is visible up
front.

2026-08-10 22:10:42 +01:00

..

apg

fix(pipelines): restore clip-skip text encoding for transformers 5.6+

2026-06-25 02:25:33 +01:00

api

fix api-control

2026-08-10 20:43:50 +02:00

ben2

full codespell coverage

2026-06-04 12:36:10 +02:00

caption

prompt enhance and caption use llm-context

2026-08-04 14:21:53 +02:00

cfgzero

strict ruff without exclude

2026-05-11 08:36:49 +02:00

civitai

refactor(model): simplify probe cache handling

2026-07-11 20:26:12 +01:00

control

detailer.next

2026-08-09 15:05:00 +02:00

detailer

improve handling of hf auth

2026-08-10 10:55:25 +02:00

face

fix(lora): apply te networks before encode and honor lora_apply_te

2026-07-08 03:06:04 +01:00

flash_attn_triton_amd

full codespell coverage

2026-06-04 12:36:10 +02:00

framepack

video: support for scripts/extensions

2026-07-28 10:43:58 +02:00

ggml

full codespell coverage

2026-06-04 12:36:10 +02:00

hidiffusion

full codespell coverage

2026-06-04 12:36:10 +02:00

image

upscaler auto-refresh on fail

2026-07-16 14:09:10 +02:00

intel

Update IPEX and ROCm to Torch 2.13

2026-07-15 04:05:26 +03:00

linfusion

cleanup logger

2026-02-19 11:09:13 +01:00

lora

fix(lora): apply native networks in place under group offload

2026-08-10 22:10:42 +01:00

ltx

add prompt enhance to ltx and fix audio

2026-07-28 13:11:21 +02:00

merging

linting

2026-07-03 22:05:33 +02:00

onnx_impl

remove directml

2026-08-10 13:43:45 +02:00

openai

add experimental openai interface

2026-07-02 14:36:44 +02:00

pag

fix(pipelines): restore clip-skip text encoding for transformers 5.6+

2026-06-25 02:25:33 +01:00

postprocess

video processing preserve audio

2026-07-27 14:23:14 +02:00

ras

Revert "much stricter ruff linting"

2026-05-11 08:13:57 +02:00

rembg

rembg add lucida

2026-07-30 14:39:30 +02:00

res4lyf

update sampler behavior and user definable fallback

2026-06-08 17:00:00 +02:00

rife

full codespell coverage

2026-06-04 12:36:10 +02:00

schedulers

schedulers fix zero-sigma final-step

2026-07-06 13:21:19 +02:00

seedvr

video processing preserve audio

2026-07-27 14:23:14 +02:00

sharpfin

update ruff and lint

2026-07-24 18:20:41 +02:00

taesd

linting

2026-07-03 22:05:33 +02:00

teacache

strict ruff without exclude

2026-05-11 08:36:49 +02:00

todo

full codespell coverage

2026-06-04 12:36:10 +02:00

vae

separate progress monitoring from live preview, live preview improvements, progress details

2026-08-07 11:41:40 +02:00

video_models

Move SDNQ to upstream SDNQ repo

2026-08-10 12:13:10 +03:00

__init__.py

refactor imports

2026-02-19 15:28:24 +01:00

attention.py

Move SDNQ to upstream SDNQ repo

2026-08-10 12:13:10 +03:00

cachedit.py

cleanup logger

2026-02-19 11:09:13 +01:00

call_queue.py

profiling updates

2026-07-26 19:35:56 +02:00

cmd_args.py

remove directml

2026-08-10 13:43:45 +02:00

devices_mac.py

mps install torchsde

2026-06-20 08:15:35 +02:00

devices.py

fix(offload): reclaim model memory across switches

2026-08-10 22:10:42 +01:00

enso.py

run enso extension installer after clone and update

2026-03-20 21:43:44 +00:00

errorlimiter.py

Typing cleanup

2026-05-17 10:41:09 -07:00

errors.py

profiling updates

2026-07-26 19:35:56 +02:00

extensions.py

register submodule as package

2026-08-10 12:06:33 +02:00

extra_networks.py

fix(lora): apply te networks before encode and honor lora_apply_te

2026-07-08 03:06:04 +01:00

extras.py

fix ui/misc: None desc crash, ratio/tile/lora split guards, parse_metadtaa typo, moondream type guard

2026-06-12 13:00:50 -04:00

files_cache.py

profiling updates

2026-07-26 19:35:56 +02:00

generation_parameters_copypaste.py

Fix assorted small typos: dead __str__, unformatted messages, preview min-height, tooltip

2026-06-11 01:42:29 -04:00

gr_hijack.py

gradio temp files guard

2026-05-16 07:19:52 +02:00

gr_tempdir.py

gradio temp files guard

2026-05-16 07:19:52 +02:00

hashes.py

validate reference, lint and update diffusers

2026-04-15 10:10:05 +02:00

history.py

remove process preview

2026-04-29 07:59:43 +02:00

images.py

Revert "much stricter ruff linting"

2026-05-11 08:13:57 +02:00

img2img.py

detailer.next

2026-08-09 15:05:00 +02:00

infotext_utils.py

ruff lint

2026-02-19 11:13:44 +01:00

infotext.py

fix(sampler): record and restore Default instead of the None sentinel

2026-08-10 02:44:56 +01:00

ipadapter.py

refactor detailer

2026-07-04 11:17:56 +02:00

json_helpers.py

model metadata handle invalid keys

2026-06-29 11:23:29 +02:00

lama.py

unified logger

2026-02-19 09:46:42 +01:00

loader.py

register submodule as package

2026-08-10 12:06:33 +02:00

localization.py

cleanup logger

2026-02-19 11:09:13 +01:00

logger.py

improve server monitor and profiling

2026-08-05 12:19:07 +02:00

masking.py

fix rembg dependencies

2026-07-21 08:20:55 +02:00

memmon.py

torch reset dynamo cache on model reload

2026-08-04 10:58:32 +02:00

memstats.py

fix model/vae: wrong quant_config var, getattr guards, remote-vae latent_copy shadowing + response handling

2026-06-12 13:00:39 -04:00

migrate.py

unified logger

2026-02-19 09:46:42 +01:00

mit_nunchaku.py

refactor uv support

2026-05-28 11:54:08 +02:00

model_probe.py

feat(model): detect header metadata and nvfp4 in the model probe

2026-07-12 03:44:54 +01:00

model_quant.py

Add Lloyd-Max quantization with use_codebook

2026-08-10 22:51:32 +03:00

model_te.py

fix model/vae: wrong quant_config var, getattr guards, remote-vae latent_copy shadowing + response handling

2026-06-12 13:00:39 -04:00

model_tools.py

cleanup logger

2026-02-19 11:09:13 +01:00

modeldata.py

mage placeholder

2026-07-24 15:15:51 +02:00

modelloader.py

cleanup

2026-08-10 11:13:28 +02:00

models_hf.py

reorder env vars

2026-08-10 00:43:15 +02:00

modelstats.py

add storage analyzer

2026-08-02 11:22:12 +02:00

modular_guiders.py

cleanup logger

2026-02-19 11:09:13 +01:00

modular.py

cleanup logger

2026-02-19 11:09:13 +01:00

olive_script.py

modernize typing

2026-02-19 09:15:37 +01:00

options_handler.py

fix(api): set compatibility options without crashing

2026-06-25 02:25:33 +01:00

options.py

unified logger

2026-02-19 09:46:42 +01:00

para_attention.py

cleanup logger

2026-02-19 11:09:13 +01:00

patches.py

add wildcards to image metadata and note separate template from prompt field

2026-05-19 09:45:20 +02:00

paths_internal.py

ruff lint

2026-02-19 11:13:44 +01:00

paths.py

chore: rename probe cache files to signatures.json and civitai.json

2026-07-12 03:44:19 +01:00

platform_linux.py

optimize sdnq quant-on-load and add platform stats

2026-06-07 11:43:46 +02:00

platform.py

optimize sdnq quant-on-load and add platform stats

2026-06-07 11:43:46 +02:00

postprocessing.py

process button busy tracking

2026-07-22 09:39:55 +02:00

processing_args.py

fix(lora): apply te networks before encode and honor lora_apply_te

2026-07-08 03:06:04 +01:00

processing_callbacks.py

separate progress monitoring from live preview, live preview improvements, progress details

2026-08-07 11:41:40 +02:00

processing_class.py

fix: dead hasattr-on-dict path, double video-vae normalization, undefined self.device, hyimage if/elif, attention-mask attr typo, wrong face logged

2026-06-12 13:00:57 -04:00

processing_correction.py

add hidream-o1

2026-05-10 21:45:58 +02:00

processing_diffusers.py

feat(offload): on-demand vae under group offload

2026-08-10 22:10:42 +01:00

processing_grading.py

fix lut

2026-05-07 07:20:20 +02:00

processing_helpers.py

feat(samplers): group sampler dropdown into labeled sections

2026-06-14 01:41:05 +01:00

processing_info.py

fix(sampler): record and restore Default instead of the None sentinel

2026-08-10 02:44:56 +01:00

processing_prompt.py

fix skip processing

2026-07-19 10:52:55 +02:00

processing_vae.py

feat(offload): on-demand vae under group offload

2026-08-10 22:10:42 +01:00

processing_video.py

feat(video): video_interpolate as execution-time stage

2026-04-26 03:08:07 +01:00

processing.py

remove sdnq_dequantize_compile option

2026-08-10 13:30:56 +03:00

progress.py

separate progress monitoring from live preview, live preview improvements, progress details

2026-08-07 11:41:40 +02:00

prompt_parser_diffusers.py

fix(lora): apply te networks before encode and honor lora_apply_te

2026-07-08 03:06:04 +01:00

prompt_parser_xhinker.py

fix(prompt): restore textual inversion on clip-skip>=2

2026-06-25 02:25:33 +01:00

prompt_parser.py

fix processing: init_images hasattr typo, empty-list guards, dead timer profile branch

2026-06-12 13:00:31 -04:00

rocm_triton_windows.py

refactor imports

2026-02-19 15:28:24 +01:00

rocm.py

rocm: detect hipBLASLt lazy library in per-arch subfolder and zlib form

2026-07-07 23:12:04 +03:00

safe.py

linting

2025-10-16 19:39:05 -04:00

script_callbacks.py

Move functions to match new execution order

2026-04-27 17:15:05 -07:00

script_loading.py

cleanup logging

2026-06-02 08:03:27 +02:00

scripts_auto_postprocessing.py

modernize typing

2026-02-19 09:15:37 +01:00

scripts_manager.py

video: support for scripts/extensions

2026-07-28 10:43:58 +02:00

scripts_postprocessing.py

add process video

2026-07-20 21:44:43 +02:00

scripts.py

video: support for scripts/extensions

2026-07-28 10:43:58 +02:00

sd_checkpoint.py

model metadata handle invalid keys

2026-06-29 11:23:29 +02:00

sd_detect.py

mage placeholder

2026-07-24 15:15:51 +02:00

sd_hijack_accelerate.py

fix hijack accelerate

2026-06-29 15:26:25 +02:00

sd_hijack_dynamic_atten.py

remove directml

2026-08-10 13:43:45 +02:00

sd_hijack_freeu.py

remove directml

2026-08-10 13:43:45 +02:00

sd_hijack_hfhub.py

improve handling of hf auth

2026-08-10 10:55:25 +02:00

sd_hijack_hypertile.py

fix(hypertile): correct width/height mapping in hires set_resolution

2026-06-15 15:20:07 -04:00

sd_hijack_safetensors.py

unified logger

2026-02-19 09:46:42 +01:00

sd_hijack_schedulers.py

add ideogram prequant and set default schedule

2026-06-08 17:20:12 +02:00

sd_hijack_te.py

triton/dynamo/inductor cache location and timer stats

2026-07-15 15:06:40 +02:00

sd_hijack_transformers.py

complete refactor javascript to typescript and reorg frontend files and folders

2026-05-20 18:08:10 +02:00

sd_hijack_triton.py

remove directml

2026-08-10 13:43:45 +02:00

sd_hijack_utils.py

modernize typing

2026-02-19 09:15:37 +01:00

sd_hijack_vae.py

add boogu

2026-07-04 15:26:36 +02:00

sd_hijack.py

initial pyright lint

2026-02-21 09:32:36 +01:00

sd_models_compile.py

cleanup lint

2026-07-15 20:30:27 +02:00

sd_models_utils.py

add storage analyzer

2026-08-02 11:22:12 +02:00

sd_models.py

fix(offload): reclaim model memory across switches

2026-08-10 22:10:42 +01:00

sd_modules.py

…

sd_offload_aux.py

detailer.next

2026-08-09 15:05:00 +02:00

sd_offload.py

fix(offload): budget pinned memory from available ram

2026-08-10 22:10:42 +01:00

sd_samplers_common.py

separate progress monitoring from live preview, live preview improvements, progress details

2026-08-07 11:41:40 +02:00

sd_samplers_diffusers.py

feat(samplers): add DPM++ 3M SDE preset

2026-06-14 01:42:26 +01:00

sd_samplers.py

feat(samplers): group sampler dropdown into labeled sections

2026-06-14 01:41:05 +01:00

sd_te_remote.py

RUF013 updates and typing update

2026-03-24 05:19:51 -07:00

sd_unet.py

feat(model): secondary unet override slot and ideogram4 native loading

2026-07-11 06:40:07 +01:00

sd_vae.py

vae_scale_factor override

2026-06-20 10:49:43 +02:00

server.py

switch to internally managed uvicorn

2026-08-06 13:24:48 +02:00

shared_defaults.py

remove directml

2026-08-10 13:43:45 +02:00

shared_helpers.py

unified logger

2026-02-19 09:46:42 +01:00

shared_items.py

mage placeholder

2026-07-24 15:15:51 +02:00

shared_legacy.py

- all guidance values set to -1 to enable using model defaults

2026-05-16 11:06:23 +02:00

shared_state.py

separate progress monitoring from live preview, live preview improvements, progress details

2026-08-07 11:41:40 +02:00

shared.py

remove directml

2026-08-10 13:43:45 +02:00

storage.py

add storage analyzer

2026-08-02 11:22:12 +02:00

styles.py

upscaler auto-refresh on fail

2026-07-16 14:09:10 +02:00

sub_quadratic_attention.py

modernize typing

2026-02-19 09:15:37 +01:00

textual_inversion.py

fix(embeddings): restore multi-vector textual inversion expansion

2026-06-25 02:25:33 +01:00

theme.py

add legacy notice

2026-06-20 21:18:35 +02:00

timer_sdnq.py

Move SDNQ to upstream SDNQ repo

2026-08-10 12:13:10 +03:00

timer.py

seedvr enhancements

2026-07-21 15:59:45 +02:00

token_merge.py

cleanup logging and update requirements

2026-03-13 13:02:41 +01:00

transformer_cache.py

cleanup

2026-07-21 16:04:10 +02:00

txt2img.py

detailer.next

2026-08-09 15:05:00 +02:00

ui_caption.py

css updates

2026-07-13 15:52:55 +02:00

ui_common.py

separate progress monitoring from live preview, live preview improvements, progress details

2026-08-07 11:41:40 +02:00

ui_components.py

full codespell coverage

2026-06-04 12:36:10 +02:00

ui_control_elements.py

fix(control): remove inert DWPose (Legacy) pose-model selector

2026-06-22 10:28:59 -04:00

ui_control_helpers.py

update masking

2026-05-19 11:56:20 +02:00

ui_control.py

detailer.next

2026-08-09 15:05:00 +02:00

ui_definitions.py

feat(offload): per-component group offload engine

2026-08-10 22:10:42 +01:00

ui_docs.py

pylint

2026-02-19 11:36:20 +01:00

ui_extensions.py

handle invalid extension

2026-07-01 18:59:20 +02:00

ui_extra_networks_checkpoints.py

networks avoid slow yield

2026-08-01 09:10:15 +02:00

ui_extra_networks_history.py

networks avoid slow yield

2026-08-01 09:10:15 +02:00

ui_extra_networks_lora.py

feat(krea2): add Krea 2 (K2) image model support

2026-06-23 04:41:54 +01:00

ui_extra_networks_styles.py

networks avoid slow yield

2026-08-01 09:10:15 +02:00

ui_extra_networks_textual_inversion.py

cleanup references to p.sd_model

2026-02-19 20:48:42 +01:00

ui_extra_networks_unet.py

networks avoid slow yield

2026-08-01 09:10:15 +02:00

ui_extra_networks_vae.py

networks avoid slow yield

2026-08-01 09:10:15 +02:00

ui_extra_networks_wildcards.py

cleanup

2026-07-27 21:30:40 +02:00

ui_extra_networks.py

separate progress monitoring from live preview, live preview improvements, progress details

2026-08-07 11:41:40 +02:00

ui_gallery.py

ui fixes

2026-05-21 09:23:10 +02:00

ui_guidance.py

- all guidance values set to -1 to enable using model defaults

2026-05-16 11:06:23 +02:00

ui_history.py

show_progress requires "full", "minimal", or "hidden"

2025-11-28 02:27:19 -08:00

ui_img2img.py

detailer.next

2026-08-09 15:05:00 +02:00

ui_javascript.py

update handlers for all authenticated workflows

2026-08-09 22:47:17 +02:00

ui_loadsave.py

refactor imports

2026-02-19 15:28:24 +01:00

ui_models_load.py

cleanup

2026-06-01 11:54:26 +02:00

ui_models.py

improve ui models

2026-07-08 14:50:29 +02:00

ui_postprocessing.py

process button busy tracking

2026-07-22 09:39:55 +02:00

ui_prompt_styles.py

…

ui_sections.py

Merge pull request #4971 from vladmandic/fix/resolution-ar-controls

2026-07-01 11:07:57 +02:00

ui_settings.py

remove directml

2026-08-10 13:43:45 +02:00

ui_storage.py

add storage analyzer

2026-08-02 11:22:12 +02:00

ui_symbols.py

gallery add thumbnail size slider

2026-05-04 09:03:50 +02:00

ui_txt2img.py

detailer.next

2026-08-09 15:05:00 +02:00

ui_video_vlm.py

video: support for scripts/extensions

2026-07-28 10:43:58 +02:00

ui_video.py

modernui update

2026-07-28 11:10:29 +02:00

ui.py

networks load/download model track progress

2026-05-08 14:43:39 +02:00

update.py

Fix url formatting in update module

2025-11-08 14:54:34 -08:00

upscaler_algo.py

PIL Image.Image type fix

2026-04-06 01:06:19 -07:00

upscaler_simple.py

ty lint

2026-05-11 09:34:17 +02:00

upscaler_spandrel.py

PIL Image.Image type fix

2026-04-06 01:06:19 -07:00

upscaler_vae.py

PIL Image.Image type fix

2026-04-06 01:06:19 -07:00

upscaler.py

video processing preserve audio

2026-07-27 14:23:14 +02:00

video.py

process add video info and metadata

2026-07-19 14:37:20 +02:00

zluda_installer.py

Revert "Avoid using args as a variable name"

2026-03-05 20:17:44 -08:00

zluda.py

unified logger

2026-02-19 09:46:42 +01:00