CalamitousFelicitousness 4c85a60c3e perf(lora): skip the discarded init when building lora modules ...

create_module built each up/down module with the default constructor,
which kaiming-initializes the parameter, then copied the stored weight
over the whole thing. The init is thrown away every time and costs about
four times the copy: 22.1ms per module against 2.5ms, or 5.8s against
0.7s over a 264-module lora, on every load.

skip_init constructs on meta and materializes uninitialized, so the copy
still fully defines the parameter. Dtype, device and values are
unchanged, including the fp32 upcast of bf16 files that the copy performs.

2026-08-10 02:42:05 +01:00

..

__init__.py

linting

2026-07-03 22:05:33 +02:00

extra_networks_lora.py

fix(lora): disable diffusers-method loras on removal

2026-07-08 03:06:47 +01:00

lora_apply.py

update ruff and lint

2026-07-24 18:20:41 +02:00

lora_common.py

modernize typing

2026-02-19 09:15:37 +01:00

lora_convert.py

fix(lora): handle flattened clip text model in kohya te keys

2026-07-08 03:05:30 +01:00

lora_diffusers.py

feat(lora): surface method-selection reason in load logs

2026-05-10 00:05:37 +01:00

lora_extract.py

fix(lora): handle flattened clip text model in kohya te keys

2026-07-08 03:05:30 +01:00

lora_load.py

style(lora): drop duplicated file path from per-load debug logging

2026-07-16 01:30:55 +01:00

lora_nunchaku.py

cleanup logger

2026-02-19 11:09:13 +01:00

lora_overrides.py

feat(krea2): add Krea 2 (K2) image model support

2026-06-23 04:41:54 +01:00

lora_timers.py

modernize typing

2026-02-19 09:15:37 +01:00

lyco_helpers.py

full codespell coverage

2026-06-04 12:36:10 +02:00

native_adapter.py

fix(lora): load official diffusers-format Krea 2 LoRAs

2026-07-16 01:30:55 +01:00

network_boft.py

feat(flux2): native BOFT (butterfly-OFT) support

2026-05-10 00:05:37 +01:00

network_full.py

Major lora refactor: works on my machine edition

2024-11-23 21:57:03 -06:00

network_glora.py

fix(lora): set GLora dim so alpha scaling is applied

2026-05-09 22:04:42 +01:00

network_hada.py

feat(lora): add NetworkModuleHadaChunk for fused-weight LoHA targets

2026-05-09 23:16:09 +01:00

network_ia3.py

Major lora refactor: works on my machine edition

2024-11-23 21:57:03 -06:00

network_lokr.py

refactor(lora): move NetworkModuleLokrSliceChunk to network_lokr

2026-05-18 23:18:31 +01:00

network_lora.py

perf(lora): skip the discarded init when building lora modules

2026-08-10 02:42:05 +01:00

network_norm.py

lint fixes

2024-11-29 08:01:26 -05:00

network_oft.py

fix(lora): guard OFT constraint for LyCORIS oft_diag files

2026-05-09 22:04:17 +01:00

network.py

feat(lora): reconstruct the lycoris sparse bias residual triplet

2026-07-14 08:06:45 +01:00

networks.py

fix lint

2026-07-08 09:50:26 +02:00