mirror of
https://github.com/vladmandic/automatic
synced 2026-09-18 00:34:33 +02:00
CalamitousFelicitousness
6c0dd0b15f
Non-additive families (lokr, loha, oft, dora, full) merged into the quantized weight and lost most of their delta on low-bit formats. On sub-8-bit layers the set's calc_updown delta now rides the svd side-channel as its top singular directions instead: factorable members are subtracted out and appended exactly, so only the non-factorable remainder is truncated. Truncation keeps the dominant part of the effect and drops an orthogonal residual, where requantize keeps the grid extrema and adds grid-shift noise of the delta's own magnitude; on real lokr files retention rises from 0.04 to about 0.5 at the default rank. Hosted layers take no weight backup and unload bit-exactly. The svd runs under a forked rng so generation seeds are unaffected. At 8 bits and above requantize retains most of the delta and remains the path. lora_sdnq_host_rank caps the hosted rank; 0 disables hosting.