mirror of
https://github.com/vladmandic/automatic
synced 2026-09-13 10:08:43 +02:00
a2daf9027c
Hosting a non-factorable set costs one truncated svd per layer on every fresh apply. The factors are deterministic in the checkpoint, the loaded set, the host rank and the calibration statistics, so they persist under data/lora-factor-cache keyed by that identity and replay bit-identically on later applies. lora_sdnq_host_cache sets the disk budget in GB (0 disables), least-recently-used entries are evicted past it. With the cost paid once per configuration, svd subspace iterations rise from 2 to 4: about two thirds of the captured-energy gap to an exact decomposition for +45% one-time compute; an exact svd measures 200-400x slower at these shapes and is not viable. - modules/lora/lora_factor_cache.py: signature, store, flush, eviction - lora_sdnq.apply_hosted: fetch before computing, store after, hits in the load summary - cli/lora-quant-fidelity.py: matching niter for the hosted mirror - test/test-sdnq-lora-factors.py: factor-cache category, 3 tests