Files
automatic/modules/lora
CalamitousFelicitousness 28bd5e8d74 fix(lora): materialize balanced-offload modules before touching weights
Under a pressed balanced offload, dispatched modules hold meta tensors
whose data lives in the accelerate offload map. The factor path raised
trying to move a meta svd tensor and aborted activation mid-pass; the
legacy requantize path silently skipped those layers. Both left the
model with a partially applied network.

Rebuild the offload state with apply_balanced_offload(force) at
activate and deactivate entry: modules come back real on cpu with
hooks intact and the execution device unchanged, so both paths see
usable tensors and the next forward re-onloads under the watermark.
2026-08-10 02:42:28 +01:00
..
2026-07-03 22:05:33 +02:00
2026-07-24 18:20:41 +02:00
2026-02-19 09:15:37 +01:00
2026-02-19 11:09:13 +01:00
2026-02-19 09:15:37 +01:00
2026-06-04 12:36:10 +02:00
2024-11-29 08:01:26 -05:00