Files
automatic/test
CalamitousFelicitousness 09e861157f fix(offload): hand back the loaded cpu tensors on no-stream offload
Group hooks on the no-stream path and the on-demand hook return a
component to cpu through a device copy, so a memory-mapped text encoder
sits in memory twice, as the mapped file its never-run vision tower
keeps alive and as the copies, and every encode pays a device-to-host
transfer of unchanged weights. The engine now records the cpu tensors
at onload and hands them back at offload; a component moved by any
other path still takes the copy.
2026-09-16 01:57:23 +01:00
..
2026-02-10 14:31:53 +01:00
2026-04-21 19:24:24 +02:00
2026-08-16 12:45:50 +02:00
2026-04-01 10:29:08 +02:00
2026-08-17 14:35:52 +02:00
2026-07-04 15:26:36 +02:00