Files
automatic/modules
CalamitousFelicitousness 6c0dd0b15f feat(lora): host non-factorable adapters on the sdnq side-channel
Non-additive families (lokr, loha, oft, dora, full) merged into the
quantized weight and lost most of their delta on low-bit formats. On
sub-8-bit layers the set's calc_updown delta now rides the svd
side-channel as its top singular directions instead: factorable members
are subtracted out and appended exactly, so only the non-factorable
remainder is truncated. Truncation keeps the dominant part of the
effect and drops an orthogonal residual, where requantize keeps the
grid extrema and adds grid-shift noise of the delta's own magnitude;
on real lokr files retention rises from 0.04 to about 0.5 at the
default rank.

Hosted layers take no weight backup and unload bit-exactly. The svd
runs under a forked rng so generation seeds are unaffected. At 8 bits
and above requantize retains most of the delta and remains the path.
lora_sdnq_host_rank caps the hosted rank; 0 disables hosting.
2026-08-25 00:25:22 +01:00
..
2026-08-24 09:00:02 +02:00
2026-06-04 12:36:10 +02:00
2026-08-16 12:45:50 +02:00
2026-05-11 08:36:49 +02:00
2026-08-22 11:24:41 +02:00
2026-08-22 11:38:51 +02:00
2026-08-16 12:45:50 +02:00
2026-08-21 10:26:17 +02:00
2026-06-04 12:36:10 +02:00
2026-06-04 12:36:10 +02:00
2026-07-16 14:09:10 +02:00
2026-07-15 04:05:26 +03:00
2026-02-19 11:09:13 +01:00
2026-08-21 10:26:17 +02:00
2026-07-03 22:05:33 +02:00
2026-08-24 18:51:30 +02:00
2026-08-10 13:43:45 +02:00
2026-07-02 14:36:44 +02:00
2026-08-22 20:10:02 +02:00
2026-08-16 12:45:50 +02:00
2026-07-30 14:39:30 +02:00
2026-06-04 12:36:10 +02:00
2026-08-16 12:45:50 +02:00
2026-07-27 14:23:14 +02:00
2026-07-24 18:20:41 +02:00
2026-08-16 12:45:50 +02:00
2026-08-16 12:45:50 +02:00
2026-06-04 12:36:10 +02:00
2026-08-24 18:51:30 +02:00
2026-02-19 15:28:24 +01:00
2026-08-24 19:34:54 +03:00
2026-02-19 11:09:13 +01:00
2026-08-22 11:24:41 +02:00
2026-08-10 13:43:45 +02:00
2026-06-20 08:15:35 +02:00
2026-08-17 08:52:46 +02:00
2026-05-17 10:41:09 -07:00
2026-07-26 19:35:56 +02:00
2026-08-10 12:06:33 +02:00
2026-08-16 12:45:50 +02:00
2026-05-16 07:19:52 +02:00
2026-08-17 08:52:46 +02:00
2026-04-29 07:59:43 +02:00
2026-05-11 08:13:57 +02:00
2026-02-19 11:13:44 +01:00
2026-07-04 11:17:56 +02:00
2026-02-19 09:46:42 +01:00
2026-02-19 11:09:13 +01:00
2026-08-23 09:59:38 +02:00
2026-07-21 08:20:55 +02:00
2026-02-19 09:46:42 +01:00
2026-08-16 12:45:50 +02:00
2026-08-16 12:45:50 +02:00
2026-08-02 11:22:12 +02:00
2026-02-19 11:09:13 +01:00
2026-08-14 15:59:51 +02:00
2026-02-19 11:09:13 +01:00
2026-02-19 09:15:37 +01:00
2026-08-16 12:45:50 +02:00
2026-02-19 09:46:42 +01:00
2026-02-19 11:09:13 +01:00
2026-02-19 11:13:44 +01:00
2026-08-17 08:52:46 +02:00
2026-08-16 12:45:50 +02:00
2026-08-16 12:45:50 +02:00
2026-05-07 07:20:20 +02:00
2026-08-14 15:59:51 +02:00
2026-08-24 10:26:28 +02:00
2026-08-24 18:51:30 +02:00
2026-08-22 11:24:41 +02:00
2026-08-16 12:45:50 +02:00
2026-02-19 15:28:24 +01:00
2026-08-16 12:45:50 +02:00
2026-06-02 08:03:27 +02:00
2026-07-20 21:44:43 +02:00
2026-08-16 12:45:50 +02:00
2026-08-12 14:24:09 +02:00
2026-08-16 12:45:50 +02:00
2026-08-10 13:43:45 +02:00
2026-08-12 14:24:09 +02:00
2026-02-19 09:46:42 +01:00
2026-02-19 09:15:37 +01:00
2026-02-21 09:32:36 +01:00
2026-08-12 14:24:09 +02:00
2026-08-02 11:22:12 +02:00
2026-08-17 10:18:32 +02:00
2025-03-30 15:04:17 -04:00
2026-08-09 15:05:00 +02:00
2026-08-16 12:45:50 +02:00
2026-08-16 12:45:50 +02:00
2026-08-16 12:45:50 +02:00
2026-08-16 12:45:50 +02:00
2026-08-22 11:24:41 +02:00
2026-08-22 16:08:58 +02:00
2026-08-06 13:24:48 +02:00
2026-02-19 09:46:42 +01:00
2026-08-11 23:31:08 +02:00
2026-08-10 13:43:45 +02:00
2026-08-17 08:52:46 +02:00
2026-08-14 15:59:51 +02:00
2026-02-19 09:15:37 +01:00
2026-06-20 21:18:35 +02:00
2026-08-10 12:13:10 +03:00
2026-08-14 09:18:24 +02:00
2026-07-21 16:04:10 +02:00
2026-08-09 15:05:00 +02:00
2026-07-13 15:52:55 +02:00
2026-06-04 12:36:10 +02:00
2026-05-19 11:56:20 +02:00
2026-08-22 11:24:41 +02:00
2026-08-16 12:45:50 +02:00
2026-07-01 18:59:20 +02:00
2026-08-13 15:33:47 +02:00
2026-07-27 21:30:40 +02:00
2026-05-21 09:23:10 +02:00
2026-08-09 15:05:00 +02:00
2026-02-19 15:28:24 +01:00
2026-08-16 12:45:50 +02:00
2026-08-11 12:55:59 +02:00
2026-08-13 15:33:47 +02:00
2026-08-16 12:45:50 +02:00
2026-08-02 11:22:12 +02:00
2026-08-09 15:05:00 +02:00
2026-08-21 10:26:17 +02:00
2025-11-08 14:54:34 -08:00
2026-08-22 11:24:41 +02:00
2026-08-22 11:24:41 +02:00
2026-08-22 11:24:41 +02:00
2026-08-22 20:10:02 +02:00
2026-08-22 20:10:02 +02:00
2026-08-22 20:10:02 +02:00
2026-07-19 14:37:20 +02:00
2026-02-19 09:46:42 +01:00