Files
automatic/modules/lora
CalamitousFelicitousness d95ea9e238 fix(lora): support embedding-target LoRA and companion bias deltas
Route nn.Embedding targets (and the SDNQEmbedding / ScaledWordEmbedding subclasses) through the linear LoRA path: the weight delta is up@down over the [vocab, dim] table, same shape and merge as a Linear.

Apply a companion bias delta (diff_b) as ex_bias on the same module rather than dropping it; collect diff_b into the LoRA group so it rides the existing module instead of a separate Full module that would collide on the network key.
2026-06-23 20:40:42 +01:00
..
2026-02-19 09:15:37 +01:00
2026-06-04 12:36:10 +02:00
2026-02-19 11:09:13 +01:00
2026-02-19 09:15:37 +01:00
2026-06-04 12:36:10 +02:00
2024-11-29 08:01:26 -05:00