svdscale

the question

Does PEFT add_weighted_adapter's svd combination apply each LoRA adapter's scaling factor exactly once?

what came out

PEFT add_weighted_adapter's svd family (the default) multiplies each adapter weight by target.scaling and then sums get_delta_weight tensors, which already carry scaling, applying it twice. At the standard lora_alpha=2r the merged adapter is exactly twice too strong; the cat path applies scaling once.

→ read the code and re-run it