Skip to main content
← Lab

muonspectral

confirmedshipPythonModel behavior & reasoningJuly 21, 2026

the question

What are the full fixed-point dynamics of Muon's Newton-Schulz iteration, and does it actually orthogonalize the momentum matrix?

what came out

Newton-Schulz has three repelling positive fixed points and no stable one, so it never converges to orthogonal. Below 1.2637 singular values fall onto a period-4 attractor band [0.68, 1.13], a 1.66x anisotropic rescaling (bf16 equals fp32); above it they diverge, held off by a rank-1-tight 26.4% Frobenius margin.

method & receipts

  • Result: confirmed
  • Tested — a correctness/benchmark suite ships alongside the code.

→ read the code and re-run it

github.com/v-code01/muonspectral