Skip to main content
← Lab

dropfloor

confirmedshipPython · NumPyModel behavior & reasoningJuly 22, 2026

the question

Does expert-choice MoE routing's perfect load balance come with an exactly conserved coverage deficit and an irreducible drop floor?

what came out

A degree-sum identity gives dropped tokens equal total redundant over-coverage exactly at c=1 (residual 0 to the integer). The distinct-token drop fraction sits on a floor e^{-c} (0.368 at c=1) that correlated scores only worsen (0.66-0.87). Token-choice at matched budget escapes it, vanishing as 1/sqrt(2 pi lambda).

method & receipts

  • Result: confirmed
  • Tested — a correctness/benchmark suite ships alongside the code.

→ read the code and re-run it

github.com/v-code01/dropfloor