keepfloor

confirmedupstream bugC++ · llama.cppInference & servingJuly 13, 2026

the question

Do the CPU and ggml-backend paths of top_p and min_p agree on the min_keep floor?

what came out

The ggml-backend top_p and min_p graphs never reference min_keep, so with min_keep>=2 the offloaded path drops the survivor floor. Over 144 cells, 78 diverge and the backend set is always a strict subset of the CPU set, while all 48 min_keep in {0,1} cells agree exactly.

method & receipts

Result: confirmed
Pre-registered — the prediction was written down and committed before the run.
Reproducible — one script re-runs the whole thing from scratch.
Tested — a correctness/benchmark suite ships alongside the code.

→ read the code and re-run it

github.com/v-code01/keepfloor