← Lab
gatehorizon
confirmedshipPython · PyTorch bfloat16Model behavior & reasoningJuly 25, 2026
the question
Can a bfloat16-stored decay gate represent slow-forgetting memory half-lives?
what came out
In bfloat16 near 1 the gate spacing is 2^-8, so any target decay below 2^-9 snaps to exactly 1.0 (never forgets) and the longest finite half-life is ln2*2^8=177.4. Half-lives in (177.4, inf) are unreachable and targets between 177 and 355 collapse to 177.4. Absent in fp32.
method & receipts
- Result: confirmed
- Reproducible — one script re-runs the whole thing from scratch.
- Tested — a correctness/benchmark suite ships alongside the code.
→ read the code and re-run it
github.com/v-code01/gatehorizon