Ho thanks for the comment.
Verification does not depend on temperature.
Expert execution is deterministic (pure matmul).
LUMABRI_VERIFY=N re-runs N% of the calls on a second replica and requires byte-identical output.
Temperature (and sampling) happens only on the chatter, after the experts return their activations.
So it can be any value (0, 0.7, 1.2…) without affecting the verification contract.
alt Hacker News
Ho thanks for the comment. Verification does not depend on temperature. Expert execution is deterministic (pure matmul). LUMABRI_VERIFY=N re-runs N% of the calls on a second replica and requires byte-identical output. Temperature (and sampling) happens only on the chatter, after the experts return their activations. So it can be any value (0, 0.7, 1.2…) without affecting the verification contract.