Fun idea, Simon!

I wonder if the game state could be sent in an analog/continuous encoding rather than as encoding of a digital state. So that the human player could learn to roughly interpret the sounds, or at least figure out that the sounds are correlated with what’s happening.

That might have a different, possibly satisfying feel compared to the current bloops.

State would not be reconstructed bit-perfect but for a model of a physical system like pong, approximate might be ok.