Right? Backprop was published in 1986, a year before HyperCard shipped. Attention is newer, but a small model like this was buildable.