Is this just a theory about an architecture or are there actually some benchmarks/results to substantiate it?
not sure w/o context why this is important -- no results/implementation & i believe there are prior combinations of transformers/RNNs. but perhaps I'm missing the relevance/insight
I thought it's about https://en.wikipedia.org/wiki/Autotransformer
Paper written by AI