I'll second this approach. I've been using my Miyoo Mini+ quite a bit recently and the complete lack of this sort of bullshit has been very refreshing. No multi-GB game or system updates to download before you can start playing or nags to sign into online services. I can just pick it up and start playing.
I will have to look into the Retroid Pocket. Thanks for the plug.