The HP LX series (95LX, 100LX, 200LX) is one of my favorites. It also fits the description "smaller than VHS casette"

https://en.wikipedia.org/wiki/HP_95LX

https://en.wikipedia.org/wiki/HP_200LX