Yep. Everyone here is talking about "just use the website" but ANZ Plus, a "neo-bank" which is increasingly popular here in Australia, literally has no web portal.

Its app is really nice and native, though. That, along with a decent interest rate, is why I use it.