Very true. In fact, there's a lot more under the surface that will come to light once more efficient tiny models come out.
P.S. Building something that proves that you don't need those many params even.
https://github.com/guilt/tinytot
The premise of your project seems compelling. Is it novel or building on existing work? Anything one could read or watch to get introduced to that area of research?
The premise of your project seems compelling. Is it novel or building on existing work? Anything one could read or watch to get introduced to that area of research?