After building some toy LLMs on my own I came to realise that architecture is not the hard part. Train is.
That's easy to say AFTER you know the architecture.
Einstein special relativity is taught these days in high-schools. Doesn't mean it wasn't the very hard part at some point in time.
As they say, shoulders of giants.
alt Hacker News
That's easy to say AFTER you know the architecture.
Einstein special relativity is taught these days in high-schools. Doesn't mean it wasn't the very hard part at some point in time.
As they say, shoulders of giants.