As an aside, for someone interested and who's an absolute beginner, can someone please recommend good resources on how to build LLMs from scratch? Thank you in advance.
Check the front page of this god forsaken website a few times a day and you'll get about 10 different posts a day about it.
1. Build an LLM from Scratch by Sebastian Raschka (https://sebastianraschka.com/llms-from-scratch/)
2. LLM from 0 to Hero, and nanoGPT by Andrej Karpathy