There's a lot of individual effort of improving the models. See how many finetuned models and LoRAs are there on Hugging Face.
fine-tuning a model is very different from training the whole model in terms of resource requirements.
fine-tuning a model is very different from training the whole model in terms of resource requirements.