Agreed, "distilled variants" might be more suitable.
Calling them variants is also inaccurate when the pretrained base and architecture are completely different.
alt Hacker News
Calling them variants is also inaccurate when the pretrained base and architecture are completely different.