You get better performance if you also finetune it for your task