I have replaced a few of my LLM pipelines with gemma4 embedding and a classifier/regression head now. LLMs are actually really good to gather the data and label it with only prompting, but after a while it is just more economic to train your own model.