I have this same reaction sometimes, I don't have the desire to eat a full meal with protein and fat, but a little candy is palatable. It's probably not a good idea overall to be honest, it would be better to just "save up" hunger for a more balanced meal.