It depends on the season, but they tend to have too much acid at first. Leaving them in the fridge reduces the acid over time improves the flavor profile. But really you should refrigerate all citrus.