Token caching might help here, but if it returns the same result, faster, for the same price as priority, seems good
I wonder how parallel token caches are, like when exploring a tree of sample continuations.
alt Hacker News
I wonder how parallel token caches are, like when exploring a tree of sample continuations.