logoalt Hacker News

wehnsdaefflaetoday at 9:12 AM1 replyview on HN

Maybe they want to be tokenizer agnostic? Then they would need to go by character count, right? Despite these inconsistencies, has anyone actually verified their promise? 350 vs. 10.000 tokens would still be very valuable even if they mess up some edge cases


Replies

wannabe44today at 9:41 AM

Oh it is not returning full tool schema. You can't cut down that much by serialisation alone.