logoalt Hacker News

teaearlgraycoldyesterday at 10:53 PM2 repliesview on HN

Well the system prompt is probably permanently cached.


Replies

dymktoday at 12:08 AM

Takes up a portion of the context window, though

show 1 reply
wongarsutoday at 12:15 AM

On API pricing you still pay 10% of the input token price on cache reads. Not sure if the subscription limits count this though.

And of course all conversations now have to compact 80 tokens earlier, and are marginally worse (since results get worse the more stuff is in the context)