logoalt Hacker News

tyleotoday at 11:23 AM0 repliesview on HN

I often push past 300k or so and I’ve absolutely worked at 800k but it’s an observable problem. Large context windows can work depending on the problem but I do feel more effective biasing towards small ones <300k.