Not unless you want to cheat the attention mechanism or do extra computations running prefill in a front-truncated version of the conversation.
Also, to the extent that the model reasons and thus learns something, if you blindly truncate the front, you will lose that knowledge. In the OP, the LLM that actually navigated the course successfully only did it on the second try. It it forgot the first failed try, it might not have succeeded :)
alt Hacker News
Not unless you want to cheat the attention mechanism or do extra computations running prefill in a front-truncated version of the conversation.
Also, to the extent that the model reasons and thus learns something, if you blindly truncate the front, you will lose that knowledge. In the OP, the LLM that actually navigated the course successfully only did it on the second try. It it forgot the first failed try, it might not have succeeded :)