alt Hacker NewsHow do you ensure the kid is learning the right material? You want them to stay on topic, but a Socratic Method that starts off on one topic can easily branch into many other topics, and then suddenly your student has spent the whole class learning about something other than what they were supposed to.
All learning is good, yes. But a baseline curriculum is necessary to create a ground floor of knowledge for society.
Replies
For a current-day LLM, deviation could be measured as the number of tokens since the agent touched on the prompted topic. A specific <<refocus>> token could even be trained so that a harness or other tooling could direct the LLM back towards the prompted topic if needed.
Or something roughly like that. Generally speaking the goal would be for the LLM to bring the topic back on its own while incorporating the tangent, but a hardcoded, "Let's get back on track" button would probably be needed
Just run a loop with another agent that watch the transcript and trigger tool to refocus on the main agent or re-run agent entirely with follow up prompt not visible to the user so it gradually goes back to the right topic.