alt Hacker NewsGeneral models can run robots. They are very bad at it. It is much more efficient to have a stack of models with 'dumber' but faster models taking care of lower level functions and higher level ones that are much slower taking care of high level planning. Consciousness isn't super fast, but it is very smart. Your 'lizard brain' (to use an overstretched metaphor) and reflexive system are relatively stupid but far faster and condense a whole raft of inputs to something your consciousness can deal with. For robots it isn't all that different. Sensors and actuators require millisecond level responses, that's something you're not going to get out of an LLM on the other side of a communications link.
Replies
> Sensors and actuators require millisecond level responses, that's something you're not going to get out of an LLM on the other side of a communications link.
We've gotten to slightly a frame behind for the models I'm using to play video games - 36ms to get the next action.
The idea is probably not have a frontier model doing this, but to make a frontier model build these out of its own brain (well, directly edit the weights instead of RL tuning).
My team did call these sort of slices of a main brain a "Reflex agent" in similar fashion, since they do not reason only respond.
> General models can run robots. They are very bad at it.
Reminder frontier labs are 6 months ahead of public models internally, if not more
What models actually run? Do they generate the PWM signals/their widths to drive a servo or something? Or is it more like "joystick commands" generator?