alt Hacker NewsI'd be very interested in how a scratch trained model that started training with this neural circuitry would behave. Especially the storage space.
Replies
qwertyforce • today at 4:10 AM
As I understand, the problem of continual learning is that if you continue training, it will "overwrite" previous knowledge and this CPU will be lost
➕ show 2 replies
Along these lines I’m curious how a scratch trained model with a few built-in tools (memory, calculator, ?) available during a single generation would behave. Not tool calls as turns.