alt Hacker NewsAs an evolutionary cousin of a rat, the half-second delay after firing my weapon and the response would make me want to eat my whiskers.
This would completely kill any potential reward (and replace it with the opposite, frustration) you're trying to train me with, please fix immediately.
Replies
One of the most important traits of intelligence is understanding and appreciating delayed reward.
I saw a gambler win the jackpot. He was really excited and started gathering up all the chips he'd won. Why he was so excited to win a bunch of plastic chips, I'll never know. What's so great about plastic chips? Why was his brain so excited when all he was doing was gathering plastic chips? ...
A half-second delay doesn't mean your brain can't learn to make the precursor feel good.
Lol you are correct! At least training them becomes smoother the faster you administer reward. Learning happens at different timescales in the brain, and immediate feedback (about <300 ms) yields the most reliable neural updates.