alt Hacker NewsIt is a huge improvement to PPO because you don’t need a separate critic model which cuts memory costs in half and stabilizes training.
It is a huge improvement to PPO because you don’t need a separate critic model which cuts memory costs in half and stabilizes training.
Yes, but monte carlo estimating the critic model is not new.