AlphaZero works in simple and fully observable environments like board games.

RLVR for LLMs works for coding and math domains which can be verified by code.

AlphaZero, RLVR and other RL methods don't work for learning dextrous manipulation for robotics, for example. Learning in robotics depends on human data.