The point is not that it is something hard to compute that we can only approximate. The point is that there is no well-defined heritability independent of the environmental distribution.