Spot prices for 5 year old A100s are still going up recently, because inference is so valuable. This meme that GPUs are a quickly depreciating asset is outdated.