> the GPUs are consumables on a timeline of ~3-5 years

When newer GPUs with clearly better perf/$ are released at a yearly cadence, then older GPUs might indeed become _obsolete_ at this pace, meaning that it makes more economic sense to swap them out because datacenter occupancy is extremely limited. Many of these GPUs might themselves still be functional.