If you don't require an air gapped system your funds would go a lot further joining an HPC cluster if you have one available through your institution.
Having done all three over my career (local machines as student, University's HPC cluster as grad/postgrad and eventually cloud in the private sector), I'd 100% rent out compute. Buying a custom rig for local ML training makes zero sense in 2026. With renting you'll be able to train bigger models/datasets faster on much better hardware while paying far less in total. Especially if you're doing project-based work.
As a scientist with a big workstation and access to several HPCs I can say that there is nothing better than having a powerful workstation. Yes, doing some sort of long runs is better on a cluster, but being able to do things locally without queue delays and various limitations imposed by HPCs is extremely valuable for initial development/experiments.