I realize it's not a 512, but for context on why I ordered a 96GB. $95/month after a trade in. I'll use it for a long term project where I'm building a national sized dataset/processing video transcripts with a rubric (of churches/sermon health). I'm willing to trade SOTA models for local ones for cost of regenerating/model consistency/ethical reasons.

I'll find other ways to use the power though, opencode or maybe start working on more video projects.