Getting (further) into this myself so good timing. Running Qwen 3.6 27B at decent speed on some old cards but going to branch out.

I bough an Octominer for ~$150 which has power and PCIe slots and a basic Celeron and should let me expand to as many GPUs as I want.

I considered the P100s but I think the V100 16GBs are a better deal at $250. The 32GBs are way too much though.