Would be great if you supported CUDA 12; I don't feel like paying $15K to upgrade my GPU right now
wait another week or so for vLLM's next release
wait another week or so for vLLM's next release