M5 Pro in a Mac Mini with 64GB RAM and 10Gbit Ethernet seems like the perfect Jellyfin server and Ollama test server. All for just over $3K (I specced with only 1TB local nvme).
Can't say about Ollama but my 2017 Intel NUC 32 GB runs all of the arr and fin stack while it's idling, swimmingly.
Probably worth it for Ollama but you can run Jellyfin off a raspberry pi.