> ollama benchmark ... for now, it's purely CPU, with DeepSeek R1 models tested based on the RAM available.
Then the results aren't comparable across different boards across RAM sizes. It'd be better to test a set of different model sizes on all and report -- if it didn't fit. But could you report the full ollama model name and version size slug for each?
> I pull Jeff's fork of the ollama-benchmark software
A link would be nice.
The BPI-R4 is great for use as a 10G WAN router if your ISP uses PPPoE since the network processing engine has hardware acceleration for it.
Unifi released the UCG-Fiber around a year ago that can also apparently finally handle it, but plenty of threads about slow performance with their UDMs since it's entirely done on the CPU [0].
I'm not the biggest fan of OpenWRT and would prefer something like OPNSense, but it's x86 only and good PPPoE performance isn't guaranteed either - need a CPU with good single core performance that costs more than the BPI-R4, or apparently virtualizing OPNSense allows it to process PPPoE with multiple threads.
0: https://community.ui.com/questions/What-is-the-max-performan...
I basically stopped buying SBCs several years ago, are there any SoC platforms that have mainline Linux support these days? Or is x86 still the way to go?
I find it really weird that it's not until you get to the $200 range that anything has USB-C DP Alt mode support. You'd have though that anyone trying to squeeze space would want to drop full-size HDMI or DisplayPort ports at the first opportunity.
I wish comparisons would get into whether or not drivers have been upstreamed far enough where it is possible to run real Linux distros. And whether or not they've made braindead choices about boot device ordering.
please make llm.cpp benchmark on this same model
It would be better if there was a table summarized it all.
[dead]
I really wish these lists would talk about software support. If I buy these, do they have mainline Linux support? Will I have security patches in a year? Is there decent distro support, or am I stuck with the vendor's half broken default image?