You know what will never ab test your usage? Local ai. Just saying.
Yep, this.
And with Strata running at 50tok/s on my desktop is all I need. Would I like faster? Sure! But it's super useful in all sorts of tasks now.
100% agree. A local model might not have the same stretch goal capabilities, but at least I don't have to constantly second guess myself in terms of the inconsistencies I think I'm noticing.
No longer am I constantly made to feel like Ingrid Bergman in that movie with all the lights.
I tried it. Nothing local or open weights can touch Fable/Opus/Gemini for my use cases.