An AI product should probably start with knowing what model (e.g., arch, version, quant, etc.) you're actually using. Opaque providers make that quite hard.
People are constantly complaining about GPT/Claude constantly changing under their apps without notice.