I honestly really don't care about models with new capabilities.

What I *really* need for my clients are good enough LLMs that can offer speed and maximum privacy/zero data retention, especially in Europe.

Right now I'm stuck in the loop of data -> pseudo anonymization on privately owned hardware (very expensive) -> third party LLM -> de-anonymize (map back to original content) -> show result.

It's expensive, error prone, and all I need to do are the same things I could do (or 99% of) with some Azure/AWS/Google APIs.

But what these scalers offer is still not good enough, especially for European users. We can't risk having a US judge or agency force those people to handle our data.