There is this phenomena where users of a product say they want something. But what they want is very different. People are not good at telling you what really matters to them. That's the main obstacle of Matrix's adaption I think.
Matrix tries to copy-cat all these other products. But in the end it feels like something trying to be all sorts of things and not quite doing it as well as the originals in every way. Plus you have this "confusing" security/crypto aspect. And then you have the whole issue with inconsistencies between clients.
You have to really commit to it, or matrix has to be the backend of some other more refined/specific app (like chat section on websites, like Disqus).
In my opinion, if you want Matrix adaption, stop talking about Matrix adaption, that's like talking about HTTP adaption. You want people to use clients, talk about clients. Let's talk about "Element" adaption. (side-chat: Please make names more searchable. ok, you want to use this generic/confusing term "Element", can you at least make it unique by calling it "Elemnt" with a weird spelling so it's more searchable?)
People don't like learning new and complex systems for the sake of it. It's a chore. I want to be able to tell people "let's use Element" and explain why they should use it. It would help if it had original features other products didn't have that it does really well. It's been over a year since i used Element, but I didn't like the UI at all, it felt like Teams but more clunky? perhaps the mobile app is better, I never tried it.
All that said, I think it's a great system, it's perfect for government systems too. they're not usually concerned about things looking great or having cosmetic features. I would very much prefer to use it over Teams or Slack personally. So long as it handles scheduling meetings, and managing things like booking conference rooms just as well.