alt Hacker NewsBoth of the text based demos would have been simpler and faster with traditional mouse and keyboard interactions. What is the AI adding?
Replies
It seems like the natural extension of the (unfortunate) simplification of UIs where everything is "cleanly" hidden behind multiple menus if not removed.
Maybe there’s potential here for certain accessibility scenarios for users who would benefit. But otherwise, leave the mouse cursor alone.
> What is the AI adding?
More $$$ for the PM who launched the product.
They’re going to take your abilities to do anything and spread it across many places so you have to run around to do them, same as all the moneyed technology.
Hype-flavored surveillance!
Yeah it's a gimmick
latency, cost and undefined behavior
It tracks what's on the screen and sends it back to Alphabet. If you're watching a video about BBQ, enjoy a bunch of ads for Omaha steaks and big green egg in your Gmail.
On a less serious note, the audience for this is people who want to optimize for what seems like the least amount of effort.
It feels like everything modern is like this. No value added, just the appearance of it.
The AI is adding that you don’t need to provide a button or menu item or keyboard shortcut for each possible action, or for the user having to know that the command is there and how to access it.
I prefer keyboard operation myself, but I can see how this could become useful in the future, for certain use cases.
What would be useful as well then is if you could bind such a repeatedly-used AI command to button/menu item/keyboard shortcut in a way that it can still be used with pointing “this” and “that”.