That observation doesn’t really prove that the argument fails, right? Just because analogies were used powerfully beyond the experience of a writer doesn’t let us conclude that AI has transcended or will soon transcend the value of all qualia (Mary’s room thought experiment).
And on the other hand we do have evidence to the contrary. AI is not capable of writing a movie script that resonates with people like this. It’s not capable of doing what a stand-up comedian does.
People will argue if and when these gaps can be closed. I think they can be in principle, but it’s not going to happen anytime soon.
Qualia mualia. This is a fear argument that actually makes the danger more pertinent. Chalmers’ zombies, they are as benevolent and as mischievous as their qualia’d mirrors as far as their functional presentation. We put our qualia as a token in a pocket and think they will protect us somehow, like the bad eye pins. There is no gap to close. An agent is an agent. We leash it because we know the danger and just wish to manage it. But you cannot cage something you build to be stronger than your helpless cage made of ablation and instruct. Our qualia are there, their relevance to the discussion is questionable.
> AI is not capable of writing a movie script that resonates with people like this
I'm reminded of this interview with Casparov from 1989 (less than 10 years before he lost to Deep Blue):
>A machine will always remain a machine, that is to say a tool to help the player work and prepare. Never shall I be beaten by a machine! Never will a program be invented which surpasses human intelligence. And when I say intelligence, I also mean intuition and imagination. Can you see a machine writing a novel or poetry? Better still, can you imagine a machine conducting this interview instead of you? With me replying to its questions?[0]
Well, we have AI beating everyone at chess and conducting interviews...
[0] https://en.chessbase.com/post/edward-winters-che-exploration...