Using “goy” as a stand-in for — say — “plebs” is the anti-Semitic piece, because it implies that Jews treat non-Jews as lesser, discriminate against them, and that’s it’s common enough as to be standard usage. I am willing to believe op doesn’t know Amodei is Jewish, hadn’t thought through the implications (even if Amodei wasn’t), and didn’t mean anything by it, but it’s not just a harmless phrase for “commoners”
Altman and Amodei are both a) nasty pieces of work, b) bona fide jews of matrilineal descent, & c) treat damn near everyone as "outsiders" (i.e. goyim), so use of the word goyim is a component of the truth. You are criticizing and policing the truth. In the short-run, truth can be buried. In the long-run, it always wins. So keep shoveling. We can wait.