I don't know the source off hand, but I've seen llms hallucinating case citations in order to "prove" their premises.

can't get more foot gun than "well according to [fiction] it is a well established practice (that the defendent is guilty)"