You are posing a question that requires deductive reasoning. LLMs can only approximate that if they have sufficient corpus to find their way to a believable response. Their willingness to spout bullshit in such scenarios where their sources are sparse is a problem but you can't expect them to function like a fully developed mind.