See: vagal neurons and vagus nerve. Serotonin from gut directly impacts those. Your brain still directly interprets that signal from the vagus nerve and uses that to up and down regulate mood and arousal. Impact is still significant