You could just put your website content behind its own chat interface. The crawler would just see a form input for a prompt.