A crawler visiting your docs won't help a human decide to pay for your commercial service advertised on those docs.