One line in robots.txt answers three questions: yes to appearing in search results, yes to being used as a source in AI answers and no to models being trained on the content.