With all of the speak about ChatGPT and different AI bots, do you know that there’s an OpenAI ChatGPT bot and it respects the robots.txt protocol? So in order for you, you may block OpenAI’s ChatGPT bot from crawling, indexing and utilizing your content material and information out of your web site. This may block the ChatGPT plugins particularly.

Mike King noticed this and posted about it on Twitter, you may see the official documentation over right here. It reads:

ChatGPT-Person is utilized by plugins in ChatGPT. This user-agent will solely be used to take direct actions on behalf of ChatGPT customers and isn’t used for crawling the online in any automated vogue.

Person agent token: ChatGPT-Person
Full user-agent string: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); appropriate; ChatGPT-Person/1.0; +https://openai.com/bot
To permit plugins to entry your website you may explicitly add the ChatGPT-Person to your website’s robots.txt:

Here’s a screenshot of the doc, in case it adjustments sooner or later:

Once more, if you don’t need OpenAI to make use of your website’s information for its AI and ChatGPT, you may disallow it in your robots.txt file. Though, I’m not certain how real-time that is and if as soon as OpenAI consumed the content material, will it then take away it after-the-fact?

Discussion board dialogue at Twitter.