OpenAI · Training

GPTBot

Crawls content that may be used to train OpenAI's generative AI foundation models.

Operator
OpenAI
Type
Training · Collect content that may be used to train AI models. Blocking them doesn't remove you from AI search answers.
robots.txt token
GPTBot (case-insensitive)
Follows robots.txt
Yes
User agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot

Verified against OpenAI’s documentation on November 21, 2026.

Should you block GPTBot?

Your call. Blocking GPTBot keeps your content out of future training data and doesn't remove you from AI search answers. Many stores allow it for brand familiarity; many publishers block it.

If you block it: Your content isn't used to train future OpenAI models. It doesn't stop ChatGPT search from citing you; that's OAI-SearchBot.

robots.txt rules for GPTBot

A bot with its own group ignores your User-agent: * rules, so copy any Disallow lines you still need (like /cart) into its group.

Allow GPTBot
User-agent: GPTBot
Allow: /
Block GPTBot
User-agent: GPTBot
Disallow: /

How to verify a request is really GPTBot

Anyone can send a request that claims to be GPTBot. OpenAI publishes the IP ranges it uses: match the request's IP address against that list before trusting it, and before allowing it through a firewall.

Does your site let GPTBot in?

The free report checks your robots.txt against the major AI crawlers and tests whether your firewall lets them through.

Other OpenAI bots

Questions about GPTBot

What is GPTBot?

GPTBot is OpenAI's training bot. Crawls content that may be used to train OpenAI's generative AI foundation models.

Should I block GPTBot?

Your call. Blocking GPTBot keeps your content out of future training data and doesn't remove you from AI search answers. Many stores allow it for brand familiarity; many publishers block it.

What happens if I block GPTBot?

Your content isn't used to train future OpenAI models. It doesn't stop ChatGPT search from citing you; that's OAI-SearchBot.

← All 20 AI crawlers