OAI-SearchBot
AI search crawler operated by OpenAI
54.1%
Not from OpenAI
67
Verified source IPs
23
Impostor source IPs
Published IP ranges
Verification
Measured across detections recorded by WebDecoy, mostly on WebDecoy's own properties, 2025-11-14 to 2026-08-19. A small sample, not the whole web.
What OAI-SearchBot is
Builds the index behind ChatGPT search results and citations.
It identifies itself with a User-Agent containing OAI-SearchBot/1.0; +https://openai.com/searchbot. Its robots.txt token is OAI-SearchBot , and it is listed as honouring robots.txt. Operator documentation: OpenAI .
How much of this traffic is actually OAI-SearchBot
OpenAI publishes the IP ranges its crawler operates from, so this has a real answer rather than an opinion. We took every request in our corpus declaring this User-Agent and checked its source address against that published list.
| Result | Source addresses | Share of traffic |
|---|---|---|
| Verified. Inside a published OpenAI range | 67 | 45.9% |
| Failed. Outside every published range | 23 | 54.1% |
54.1% of traffic claiming to be OAI-SearchBot could not be traced back to OpenAI. It is something else wearing the name. Most sites wave this User-Agent straight through without checking, which is exactly why the name is worth wearing.
Verifying it yourself
OpenAI publishes the ranges OAI-SearchBot crawls from. Fetch them and test the source address:
# 1. fetch the published ranges
curl -s -o ranges.json \
https://openai.com/searchbot.json
# 2. check an address against them
python3 - 203.0.113.42 <<'PY'
import json, sys, ipaddress
ip = ipaddress.ip_address(sys.argv[1])
data = json.load(open('ranges.json'))
hit = any(ip in ipaddress.ip_network(p.get('ipv4Prefix') or p['ipv6Prefix'])
for p in data['prefixes'])
print('verified' if hit else 'NOT VERIFIED')
PYSwap in the address you are checking. Never trust the User-Agent on its own: it is a header the client picks for itself.
Blocking it
If you want the real crawler to stay away, robots.txt is the polite way to ask:
User-agent: OAI-SearchBot
Disallow: /robots.txt only works on a client willing to obey it, which rules out every request that was already lying about who it is. Stopping those takes enforcement at the network or application layer, keyed on something the client cannot simply retype. That is the problem WebDecoy exists to solve.
Frequently Asked Questions
What is OAI-SearchBot? +
OAI-SearchBot is an ai search crawler operated by OpenAI. Builds the index behind ChatGPT search results and citations.
Is OAI-SearchBot a real crawler or is it being faked? +
Both. OAI-SearchBot is a genuine crawler operated by OpenAI, but 54.1% of the traffic we observed carrying its User-Agent did not come from an IP address in OpenAI's published range list. Only 67 of the source addresses using this name verified against that list; 23 did not.
How do I verify OAI-SearchBot? +
OpenAI publishes the IP ranges OAI-SearchBot uses at https://openai.com/searchbot.json. Check whether the request's source address falls inside one of those prefixes, and reject it if it does not. Never match on the User-Agent alone, because that is the part a client chooses for itself.
How do I block OAI-SearchBot? +
Add a robots.txt rule for the token OAI-SearchBot. That stops the real crawler, but not clients that only borrow its name, so pair it with verification and enforcement at your edge.
Methodology
Every request recorded by WebDecoy's sensors, mostly on WebDecoy's own properties, whose User-Agent declares one of these crawlers, checked IP-by-IP against the operator's own published IP range list. A request is counted as verified when its source IP falls inside a published prefix, and forged when it does not. Operators that publish no machine-readable range list cannot be checked this way and are reported without a forgery figure. Corpus: 81,034 detections from 17,187 distinct addresses, 2025-11-14 to 2026-08-19. Published ranges retrieved 2026-08-19. Operators revise their ranges over time, so a request logged months ago is checked against today's list; we re-ran the comparison over a recent 30-day window and the rates held.
This crawler dataset is licensed under CC BY 4.0; reuse is permitted with attribution to WebDecoy.
Related crawlers
- ChatGPT-User OpenAI
- GPTBot OpenAI
- OAI-AdsBot OpenAI
- Operator OpenAI
- SearchGPT OpenAI
- Aranet-SearchBot Aranet
- AzureAI-SearchBot Microsoft
- BraveSearch Brave
- Claude-SearchBot Anthropic
- DuckAssistBot DuckDuckGo
- Exa Exa AI
- GrokBot xAI
See which OAI-SearchBot requests are real
WebDecoy verifies declared crawlers against what their operators publish and identifies the ones that fail, as persistent actors rather than disposable IPs.