Bot Identification Dataset
User-agents and IP addresses for 140+ bots and crawlers, sourced directly from their official documentation.
"name": "Bingbot",
"provider": "Microsoft",
"ip_ranges": [
"40.77.177.0/24",
"40.77.178.0/23"
],
"user_agents": [
"Bingbot",
"BingPreview"
]
},
"name": "GPTBot",
"provider": "OpenAI",
"ip_ranges": [
"52.230.152.0/24"
],
"user_agents": [
"GPTBot"
]
}
Why Choose Botective?
Our comprehensive dataset contains detailed information about web crawlers, bots, and scrapers
Structured Dataset
JSON-formatted bot profiles with user-agents and IP ranges, ready for integration.
Frequently Updated
New bots emerge constantly and IPs change frequently. Our regular updates keep the dataset accurate.
Simple Pricing
No subscriptions, no contracts. Purchase updates individually and own them permanently.
Use Case
Built with Botective dataset. Paste your server logs or IP addresses below to identify web crawlers and bots.
AI bots generates billions of requests every day
AI companies bots are the most active crawlers on the web, potentially impacting your site's performance.
With Botective, you can:
- Identify which bots are crawling your site
- Block unwanted bots
- Reduce server load and bandwidth costs
Need reliable bot data?
Get instant access to our curated dataset of 140+ bots with detailed signatures.