New AI Crawlers Seen in November 2026
Nine crawlers no bot list named yet, from an undocumented Alibaba bot to an anonymous crawler on 158 addresses in one day. What each sent and how to handle it.
bot-detectionInsights and updates on AI bot detection, web security, and digital threat mitigation. Discover best practices for protecting your online properties from automated threats and malicious bots.
Understand AI traffic: follow our curated learning path →
Post 1 through 6 of 95 total posts
Nine crawlers no bot list named yet, from an undocumented Alibaba bot to an anonymous crawler on 158 addresses in one day. What each sent and how to handle it.
bot-detectionKeep GPTBot, ClaudeBot, CCBot and other AI training crawlers off WordPress with an automatic robots.txt, and refuse the ones that ignore it.
tutorialMeasure visits from ChatGPT, Perplexity, Claude and Gemini on WordPress: what Google Analytics shows, what it misses, and a free plugin that counts them.
tutorial
A valid account can still drive automated scraping and feature abuse. Use WebDecoy request evidence, actor journeys, and route controls after login.
security
We joined a controlled ARTEX WebFetch with threat.gg model-plane telemetry to show what the framework reveals on both sides of an agent run.
security
In 90 days, two sites we run logged 5,259 requests for .env files and other secrets under names like ClaudeBot and Googlebot. One name is fake by definition.
security