ai-crawlers
Detecting AI Bot Traffic in Server Logs
Classifies AI crawler traffic in your server logs so you can measure which agents crawl you and how much — free to try.
Free · download5 downloads
Quick answer
Classifies AI crawler traffic in your server logs so you can measure which agents crawl you and how much — free to try.
What this skill does
You can't manage AI crawler access you can't see. This skill parses server-log user-agents, classifies the known AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot, Bytespider…), and reports share of crawl per agent — the visibility layer under any access policy. Free to try.
Get Detecting AI Bot Traffic in Server Logs
Free to download — drops straight into .claude/skills/.