BeamReactor Crawler-Bots-Wissensdatenbank
Anzahl bekannter Bots: 237
| Signatur | Bot | Kategorie | Risiko |
|---|---|---|---|
ImagesiftBot | AI image analysis crawler (Link) | KI-Crawler | |
Anthropic-AI | Anthropic AI services general agent (Link) | KI-Crawler | |
Claude-Web | Anthropic Claude web crawler (Link) | KI-Crawler | |
Bytespider | ByteDance (TikTok) AI crawler (Link) | KI-Crawler | |
CCBot | CCBot, or CommonCrawl bot, claims since 2009 and like many that it'll bring interesting search content for xyz in a near future. It offers nothing but crawling stats. It's CC name misleads to "creative commons" but has NOTHING in common with it. (Link) | KI-Crawler | |
ChatGPT-User | ChatGPT user agent for browsing (Link) | KI-Crawler | |
cohere-ai | Cohere AI language model crawler (Link) | KI-Crawler | |
Diffbot | Diffbot AI extraction and analysis (Link) | KI-Crawler | |
Omgilibot | Omgili conversation analysis bot (Link) | KI-Crawler | |
GPTBot | OpenAI GPT crawler for AI training (Link) | KI-Crawler | |
PerplexityBot | Perplexity AI search crawler (Link) | KI-Crawler |
