| | | |
|---|
| -- | Suchmaschine | |
AAfter | AAfter looks like a legit search engine. () | Suchmaschine | |
AboutUsBot | AboutUsBot is used by the About Us website to determine the contents, aspect, logo and owner of a website. It is legit. | Suchmaschine | |
aiHitBot | aiHitBot, seems to be a legit search engine. () | Suchmaschine | |
ia_archiver | Alexa ia_archiver () | Suchmaschine | |
almaden | almaden, Unstructured Information Analysis and Search @ IBM () | Suchmaschine | |
Scooter | AltavistaBot, Altavista () | Suchmaschine | |
aport | Aport () | Suchmaschine | |
appie | Appie-spider/Walhello () | Suchmaschine | |
ApptusBot | ApptusBot is the Apptus crawler bot, some business driven search engine. () | Suchmaschine | |
Ask Jeeves | Ask Jeeves, Teoma () | Suchmaschine | |
askpeter_bot | Ask Peter is a German based search engine () | Suchmaschine | |
ASPseek | ASPSeek () | Suchmaschine | |
Baiduspider | Baidu search engine web crawler. Not always respectful of robots.txt, sometimes a bit pushy as well. () | Suchmaschine | |
BecomeBot | BecomeBot shopping search () | Suchmaschine | |
Blazer | Blazer Browser, Sharp Zaurus () | Suchmaschine | |
CatchBot | CatchBot is a business page crawler. They claim to resell information for companies, academics and various professional fields. Bot behaves correctly. | Suchmaschine | |
abby/ | Ellerdale determines trends through the semantic web, usually through gathering recent Twits or Facebook entries. () | Suchmaschine | |
ExaBot | Exlead Exabot () | Suchmaschine | |
facebookexternalhit | Facebook External Hit () | Suchmaschine | |
fast | FAST-WebCrawler () | Suchmaschine | |
sitedossier.com | Featuring sitedossier.com as a referer, the IP 69.71.222.186 seems to check for websites recently crawled by one of their competitors, domaintools. Seems harmless. () | Suchmaschine | |
feedfetcher | Feedfetcher Google, gathers news feeds from websites () | Suchmaschine | |
Feedtrace-bot | Feedtrace-bot makes a list of the most popular twitter feeds (parses the most recent feeds all time round). () | Suchmaschine | |
ftxbrowser | ftxBrowser, Windows CE () | Suchmaschine | |
gais | Gais () | Suchmaschine | |
Gigabot | Gigablast's Gigabot () | Suchmaschine | |
Mediapartners | Google AdSense () | Suchmaschine | |
Google Desktop | Google Desktop is a desktop data manager/search. It should be harmless. () | Suchmaschine | |
googlebot | Googlebot () | Suchmaschine | |
ichiro | ichiro @ Goo Japan / Inktomi () | Suchmaschine | |
IconSurf | Icon Surf () | Suchmaschine | |
ICRA_Semantic_spider | ICRA semantic spider, Internet Content Rating association. () | Suchmaschine | |
infoseek | InfoSeek () | Suchmaschine | |
JS-Kit | JS-Kit is a blabla software for blogs. It usually connects here and there to promote their stuff through curiosity. For that reason no URL is provided here. | Suchmaschine | |
Linguee Bot | Linguee Bot is a legit search engine bot. However it WILL get banned from your Beamreactor enabled website for its extreme crawling speed with the argument 'flood'. () | Suchmaschine | |
LinkWalker | LinkWalker () | Suchmaschine | |
grub | Looksmart/Grub () | Suchmaschine | |
Mail.RU | mail.ru (Поиск@mail.ru) is tied to the mail.ru search engine () | Suchmaschine | |
MJ12bot | Majestic-12 distributed search engine bot () | Suchmaschine | |
MetaQuerier | MetaQuerier (University of Illinois in Urbana-Champaign) () | Suchmaschine | |
bingbot | Microsoft Bing () | Suchmaschine | |
Media Center PC 5.0 | Microsoft EnhanceIE enables Windows users to mod their useragents and emulate other user agents (!?) () | Suchmaschine | |
MLbot | MLBot is a mp3/video crawler. The true purpose of MLbot is undisclosed but might be related to piracy protection. This robot is fairly clean. () | Suchmaschine | |
Yahoo-MMCrawler | MM Crawler, seeks for images on the www. () | Suchmaschine | |
MOT-A768 | Motorola A768 browser client. Might be fairly harmless. | Suchmaschine | |
msnbot | MSN Search Crawler () | Suchmaschine | |
MSTV | MSTV WebTV () | Suchmaschine | |
MyIE2 | MyIE2 @ turkey? | Suchmaschine | |
netcraft | Netcraft () | Suchmaschine | |
Naverbot | NHN Corp bot/Naver.com () | Suchmaschine | |
Ocelli | Ocelli Engineering search () | Suchmaschine | |
OnetSzukaj | OnetSzukaj () | Suchmaschine | |
avantgo | PalmOs AvantGo () | Suchmaschine | |
PSbot | Picsearch web crawler () | Suchmaschine | |
plucker | Plucker Browser, Windows CE () | Suchmaschine | |
Plukkie | Plukkie: a search engine robot, fairly harmless. () | Suchmaschine | |
pompos | Pompos () | Suchmaschine | |
Moo | qsdfqs () | Suchmaschine | |
quepasacreep | QuePasaCreep () | Suchmaschine | |
StackRambler | Rambler search robot () | Suchmaschine | |
RSScache | RSS Cache website bandwith saver () | Suchmaschine | |
SapphireWebCrawler | SapphireWebCrawler crawls for a computer science project from Carnegie Mellon university. | Suchmaschine | |
scrubby | scrubby () | Suchmaschine | |
Shim | Shim Crawler (University of Tokyo) () | Suchmaschine | |
slurp | Slurp () | Suchmaschine | |
spbot | spbot; "we just want to find out to which web pages you link to" () | Suchmaschine | |
Speedy Spider | Speedy Spider is a part of the highly advanced search engine Entireweb.com, that was developed in Halmstad, Sweden during 1998-2000. () | Suchmaschine | |
sproose | Sproose Crawler () | Suchmaschine | |
Apple-PubSub | The PubSub client is checking your RSS for an Apple computer owner! Don't remove or block this client/IP. () | Suchmaschine | |
bnf.fr_bot | This robot comes from the National French Library. It makes a web archive of your website for various reasons and may, or may not respect robots.txt according to its settings. Harmless nonetheless. () | Suchmaschine | |
seznambot | Tied to the Seznam Czech search engine. () | Suchmaschine | |
turnitin | Turn It In () | Suchmaschine | |
Twiceler | Twiceler is the legit Cuil search engine crawler () | Suchmaschine | |
Twingly Recon | Twingly Recon is a RSS parser, focused towards blogs. Usually triggered with syndication tools, such as facebook / twitter post third party APIs. () | Suchmaschine | |
Twitturls | Twitter URL parser. Someone linked your content to twitter. () | Suchmaschine | |
Vagabondo | Vagabondo () | Suchmaschine | |
VideoSurf_bot | VideoSurf bot looks for videos. It uses social webs to parse URLs to visit, so its visit might be related to some of your website data being posted on Twitter or FB | Suchmaschine | |
VoilaBot | VoilaBot is from the Voila search engine, owned by The "France Telecom - Orange" group. Basically harmless. () | Suchmaschine | |
Jigsaw | W3C CSS validator - JFouffa () | Suchmaschine | |
W3C_Validator | W3C Validator () | Suchmaschine | |
WMP | Windows Media Player | Suchmaschine | |
Xenu Link Sleuth | Xenu Link Sleuth validates your website for dead links () | Suchmaschine | |
Yahoo! Mindset | Yahoo Mindset () | Suchmaschine | |
Yandex | Yandex. I at the end refers to search. H looks for mirror copies, P for images, F for favicons, D for Yandex declared websites, B for RSS () | Suchmaschine | |
YandexSomething | YandexSomething searches for news related RSS feeds for their news system. () | Suchmaschine | |
zyborg | Zyborg () | Suchmaschine | |
