Robots |
1 | 8027 | 54.72 | robots |
2 | 2773 | 18.90 | compatible Mozilla/5.0 |
3 | 1404 | 9.57 | MauiBot (crawler.feedback+wc@gmail.com) |
4 | 1305 | 8.90 | DotBot/1.1 |
5 | 199 | 1.36 | YandexBot/3.0 |
6 | 182 | 1.24 | SemrushBot/2~bl |
7 | 146 | 1.00 | bingbot/2.0 |
8 | 127 | 0.87 | Googlebot/2.1 |
9 | 99 | 0.67 | Linux x86_64 |
10 | 62 | 0.42 | SemrushBot/1.2~bl |
11 | 60 | 0.41 | Cliqzbot/2.0 |
12 | 56 | 0.38 | AhrefsBot/5.2 |
13 | 32 | 0.22 | MJ12bot/v1.4.8 |
14 | 27 | 0.18 | ia_archiver |
15 | 22 | 0.15 | linkdexbot/2.2 |
16 | 19 | 0.13 | netEstate NE Crawler (+http://www.websit... |
17 | 12 | 0.08 | CCBot/2.0 (http://commoncrawl.org/faq/) |
18 | 11 | 0.07 | BUbiNG (+http://law.di.unimi.it/BUbiNG.h... |
19 | 10 | 0.07 | SeznamBot/3.2 |
20 | 10 | 0.07 | Pinterestbot/1.0 |
21 | 10 | 0.07 | ltx71 - (http://ltx71.com/) |
22 | 9 | 0.06 | Exabot/3.0 |
23 | 9 | 0.06 | Go-http-client/1.1 |
24 | 8 | 0.05 | archive.org_bot |
25 | 6 | 0.04 | spbot/5.0.3 |
26 | 6 | 0.04 | Mediatoolkitbot (complaints@mediatoolkit... |
27 | 4 | 0.03 | linkdexbot/2.0 |
28 | 4 | 0.03 | MSIE 9.0 |
29 | 3 | 0.02 | SiteExplorer/1.1b |
30 | 3 | 0.02 | Plukkie/1.6 |
31 | 3 | 0.02 | MSIE 10.0 |
32 | 3 | 0.02 | SurdotlyBot/1.0 |
33 | 2 | 0.01 | Firefox/47.0.1 |
34 | 2 | 0.01 | cis455crawler |
35 | 2 | 0.01 | SEOkicks-Robot |
36 | 2 | 0.01 | SMTBot/1.0 |
37 | 2 | 0.01 | Daum/4.1 |
38 | 2 | 0.01 | MSIE 8.0 |
39 | 1 | 0.01 | eright/1.0 |
40 | 1 | 0.01 | nutch-1.4/Nutch-1.4 |
41 | 1 | 0.01 | - |
42 | 1 | 0.01 | AHC/1.0 |
43 | 1 | 0.01 | Firefox/2.0.0.2 |
44 | 1 | 0.01 | Firefox/3.0.0.11 |