Robots (25 / 25) [show full report] |
1 | 576 | 40.97 | compatible Mozilla/5.0 |
2 | 210 | 14.94 | DotBot/1.1 |
3 | 179 | 12.73 | Yahoo! Slurp |
4 | 168 | 11.95 | msnbot/2.0b (+http://search.msn.com/msnb... |
5 | 122 | 8.68 | Googlebot/2.1 |
6 | 28 | 1.99 | msnbot-media/1.1 (+http://search.msn.com... |
7 | 22 | 1.56 | Baiduspider+(+http://www.baidu.com/searc... |
8 | 18 | 1.28 | Jyxobot/1 |
9 | 17 | 1.21 | Googlebot-Image/1.0 |
10 | 13 | 0.92 | MLBot (www.metadatalabs.com/mlbot) |
11 | 10 | 0.71 | NaverBot/1.0 |
12 | 6 | 0.43 | Exabot/3.0 |
13 | 6 | 0.43 | MJ12bot/v1.3.2 |
14 | 6 | 0.43 | Ask Jeeves/Teoma |
15 | 4 | 0.28 | yousearch/Nutch-1.1-dev |
16 | 4 | 0.28 | oBot |
17 | 3 | 0.21 | Snapbot/1.0 (Snap Shots, +http://www.sna... |
18 | 3 | 0.21 | librabot/2.0 (+http://academic.research.... |
19 | 2 | 0.14 | msnbot/2.0b (+http://search.msn.com/msnb... |
20 | 2 | 0.14 | CCBot/1.0 (+http://www.commoncrawl.org/b... |
21 | 2 | 0.14 | msnbot/2.0b (+http://search.msn.com/msnb... |
22 | 2 | 0.14 | ia_archiver-web.archive.org |
23 | 1 | 0.07 | Python-urllib/1.16 |
24 | 1 | 0.07 | page_test (larbin2.6.3@unspecified.mail) |
25 | 1 | 0.07 | Baiduspider+(+http://www.baidu.jp/spider... |