Robots |
1 | 2235 | 44.39 | bingbot/2.0 |
2 | 1896 | 37.66 | worldwebheritage.org/1.1 |
3 | 182 | 3.61 | MJ12bot/v1.4.5 |
4 | 153 | 3.04 | YandexBot/3.0 |
5 | 105 | 2.09 | Googlebot/2.1 |
6 | 89 | 1.77 | compatible Mozilla/5.0 |
7 | 82 | 1.63 | robots |
8 | 48 | 0.95 | worldwebheritage.org/1.0 |
9 | 30 | 0.60 | ia_archiver |
10 | 27 | 0.54 | Linux x86_64 |
11 | 26 | 0.52 | linkdexbot/2.0 |
12 | 24 | 0.48 | coccoc/1.0 |
13 | 23 | 0.46 | Yahoo! Slurp |
14 | 22 | 0.44 | DotBot/1.1 |
15 | 14 | 0.28 | Exabot/3.0 |
16 | 9 | 0.18 | SeznamBot/3.2 |
17 | 7 | 0.14 | archive.org_bot |
18 | 6 | 0.12 | spbot/4.4.2 |
19 | 6 | 0.12 | proximic |
20 | 5 | 0.10 | meanpathbot/1.0 |
21 | 5 | 0.10 | Twitterbot/1.0 |
22 | 5 | 0.10 | AhrefsBot/5.0 |
23 | 4 | 0.08 | CCBot/2.0 (http://commoncrawl.org/faq/) |
24 | 4 | 0.08 | MSIE 8.0 |
25 | 3 | 0.06 | msnbot-media/1.1 (+http://search.msn.com... |
26 | 3 | 0.06 | SemrushBot/0.98~bl |
27 | 2 | 0.04 | linkdexbot/2.2 |
28 | 2 | 0.04 | WBSearchBot/1.1 |
29 | 2 | 0.04 | SMTBot/1.0 |
30 | 2 | 0.04 | MSIE 9.0 |
31 | 2 | 0.04 | Apache-HttpClient/4.3.4 (java 1.5) |
32 | 2 | 0.04 | voltron |
33 | 2 | 0.04 | GrapeshotCrawler/2.0 |
34 | 1 | 0.02 | netEstate NE Crawler (+http://www.websit... |
35 | 1 | 0.02 | Mozilla 1.4a |
36 | 1 | 0.02 | nutch-1.4/Nutch-1.4 |
37 | 1 | 0.02 | MaxPointCrawler/Nutch-1.1 (maxpoint.craw... |
38 | 1 | 0.02 | Lipperhey-Kaus-Australis/5.0 |
39 | 1 | 0.02 | izsearch.com |
40 | 1 | 0.02 | LinqiaScrapeBot/1.0 (eng@linqia.com) |
41 | 1 | 0.02 | Riddler (http://riddler.io/about) |