Robots |
1 | 14419 | 62.92 | robots |
2 | 4319 | 18.85 | SemrushBot/6~bl |
3 | 2492 | 10.87 | DotBot/1.1 |
4 | 447 | 1.95 | bingbot/2.0 |
5 | 199 | 0.87 | Googlebot/2.1 |
6 | 154 | 0.67 | BLEXBot/1.0 |
7 | 136 | 0.59 | Go-http-client/1.1 |
8 | 122 | 0.53 | SemrushBot-BA |
9 | 109 | 0.48 | AhrefsBot/6.1 |
10 | 109 | 0.48 | compatible Mozilla/5.0 |
11 | 101 | 0.44 | msnbot/2.0b (+http://search.msn.com/msnb... |
12 | 89 | 0.39 | YandexBot/3.0 |
13 | 46 | 0.20 | SemrushBot/1.0~bm |
14 | 34 | 0.15 | SeznamBot/3.2 |
15 | 25 | 0.11 | ia_archiver |
16 | 25 | 0.11 | MJ12bot/v1.4.8 |
17 | 23 | 0.10 | CCBot/2.0 (https://commoncrawl.org/faq/) |
18 | 16 | 0.07 | Sogou web spider/4.0(+http://www.sogou.c... |
19 | 11 | 0.05 | SEOkicks |
20 | 10 | 0.04 | Firefox/2.0.0.6 |
21 | 9 | 0.04 | Pinterestbot/1.0 |
22 | 4 | 0.02 | TurnitinBot (https://turnitin.com/robot/... |
23 | 2 | 0.01 | oBot/2.3.1 |
24 | 2 | 0.01 | linkdexbot/2.0 |
25 | 2 | 0.01 | SafeDNSBot (https://www.safedns.com/sear... |
26 | 2 | 0.01 | eContext/1.0 (eContext Classification En... |
27 | 2 | 0.01 | python-requests/2.22.0 |
28 | 2 | 0.01 | Python-urllib/3.7 |
29 | 1 | 0.00 | Linux x86_64 |
30 | 1 | 0.00 | SurdotlyBot/1.0 |
31 | 1 | 0.00 | HubSpot Links Crawler 2.0 http://www.hub... |
32 | 1 | 0.00 | Opera 9.80 |
33 | 1 | 0.00 | Clarabot/1.4 |
34 | 1 | 0.00 | Seekport Crawler |