Robots |
1 | 25920 | 85.91 | robots |
2 | 1390 | 4.61 | DotBot/1.1 |
3 | 800 | 2.65 | SemrushBot/6~bl |
4 | 452 | 1.50 | SemrushBot/7~bl |
5 | 294 | 0.97 | BLEXBot/1.0 |
6 | 248 | 0.82 | YandexBot/3.0 |
7 | 219 | 0.73 | bingbot/2.0 |
8 | 195 | 0.65 | Googlebot/2.1 |
9 | 125 | 0.41 | AhrefsBot/6.1 |
10 | 105 | 0.35 | SemrushBot-BA |
11 | 97 | 0.32 | MJ12bot/v1.4.8 |
12 | 76 | 0.25 | compatible Mozilla/5.0 |
13 | 63 | 0.21 | ltx71 - (http://ltx71.com/) |
14 | 42 | 0.14 | Barkrowler/0.9 |
15 | 40 | 0.13 | SemrushBot-BM/1.0 |
16 | 19 | 0.06 | ia_archiver |
17 | 18 | 0.06 | CCBot/2.0 (https://commoncrawl.org/faq/) |
18 | 16 | 0.05 | Go-http-client/1.1 |
19 | 11 | 0.04 | SeznamBot/3.2 |
20 | 8 | 0.03 | Linux x86_64 |
21 | 7 | 0.02 | Linespider/1.1 |
22 | 6 | 0.02 | oBot/2.3.1 |
23 | 5 | 0.02 | Pinterestbot/1.0 |
24 | 4 | 0.01 | Turnitin (https://bit.ly/2UvnfoQ) |
25 | 2 | 0.01 | Wget/1.19.4 (linux-gnu) |
26 | 2 | 0.01 | facebookexternalhit/1.1 (+http://www.fac... |
27 | 1 | 0.00 | python-requests/2.25.0 |
28 | 1 | 0.00 | MSIE 10.0 |
29 | 1 | 0.00 | Python-urllib/3.7 |
30 | 1 | 0.00 | GarlikCrawler/1.2 (http://garlik.com/, c... |
31 | 1 | 0.00 | Wget/1.20.3 (linux-gnu) |
32 | 1 | 0.00 | Seekport Crawler |