| 126 different robots | Hits | Bandwidth | Last visit |
|---|
| crawl | 1,366,064 | 99.65 GB | 30 Sep 2025 - 23:59 |
| nbot | 346,793 | 52.18 GB | 30 Sep 2025 - 23:59 |
| SemrushBot | 403,663 | 7.54 GB | 30 Sep 2025 - 23:59 |
| Unknown robot identified by bot\* | 1,014,556 | 238.98 GB | 30 Sep 2025 - 23:59 |
| bingbot | 419,738 | 90.12 GB | 30 Sep 2025 - 23:59 |
| AhrefsBot | 399,129 | 12.78 GB | 30 Sep 2025 - 23:59 |
| Googlebot | 201,596 | 23.32 GB | 30 Sep 2025 - 23:59 |
| facebook | 58,948 | 4.72 GB | 30 Sep 2025 - 23:59 |
| facebookexternalhit | 5,270 | 2.38 GB | 30 Sep 2025 - 23:58 |
| Unknown robot identified by \*bot | 45,052 | 35.80 GB | 30 Sep 2025 - 23:58 |
| wordpress | 570 | 24.49 MB | 30 Sep 2025 - 23:58 |
| Applebot | 57,505 | 4.84 GB | 30 Sep 2025 - 23:57 |
| Mediapartners-Google | 1,712 | 81.48 MB | 30 Sep 2025 - 23:57 |
| YandexImages | 1,559 | 128.47 MB | 30 Sep 2025 - 23:57 |
| Baidu ( catchall ) | 4,170 | 528.10 MB | 30 Sep 2025 - 23:56 |
| Baiduspider | 349 | 50.61 MB | 30 Sep 2025 - 23:56 |
| empty user agent string | 3,847 | 458.39 MB | 30 Sep 2025 - 23:54 |
| Dalvik | 1,495 | 5.67 GB | 30 Sep 2025 - 23:53 |
| DotBot | 35,480 | 4.66 GB | 30 Sep 2025 - 23:53 |
| Googlebot-Image | 29,979 | 2.29 GB | 30 Sep 2025 - 23:52 |
| YandexBot | 30,682 | 3.90 GB | 30 Sep 2025 - 23:48 |
| feed | 104,664 | 2.35 GB | 30 Sep 2025 - 23:47 |
| BingPreview | 288 | 18.58 MB | 30 Sep 2025 - 23:41 |
| Feedfetcher-Google | 1,170 | 11.22 MB | 30 Sep 2025 - 23:39 |
| Google Web Preview | 245,871 | 15.25 GB | 30 Sep 2025 - 23:39 |
| core | 5,674 | 717.02 MB | 30 Sep 2025 - 23:34 |
| Yandex ( catchall ) | 18,201 | 992.52 MB | 30 Sep 2025 - 23:33 |
| yeti | 269 | 3.70 MB | 30 Sep 2025 - 23:32 |
| CFNetwork | 808 | 76.93 MB | 30 Sep 2025 - 23:31 |
| Velen | 146 | 2.72 MB | 30 Sep 2025 - 23:24 |
| Pinterestbot | 901 | 21.38 MB | 30 Sep 2025 - 23:16 |
| MojeekBot | 274 | 2.68 MB | 30 Sep 2025 - 23:13 |
| Mediatoolkitbot | 702 | 3.08 MB | 30 Sep 2025 - 23:03 |
| urllib | 841 | 102.34 MB | 30 Sep 2025 - 22:45 |
| Apache-HttpClient | 1,266 | 7.94 MB | 30 Sep 2025 - 22:42 |
| motor | 500 | 86.46 MB | 30 Sep 2025 - 22:29 |
| twitterbot | 1,789 | 40.41 MB | 30 Sep 2025 - 22:19 |
| Python-urllib | 62 | 78.64 MB | 30 Sep 2025 - 22:07 |
| Firefox version 10 and lower - various robots | 991 | 230.36 MB | 30 Sep 2025 - 22:06 |
| phantom | 6 | 28.95 KB | 30 Sep 2025 - 22:06 |
| python | 721 | 464.27 MB | 30 Sep 2025 - 22:06 |
| Go-http-client | 2,380+2 | 1.48 GB | 30 Sep 2025 - 21:42 |
| MJ12bot | 7,250 | 214.79 MB | 30 Sep 2025 - 21:22 |
| Sogou web spider | 814 | 434.28 MB | 30 Sep 2025 - 20:37 |
| Curl | 5,467 | 57.76 MB | 30 Sep 2025 - 20:05 |
| trendiction | 16 | 297.93 KB | 30 Sep 2025 - 19:39 |
| ning | 16 | 665.64 KB | 30 Sep 2025 - 19:17 |
| coccoc | 276 | 15.40 MB | 30 Sep 2025 - 19:12 |
| optimizer | 20 | 19.28 KB | 30 Sep 2025 - 18:28 |
| seek | 7,600 | 799.37 MB | 30 Sep 2025 - 17:02 |
| custo | 3 | 9.10 KB | 30 Sep 2025 - 16:30 |
| SemrushBot-SI | 46 | 1.15 MB | 30 Sep 2025 - 16:26 |
| proximic | 199 | 3.29 MB | 30 Sep 2025 - 16:12 |
| LinkedInBot | 8 | 1.09 MB | 30 Sep 2025 - 15:11 |
| Mozilla ( Rogue Robot ) | 90 | 2.09 MB | 30 Sep 2025 - 14:02 |
| spider | 1,139 | 37.41 MB | 30 Sep 2025 - 13:14 |
| perl | 2 | 8.22 KB | 30 Sep 2025 - 12:53 |
| MSIE 6 - ( Rogue Robot ) | 516 | 9.05 MB | 30 Sep 2025 - 11:34 |
| MixrankBot | 22 | 352.49 KB | 30 Sep 2025 - 07:22 |
| Windows 99 - ( Rogue Robot ) | 470 | 75.41 MB | 30 Sep 2025 - 06:39 |
| SeznamBot | 16 | 1.21 MB | 30 Sep 2025 - 06:33 |
| Barkrowler | 106,022 | 1.60 GB | 30 Sep 2025 - 04:17 |
| scanner | 23 | 189.55 KB | 30 Sep 2025 - 04:15 |
| Java ( catchall ) | 74 | 321.08 MB | 29 Sep 2025 - 21:27 |
| Googlebot-Video | 134 | 823.06 MB | 29 Sep 2025 - 21:10 |
| YisouSpider | 87 | 15.68 MB | 29 Sep 2025 - 20:41 |
| AdsBot-Google | 1,421 | 26.23 MB | 29 Sep 2025 - 20:00 |
| W3C_Validator | 1 | 4.27 KB | 29 Sep 2025 - 18:21 |
| TelegramBot | 30 | 61.33 MB | 29 Sep 2025 - 16:24 |
| robot | 146 | 50.27 MB | 29 Sep 2025 - 10:14 |
| BLEXBot | 234,237 | 16.92 GB | 29 Sep 2025 - 08:15 |
| Wget | 981 | 176.21 MB | 29 Sep 2025 - 06:57 |
| checker | 695 | 3.04 MB | 29 Sep 2025 - 01:33 |
| link | 21,220 | 530.30 MB | 28 Sep 2025 - 21:23 |
| Yahoo Link Preview | 69 | 7.09 MB | 28 Sep 2025 - 03:09 |
| discover | 1 | 4.44 MB | 28 Sep 2025 - 00:30 |
| mozilla/5.0 - ( Rogue Robot ) | 9,107 | 18.21 GB | 27 Sep 2025 - 20:48 |
| Microsoft Office Protocol Discovery | 14 | 38.92 KB | 27 Sep 2025 - 20:38 |
| MSIE 5 - ( Rogue Robot ) | 17 | 2.54 MB | 27 Sep 2025 - 16:39 |
| FirePHP | 19 | 4.17 MB | 27 Sep 2025 - 13:42 |
| nutch ( catchall ) | 5 | 30.72 KB | 27 Sep 2025 - 08:42 |
| zoominfobot | 7 | 68.11 KB | 27 Sep 2025 - 06:47 |
| YandexImageResizer | 22 | 7.17 MB | 27 Sep 2025 - 04:28 |
| bit.ly | 18 | 503.30 KB | 26 Sep 2025 - 18:39 |
| LinkCheck | 7 | 39.13 KB | 25 Sep 2025 - 21:38 |
| webcollage | 4 | 267.15 KB | 25 Sep 2025 - 01:51 |
| SurdotlyBot | 16 | 172.27 KB | 24 Sep 2025 - 23:54 |
| scrapy | 8 | 158.36 KB | 24 Sep 2025 - 16:57 |
| linkchecker | 4 | 14.46 KB | 24 Sep 2025 - 15:20 |
| webcopy | 62 | 2.21 MB | 24 Sep 2025 - 14:41 |
| Yahoo! Slurp | 6 | 415.78 KB | 24 Sep 2025 - 06:48 |
| fetcher | 2 | 55.76 KB | 24 Sep 2025 - 00:40 |
| Discordbot | 33 | 3.73 MB | 24 Sep 2025 - 00:15 |
| MSIE 4 - ( Rogue Robot ) | 3 | 646.24 KB | 23 Sep 2025 - 16:51 |
| microsoft-webdav-miniredir | 5 | 710 Bytes | 23 Sep 2025 - 05:03 |
| dataprovider.com | 110 | 4.13 MB | 23 Sep 2025 - 02:48 |
| yak-linkfluence | 29 | 259.97 KB | 21 Sep 2025 - 14:27 |
| Nautic Expo using Firefox/1.5 | 2 | 138.48 KB | 20 Sep 2025 - 11:38 |
| archive.org_bot | 20 | 425.74 KB | 20 Sep 2025 - 05:25 |
| rome client | 2 | 15.38 KB | 19 Sep 2025 - 22:15 |
| favicon | 1 | 4.50 KB | 18 Sep 2025 - 21:21 |
| FurlBot | 4 | 3.42 MB | 18 Sep 2025 - 18:13 |
| ELinks ( | 2 | 3.52 KB | 18 Sep 2025 - 14:57 |
| Screaming Frog SEO Spider | 7 | 47.40 KB | 18 Sep 2025 - 09:16 |
| CCBot | 5,261 | 172.49 MB | 16 Sep 2025 - 23:00 |
| internetarchive | 3 | 945 Bytes | 16 Sep 2025 - 19:00 |
| ng/2. | 1 | 8.69 KB | 15 Sep 2025 - 12:25 |
| CUBOT | 2 | 63.98 KB | 15 Sep 2025 - 01:47 |
| cursor | 15 | 665.68 KB | 13 Sep 2025 - 14:45 |
| Ruby script | 1 | 20.73 KB | 12 Sep 2025 - 18:27 |
| Seobility | 1 | 694 Bytes | 12 Sep 2025 - 17:48 |
| Konqueror | 6 | 13.08 KB | 11 Sep 2025 - 13:37 |
| netcraft | 4 | 116.55 KB | 10 Sep 2025 - 20:58 |
| FAST-WebCrawler | 1 | 4.28 KB | 10 Sep 2025 - 14:36 |
| Xenu Link Sleuth | 1 | 587 Bytes | 10 Sep 2025 - 02:10 |
| Yahoo! Slurp China | 1 | 587 Bytes | 10 Sep 2025 - 02:10 |
| bubing | 285 | 42.50 MB | 09 Sep 2025 - 18:32 |
| bloglines | 1 | 587 Bytes | 09 Sep 2025 - 14:01 |
| msnbot | 2 | 2.01 KB | 09 Sep 2025 - 14:01 |
| Slackbot-LinkExpanding | 3 | 108.60 KB | 09 Sep 2025 - 14:00 |
| LWP::Simple | 2 | 8.58 KB | 09 Sep 2025 - 07:42 |
| ips-agent | 4 | 60.18 KB | 08 Sep 2025 - 19:49 |
| Googlebot-Mobile | 1 | 7.74 KB | 07 Sep 2025 - 20:59 |
| facebot | 1 | 85.94 KB | 07 Sep 2025 - 07:48 |
| bnf.fr_bot | 3 | 403.61 KB | 02 Sep 2025 - 03:10 |
| Mail.RU Bot | 1 | 4.50 KB | 01 Sep 2025 - 03:37 |
|