Web Bots Live 2024 List - The list below names all known web bots and web spiders on the internet using spider web sites for search engineers and others. It includes Google Bot, Yahoo Bot, Bing Bots, Baidu Bots, Robots, etc. Read More
Also you can see:
- Google/Yahoo/Bing bots IP Addresses
- List of unknown bots that are being masked as normal users
- List of all web user agents (more then 600,000 user agents are listed in our database)
No
Web Bot / Spider
Total Known IP Addresses who have used this User Agent
1
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
117,740 ip
2
Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php)
54,857 ip
3
SirdataBot
31,402 ip
4
Googlebot/2.1 (+http://www.google.com/bot.html)
16,400 ip
5
Clickagy Intelligence Bot v2
15,441 ip
6
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
14,418 ip
7
Mozilla/5.0 (compatible; Cliqzbot/1.0 +http://cliqz.com/company/cliqzbot)
6,888 ip
8
Mozilla/5.0 (compatible; BomboraBot/1.0; +http://www.bombora.com/bot)
6,832 ip
9
A6-Indexer/1.0 (http://www.a6corp.com/a6-web-scraping-policy/)
6,826 ip
10
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
4,828 ip
11
Mozilla/5.0 (compatible; AhrefsBot/5.1; +http://ahrefs.com/robot/)
4,525 ip
12
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html
4,482 ip
13
Mozilla/5.0 (compatible; Genieo/1.0 http://www.genieo.com/webfilter.html)
4,283 ip
14
Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
4,105 ip
15
Mozilla/5.0 (compatible; Cliqzbot/2.0; +http://cliqz.com/company/cliqzbot)
4,043 ip
16
Screaming Frog SEO Spider/9.2
3,131 ip
17
Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot)
3,108 ip
18
CCBot/2.0 (http://commoncrawl.org/faq/)
2,804 ip
19
Mozilla/5.0 (iPhone; CPU iPhone OS 60 like Mac OS X) AppleWebKit/536.26 (KHTML like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
2,536 ip
20
YisouSpider
2,533 ip
21
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
2,133 ip
22
Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
2,055 ip
23
Mozilla/5.0 (compatible; Cliqzbot/1.0; +http://cliqz.com/company/cliqzbot)
1,939 ip
24
Googlebot/2.1 (+http://www.googlebot.com/bot.html)
1,917 ip
25
Googlebot-Video/1.0
1,844 ip
26
Mozilla/5.0 (compatible; Googlebot/2.1;+http://www.google.com/bot.html)
1,814 ip
27
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; http://www.tropicdesigns.net)
1,803 ip
28
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
1,788 ip
29
Mozilla/5.0 (compatible; AhrefsBot/5.2; +http://ahrefs.com/robot/)
1,705 ip
30
Mozilla/5.0 (compatible; 008/0.85; http://www.80legs.com/webcrawler.html) Gecko/2008032620
1,647 ip
31
SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
1,575 ip
32
Mozilla/5.0 (Linux; Android 7.0; SM-G930V Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.125 Mobile Safari/537.36 (compatible; Google-Read-Aloud; +https://support.google.com/webmasters/answer/1061943)
1,527 ip
33
Mozilla/5.0 (iPhone; U; CPU iPhone OS 41 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML like Gecko) Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
1,474 ip
34
msnbot/2.0b (+http://search.msn.com/msnbot.htm)
1,444 ip
35
Mozilla/5.0 (compatible; URLAppendBot/1.0; +http://www.profound.net/urlappendbot.html)
1,370 ip
36
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
1,338 ip
37
ClaudeBot
1,308 ip
38
Mozilla/5.0 (iPhone; CPU iPhone OS 60 like Mac OS X) AppleWebKit/536.26 (KHTML like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
1,225 ip
39
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
1,222 ip
40
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider
1,208 ip
41
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0
1,162 ip
42
Mozilla/5.0 (compatible; DomainAppender /1.0; +http://www.profound.net/domainappender)
1,151 ip
43
Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36
1,100 ip
44
msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
1,088 ip
45
CCBot/2.0 (https://commoncrawl.org/faq/)
1,066 ip
46
Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
1,031 ip
47
Mozilla/5.0 (compatible; AhrefsBot/6.1; +http://ahrefs.com/robot/)
977 ip
48
acebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
961 ip
49
Mozilla/5.0 (compatible; GoogleDocs; apps-spreadsheets; +http://docs.google.com)
950 ip
50
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/100.0.4896.127 Safari/537.36
842 ip
Reviews and Comments
Please enable JavaScript to view the comments powered by Disqus.
comments powered by
Reviews and Comments
To share this Review on your website/blog simply copy the following html code below and place it in your web page -
Copyright © 2012-2024 Myip.ms. All rights reserved. Updated: 16 May 2024
All or part of the information on this site may be quoted and reproduced by disclosing the source properly (making a link to the Myip.ms)