Web Bots 2026 - Web Spider List

Web Bots Live 2026 List - The list below names all known web bots and web spiders on the internet using spider web sites for search engineers and others. It includes Google Bot, Yahoo Bot, Bing Bots, Baidu Bots, Robots, etc.  Read More
Also you can see:
     - Google/Yahoo/Bing bots IP Addresses
     - List of unknown bots that are being masked as normal users
     - List of all web user agents (more then 600,000 user agents are listed in our database)

Online IP Check      Export to Text File »      1 - 50  of  11,581 records   No Web Bot / Spider Total Known IP Addresses who have used this User Agent 1 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 117,897 ip 2 Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php) 54,857 ip 3 SirdataBot 31,402 ip 4 Googlebot/2.1 (+http://www.google.com/bot.html) 16,909 ip 5 Clickagy Intelligence Bot v2 15,442 ip 6 Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) 14,422 ip 7 Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) 7,784 ip 8 Mozilla/5.0 (compatible; Cliqzbot/1.0 +http://cliqz.com/company/cliqzbot) 6,888 ip 9 Mozilla/5.0 (compatible; BomboraBot/1.0; +http://www.bombora.com/bot) 6,833 ip 10 A6-Indexer/1.0 (http://www.a6corp.com/a6-web-scraping-policy/) 6,826 ip 11 Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) 4,903 ip 12 Mozilla/5.0 (compatible; AhrefsBot/5.1; +http://ahrefs.com/robot/) 4,525 ip 13 Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html 4,482 ip 14 Mozilla/5.0 (compatible; Genieo/1.0 http://www.genieo.com/webfilter.html) 4,283 ip 15 Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) 4,113 ip 16 Mozilla/5.0 (compatible; Cliqzbot/2.0; +http://cliqz.com/company/cliqzbot) 4,043 ip 17 Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot) 3,140 ip 18 Screaming Frog SEO Spider/9.2 3,131 ip 19 CCBot/2.0 (http://commoncrawl.org/faq/) 2,804 ip 20 Mozilla/5.0 (iPhone; CPU iPhone OS 60 like Mac OS X) AppleWebKit/536.26 (KHTML like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 2,536 ip 21 YisouSpider 2,533 ip 22 Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) 2,518 ip 23 Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) 2,171 ip 24 Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) 2,149 ip 25 Mozilla/5.0 (compatible; Cliqzbot/1.0; +http://cliqz.com/company/cliqzbot) 1,939 ip 26 Googlebot/2.1 (+http://www.googlebot.com/bot.html) 1,919 ip 27 Googlebot-Video/1.0 1,877 ip 28 Mozilla/5.0 (compatible; Googlebot/2.1;+http://www.google.com/bot.html) 1,814 ip 29 Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; http://www.tropicdesigns.net) 1,803 ip 30 Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 1,790 ip 31 Mozilla/5.0 (compatible; AhrefsBot/5.2; +http://ahrefs.com/robot/) 1,706 ip 32 Mozilla/5.0 (Linux; Android 7.0; SM-G930V Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.125 Mobile Safari/537.36 (compatible; Google-Read-Aloud; +https://support.google.com/webmasters/answer/1061943) 1,685 ip 33 Mozilla/5.0 (compatible; 008/0.85; http://www.80legs.com/webcrawler.html) Gecko/2008032620 1,647 ip 34 SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) 1,575 ip 35 Mozilla/5.0 (iPhone; U; CPU iPhone OS 41 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML like Gecko) Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) 1,474 ip 36 msnbot/2.0b (+http://search.msn.com/msnbot.htm) 1,444 ip 37 Mozilla/5.0 (compatible; URLAppendBot/1.0; +http://www.profound.net/urlappendbot.html) 1,370 ip 38 DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) 1,338 ip 39 ClaudeBot 1,308 ip 40 Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 1,239 ip 41 Mozilla/5.0 (iPhone; CPU iPhone OS 60 like Mac OS X) AppleWebKit/536.26 (KHTML like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) 1,225 ip 42 Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider 1,208 ip 43 CCBot/2.0 (https://commoncrawl.org/faq/) 1,176 ip 44 Mozilla/5.0 (compatible; DomainAppender /1.0; +http://www.profound.net/domainappender) 1,151 ip 45 Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com) 1,128 ip 46 Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36 1,100 ip 47 msnbot-media/1.1 (+http://search.msn.com/msnbot.htm) 1,088 ip 48 Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) 1,031 ip 49 Mozilla/5.0 (compatible; GoogleDocs; apps-spreadsheets; +http://docs.google.com) 1,014 ip 50 Mozilla/5.0 (compatible; AhrefsBot/6.1; +http://ahrefs.com/robot/) 977 ip 1 - 50  of  11,581 records   Please wait...