Web Bots 2020 - Web Spider List

Web Bots Live 2020 List - The list below names all known web bots and web spiders on the internet using spider web sites for search engineers and others. It includes Google Bot, Yahoo Bot, Bing Bots, Baidu Bots, Robots, etc.  Read More
Also you can see:
     - Google/Yahoo/Bing bots IP Addresses
     - List of unknown bots that are being masked as normal users
     - List of all web user agents (more then 600,000 user agents are listed in our database)

Online IP Check      Export to Text File »      1 - 50  of  6,009 records   No Web Bot / Spider Total Known IP Addresses who have used this User Agent 1 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 116,664 ip 2 Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php) 54,844 ip 3 SirdataBot 31,348 ip 4 Clickagy Intelligence Bot v2 15,441 ip 5 Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) 14,355 ip 6 Googlebot/2.1 (+http://www.google.com/bot.html) 7,130 ip 7 Mozilla/5.0 (compatible; Cliqzbot/1.0 +http://cliqz.com/company/cliqzbot) 6,888 ip 8 Mozilla/5.0 (compatible; BomboraBot/1.0; +http://www.bombora.com/bot) 6,831 ip 9 A6-Indexer/1.0 (http://www.a6corp.com/a6-web-scraping-policy/) 6,826 ip 10 Mozilla/5.0 (compatible; AhrefsBot/5.1; +http://ahrefs.com/robot/) 4,509 ip 11 Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html 4,464 ip 12 Mozilla/5.0 (compatible; Genieo/1.0 http://www.genieo.com/webfilter.html) 4,283 ip 13 Mozilla/5.0 (compatible; Cliqzbot/2.0; +http://cliqz.com/company/cliqzbot) 4,043 ip 14 Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) 3,768 ip 15 Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) 3,295 ip 16 Screaming Frog SEO Spider/9.2 3,131 ip 17 CCBot/2.0 (http://commoncrawl.org/faq/) 2,804 ip 18 Mozilla/5.0 (iPhone; CPU iPhone OS 60 like Mac OS X) AppleWebKit/536.26 (KHTML like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 2,536 ip 19 YisouSpider 2,532 ip 20 Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) 1,979 ip 21 Mozilla/5.0 (compatible; Cliqzbot/1.0; +http://cliqz.com/company/cliqzbot) 1,939 ip 22 Googlebot/2.1 (+http://www.googlebot.com/bot.html) 1,897 ip 23 Mozilla/5.0 (compatible; Googlebot/2.1;+http://www.google.com/bot.html) 1,814 ip 24 Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; http://www.tropicdesigns.net) 1,803 ip 25 Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 1,770 ip 26 Googlebot-Video/1.0 1,738 ip 27 Mozilla/5.0 (compatible; AhrefsBot/5.2; +http://ahrefs.com/robot/) 1,697 ip 28 Mozilla/5.0 (compatible; 008/0.85; http://www.80legs.com/webcrawler.html) Gecko/2008032620 1,642 ip 29 Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) 1,594 ip 30 SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) 1,575 ip 31 Mozilla/5.0 (iPhone; U; CPU iPhone OS 41 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML like Gecko) Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) 1,474 ip 32 msnbot/2.0b (+http://search.msn.com/msnbot.htm) 1,444 ip 33 Mozilla/5.0 (compatible; URLAppendBot/1.0; +http://www.profound.net/urlappendbot.html) 1,370 ip 34 DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) 1,338 ip 35 Mozilla/5.0 (iPhone; CPU iPhone OS 60 like Mac OS X) AppleWebKit/536.26 (KHTML like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) 1,225 ip 36 Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider 1,207 ip 37 Mozilla/5.0 (compatible; DomainAppender /1.0; +http://www.profound.net/domainappender) 1,151 ip 38 Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36 1,100 ip 39 msnbot-media/1.1 (+http://search.msn.com/msnbot.htm) 1,088 ip 40 Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) 995 ip 41 Mozilla/5.0 (compatible; AhrefsBot/6.1; +http://ahrefs.com/robot/) 960 ip 42 acebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php) 822 ip 43 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) 812 ip 44 Mozilla/5.0 (compatible; YandexAntivirus/2.0; +http://yandex.com/bots) 807 ip 45 DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html) 804 ip 46 Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot) 794 ip 47 Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails) 790 ip 48 Mozilla/5.0 (iPhone; U; CPU iPhone OS 41 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML like Gecko) Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; Mediapartners-Google/2.1; +http://www.google.com/bot.html) 722 ip 49 Mozilla/5.0 (iPhone; CPU iPhone OS 8_1 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12B411 Safari/600.1.4 (compatible; YandexMobileBot/3.0; +http://yandex.com/bots) 720 ip 50 Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/) 689 ip 1 - 50  of  6,009 records   Please wait...