360蜘蛛UI
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36; 360Spider
需要说明的是,目前360搜索蜘蛛暂时不支持nslookup命令的查询,因此建议大家以本页面查询到的IP为准,结合本页提供的信息进行比对,以确认是否为360搜索的蜘蛛。
以下为360搜索的蜘蛛IP段:
180.153.232.*
180.153.234.*
180.153.236.*
180.163.220.*
42.236.101.*
42.236.102.*
42.236.103.*
42.236.10.*
42.236.12.*
42.236.13.*
42.236.14.*
42.236.15.*
42.236.16.*
42.236.17.*
42.236.46.*
42.236.48.*
42.236.49.*
42.236.50.*
42.236.51.*
42.236.52.*
42.236.53.*
42.236.54.*
42.236.55.*
42.236.99.*
不能用 nslookup 判断360真假蜘蛛
百度蜘蛛UI
移动UA:Mozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,likeGecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; **Baiduspider/2.0;** +http://www.baidu.com/search/spider.html)
PC UA:Mozilla/5.0 (compatible; **Baiduspider/2.0;** +http://www.baidu.com/search/spider.html)
新增渲染UA:
移动UA:Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 likeMac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1 (compatible; **Baiduspider-render/2.0;** +http://www.baidu.com/search/spider.html)
PC UA:Mozilla/5.0 (compatible; **Baiduspider-render/2.0;** +http://www.baidu.com/search/spider.html)
搜狗蜘蛛UI
Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
可以使用 nslookup 判断搜狗真假蜘蛛
谷歌蜘蛛UI
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
判断谷歌真假蜘蛛,用 nslookup 命令
神马蜘蛛UI
主要针对PC端的抓取,移动端也有,很少
Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36
主要针对移动端抓取,PC端也有,很少
Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e YisouSpider/5.0 Safari/602.1
不能使用 nslookup 命令
版权属于:本文为原创文章,版权归A'kun所有,转载请注明出处!
本文链接:https://www.akunblog.com/archives/104.html
转载时须注明出处及本声明