百度 Baiduspider/2.0
Baiduspider-image
常见百度旗下同类型蜘蛛还有下面这些:Baiduspider-mobile(抓取wap)、Baiduspider-image(抓取图片)、Baiduspider-video(抓取视频)、Baiduspider-news(抓取新闻)
百度蜘蛛IP:
220.181.108.76 ~ 220.181.108.187
123.125.71.92 ~ 123.125.71.113
Bing bingbot/2.0
Bing蜘蛛IP:
157.55.39.97 ~ 157.55.39.98
40.77.167.36 ~ 40.77.167.87
207.46.13.1 ~ 207.46.13.255
Google Googlebot/2.1
Google蜘蛛IP:
66.249.74.78 ~ 66.249.74.80
66.249.71.53 ~ 66.249.71.124
66.249.65.93 ~ 66.249.65.99
搜狗sogou Sogou+web+spider/4.0
搜狗蜘蛛IP:
61.135.189.97 ~ 61.135.189.98
123.126.113.189
神马搜索 Yisouspider
原属一搜蜘蛛。
神马搜索IP:
360搜索 360Spider
360搜索蜘蛛IP:
180.153.232.*
180.153.234.*
180.153.236.*
180.163.220.*
42.236.101.*
今日头条 Bytespider
今日头条蜘蛛IP:
111.225.149.2 ~ 111.225.149.249
110.249.202.2 ~ 110.249.202.249
Yahoo Yahoo!
Yahoo蜘蛛IP:
68.180.230.46、68.180.228.253