2010-12-09 00:06:17  GET /index.asp – 80 – 220.181.108.116 Baiduspider+(+http://www.baidu.com/search/spider.htm) – 200 0 0
2010-12-09 00:21:20  GET /index.asp – 80 – 220.181.108.109 Baiduspider+(+http://www.baidu.com/search/spider.htm) – 200 0 0
2010-12-09 00:36:18  GET /index.asp – 80 – 220.181.108.100 Baiduspider+(+http://www.baidu.com/search/spider.htm) – 200 0 0
2010-12-09 00:51:18  GET /index.asp – 80 – 220.181.108.114 Baiduspider+(+http://www.baidu.com/search/spider.htm) – 200 0 0
2010-12-09 01:05:06  GET /.html – 80 – 220.181.108.102 Baiduspider+(+http://www.baidu.com/search/spider.htm) – 200 0 2
2010-12-09 01:06:12  GET /index.asp – 80 – 220.181.108.121 Baiduspider+(+http://www.baidu.com/search/spider.htm) – 200 0 0
2010-12-09 01:21:19  GET /index.asp – 80 – 220.181.108.123 Baiduspider+(+http://www.baidu.com/search/spider.htm) – 200 0 0
2010-12-09 01:36:09  GET /index.asp – 80 – 220.181.108.105 Baiduspider+(+http://www.baidu.com/search/spider.htm) – 200 0 0
2010-12-09 01:51:10  GET /index.asp – 80 – 220.181.108.119 Baiduspider+(+http://www.baidu.com/search/spider.htm) – 200 0 0
2010-12-09 01:55:58  GET /.html – 80 – 220.181.108.108 Baiduspider+(+http://www.baidu.com/search/spider.htm) – 200 0 2
2010-12-09 02:06:17  GET /index.asp – 80 – 220.181.108.115 Baiduspider+(+http://www.baidu.com/search/spider.htm) – 200 0 0
2010-12-09 02:21:09  GET /index.asp – 80 – 220.181.108.104 Baiduspider+(+http://www.baidu.com/search/spider.htm) – 200 0 0

今天在分析网站日志时,来对比了一下百度蜘蛛来访的时间,及有什么规律,我列了十几条来访数据,从时间数据上来看,每个小时固定会来四次,而且每个小时的都会在哪几分钟来,如果排除网络不稳定因数可能秒数都一样。还有就是刚发现的,固定时间来访的IP段是一样的。

我就在想,百度蜘蛛为什么这么频繁的来呢,而且还这么有规律。
第一个原因应该是网站的所谓权重
第二是网站更新的频率

如果你想让百度蜘蛛常驻你网站,最重要的一点就是有规律的更新你的网站。




你可能对此也感兴趣