面向博客的智能网络蜘蛛技术及其系统实现

The Research and Implementation of Intelligent Spider in Blog

摘要: 从博客网站的结构特点出发,抽象出博客网站的链接分级模型,并在此基础上提出了基于蚁群算法的"目录链接-博文链接"自适应采集策略,设计并实现了针对博客网站的智能网络蜘蛛系统.实验表明,采用该策略的系统在采集效率上取得了显著提高.

Abstract: This paper analyzed the architecture of blog site, presented a Link-Rank model and also the “Catalog Link-Article Link” crawling strategy based on ant colony algorithm, then an intelligent web spider system face web blog was designed and implemented.In practice, this solution performed remarkably better on crawling efficiency.