搜索引擎排序作弊的识别:基于文本内容和链接结构的分析

搜索引擎排序作弊通过提高网页与搜索请求的相关性,达到提高搜索排名的目的.为此,根据作弊网页的特征,引入作弊倾向系数这一概念来衡量网页作弊的可能性.网页作弊通过多种手段实现,鉴于此本文基于网页内容本身的名词密度特征,衡量页面内容作弊的可能性,由于搜索关键词大部分为名词,超过一定名词比例阈值的页面,其内容作弊的可能性越大.根据页面的链接特征,衡量页面链接作弊的可能性,从黑名单页面通过迭代计算链接作弊系数,并根据与黑名单页面的距离设置权重.最终从上述两方面特征来综合考量页面的作弊倾向系数.选取PageRank,TrustRank,BadRank为基线实验,实验结果验证了关于检索词性分析的假设以及链接作弊检测算法的有效性.

Countering page ranking spam for search engine based on text content and link structure analysis

By improving the relevance of web pages and search requests, the search engines sort spam achieves the purposes of improving search ranking. Hence, according to the characteristics of the cheating pages, the paper introduces the concept of spam tendency rate to measure the possibility of a web spam behavior. Web spam may be achieved through a variety of channels, based on nouns density, it measures content spam tendency rate. Because majority search keywords are nouns, so the greater a page exceeds a certain proportion of nouns threshold, the greater the possibility of spam. Based on link characteristics, it measures link spam tendency rate. The paper calculates link spam tendency rate by iteration from the blacklist page, then sets the weight in accordance with the distance from the blacklist page. Finally, from these both aspects to comprehensive considerate the spam tendency rate of a page. By selecting PageRank, TrustRank, BadRank as baseline, the experimental results verify the assumptions of the part-of-speech on keywords and the effectiveness of link spam detection.