高性能网页索引器JU_Indexer的实现

高性能网页索引器JU_Indexer用倒排索引表存储网页索引数据, 以多线程并行的方式对网页建立索引数据, 采用经过优化的检索算法实现用户的查询. 首先给出了JU_Indexer的系统框架, 然后描述了索引数据在JU_Indexer中的存储结构、 建立网页索引的算法、 以及实现用户查询的检索算法. 实验结果表明, JU_Indexer能在毫秒级的时间内完成用户的查询, 它采用的经过优化的词组检索算法缩短了词组的检索时间.

Implementation of a Web Page Indexer JU_Indexer with High Performance

JU_Indexer,a web page indexer with high performance,uses the inverted index table to store(index) data for web pages,creates index data by multiple threads concurrently,utilizes the optimized search(algorithms) to implement the queries posed by users.First,the system architecture of JU_Indexer is given.(Then),the data structure used to store the index data in JU_Indexer,the algorithm employed to create web page index,and the strategy utilized to complete the queries proposed by users are described in great detail.The experiment result demonstrates that the queries proposed by users can be completed by JU_Indexer within milliseconds.The optimized phrase search algorithm employed by JU_Indexer shortens the time to complete the phrase querying.