问答社区问句中多字词表达提取

基于互动问答社区问句中多字词表达和问句理解的关系,提出针对互动问答社区问句进行多字词表达抽取,并基于互动问答社区问句中多字词表达的特点,提出适用于互动问答社区的多字词表达提取方法.该方法在利用互信息和停用词表的方法从问句中抽取候选多字词表达的基础上,将候选多字词表达分为正确串、残缺串、冗余串和错误串4类,借助搜索引擎对查询串的优化和候选多字词表达在互联网上的检索结果,设计候选多字词表达校正方法,实现对多字词表达的提取.以新浪爱问知识人问题库中的问句进行实验,结果表明,多字词表达抽取的准确率、召回率和F值分别达到84%,52%和0.64,验证了该方法的有效性.

Extraction of Multiword Expressions in Questions of Question Answering Communities

The multiword expressions (MWEs) in the questions of question answering communities have direct relationship with question interpretation. We first proposed the idea of extracting MWEs from the questions of question answering communities. According to the characteristics of multiword expressions in the questions, we proposed a method of extracting MWEs in questions of question answering communities. In this method, we first used mutual information method and stop words filtering method to get the candidate MWEs. Then we classified the candidate MWEs into four types: right string, incomplete string, redundancy string and error string. At last, with the help of query optimization in search engines and the candidate MWEs retrieval results on the internet, we designed a revising method to get the MWEs. We took the questions in Sina iask question library as the experimental corpus. And the results show that the precision, recall and the F measure can reach 84%, 52%, 0.64 respectively, which proves the effectiveness of the proposed method.