基于自注意力机制的科技术语自动提取技术研究

科技术语提取是科技术语自动处理的重要环节,对后续的机器翻译、信息检索、QA问答等任务有重要意义。传统的人工科技术语提取方法耗费大量的人力成本。而一种自动提取科技术语方法是将术语提取转化为序列标注问题,通过监督学习方法训练出标注模型,但是面临缺乏大规模科技术语标注语料库的问题。文章引入远程监督的方法来产生大规模训练标注语料。另外又提出基于自注意力机制的Bi-LSTM的模型架构来提高科技术语提取结果。发现新模型在发现新的科技术语的能力上远远优于传统机器学习模型(CRF)。

Research on Automatic Extraction of Scientific Terminology from Texts Based on Self-Attention

Scientific terminology uses specific words to represent certain scientific concepts.The extraction of scientific terminology is an important part of the automatic processing of scientific terminology,and it is of great significance for the following tasks such as machine translation,information retrieval,and questions and answers.The traditional extraction of scientific terminology consumes a lot of manpower cost,and an automatic method for extracting scientific terminology is transforming terminology extraction into tagging problem and training out the tagging model through supervised learning methods,while the lack of annotated large-scale scientific terminology corpus is the problem.This paper introduces the method of distant supervision to generate large-scale annotated training corpus,and proposes Bi-LSTM model architecture based on Self-attention mechanism for the purpose of improving the extraction results of scientific terminology.We found that the ability of discovering new scientific terminology about our new model is far superior to the traditional machine learning model(CRF).