首页 | 本学科首页   官方微博 | 高级检索  
     

基于语义特征提取与层次结构的问题生成方法
引用本文:白诗瑶,吕佳键,彭涛,刘露,崔海. 基于语义特征提取与层次结构的问题生成方法[J]. 吉林大学学报(理学版), 2023, 61(1): 94-100
作者姓名:白诗瑶  吕佳键  彭涛  刘露  崔海
作者单位:1. 吉林大学 计算机科学与技术学院, 长春 130012; 2. 吉林大学 软件学院, 长春 130012; 3. 吉林大学 符号计算与知识工程教育部重点实验室, 长春 130012
摘    要:针对传统端到端模型在输入文本语义较复杂情况下生成的问题普遍存在语义不完整的情形,提出一种基于语义特征提取的文本编码器架构.首先构建双向长短时记忆网络获得基础的上下文信息,然后采用自注意力机制及双向卷积神经网络模型分别提取语义的全局特征和局部特征,最后设计一种层次结构,融合特征及输入自身信息得到最终的文本表示进行问题生成.在数据集SQuAD上的实验结果表明,基于语义特征提取与层次结构进行问题生成效果显著,结果明显优于已有方法,并且语义特征提取和层次结构在任务的各评价指标上均有提升.

关 键 词:问题生成  双向长短时记忆网络  卷积神经网络  自注意力机制  层次结构
收稿时间:2021-11-19

Question Generation Method Based on Semantic Feature Extraction and Hierarchical Structure
BAI Shiyao,LV Jiajian,PENG Tao,LIU Lu,CUI Hai. Question Generation Method Based on Semantic Feature Extraction and Hierarchical Structure[J]. Journal of Jilin University: Sci Ed, 2023, 61(1): 94-100
Authors:BAI Shiyao  LV Jiajian  PENG Tao  LIU Lu  CUI Hai
Affiliation:1. College of Computer Science and Technology, Jilin University, Changchun 130012, China;2. College of Software, Jilin University, Changchun 130012, China; 3. Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China
Abstract:Aiming at  the problem that when the semantics of the input text were relatively complex, traditional end-to-end models generated questions with incomplete semantics,  we proposed a text encoder architecture based on semantic feature extraction. Firstly, we constructed bidirectional long short-term memory network to obtain  basic contextual information. Secondly,  self-attention mechanism was used to extract global features of semantics and bidirectional convolutional neural network model was used to extract local features of semantics respectively. Finally, we designed a hierarchical structure to merge the features and input their own information  to obtain the final text representation for question generation. Experimental results on the SQuAD dataset show that the question generation based on semantic feature extraction and hierarchical structure are significantly effective, and the results are better than the existing methods. Moreover, semantic feature extraction and hierarchical structure are improved  in each evaluation index of the task.
Keywords:question generation   bidirectional long short-term memory network   convolutional neural network   self-attention mechanism   hierarchical structure  
点击此处可从《吉林大学学报(理学版)》浏览原始摘要信息
点击此处可从《吉林大学学报(理学版)》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号