首页 | 本学科首页   官方微博 | 高级检索  
     检索      

面向问答领域的数据增强方法
引用本文:丁家杰,肖康,叶恒,周夏冰,张民.面向问答领域的数据增强方法[J].北京大学学报(自然科学版),2022,58(1):54-60.
作者姓名:丁家杰  肖康  叶恒  周夏冰  张民
作者单位:苏州大学计算机科学与技术学院, 苏州 215000
基金项目:国家自然科学基金(62176174)资助;
摘    要:针对当前自动问答数据增强方法需要大量外部数据的问题,提出一个面向问答模型缺陷的数据增强方法.首先,在训练集上训练好问答模型、问题生成模型以及问答匹配模型;然后,获取问答模型在训练集上预测的所有答案,并选取其中预测错误的答案;再后,使用问题生成模型对这些答案生成相应问题;最后,通过问答匹配模型对生成的问答对进行过滤,保留...

关 键 词:数据增强  问题生成模型  自动问答模型  质量控制
收稿时间:2021-06-08

Data Augmentation Method for Question Answering
DING Jiajie,XIAO Kang,YE Heng,ZHOU Xiabing,ZHANG Min.Data Augmentation Method for Question Answering[J].Acta Scientiarum Naturalium Universitatis Pekinensis,2022,58(1):54-60.
Authors:DING Jiajie  XIAO Kang  YE Heng  ZHOU Xiabing  ZHANG Min
Institution:School of Computer Science and Technology, Soochow University, Suzhou 21500
Abstract:Aiming at the problem that the current data augmentation method for automatic question answering requires a large amount of external data, a new method oriented to the defects of the question answering model is proposed. Firstly, the question answering (QA) model, question generating (QG) model and question answering matching (QAMatch) model are trained on the training set. Secondly, all the answers predicted by the QA model on the training set are obtained and the wrong ones are selected. Then, the QG model is used to generate corresponding questions for these answers. Finally, the question-answer pairs are filtered by the QAMatch model and the high-quality data are retained as the final augmented data. This method does not require additional data and domain knowledge, and can construct specific data for QA model, improving the performance with less training cost. Experimental results show that the proposed data augmentation method is effective for R-NET, Bert-Base and Luke. Compared with other methods, the QA model achieves better performance improvement with less data scale.
Keywords:data augmentation  question answering model  question generation model  quality control  
点击此处可从《北京大学学报(自然科学版)》浏览原始摘要信息
点击此处可从《北京大学学报(自然科学版)》下载免费的PDF全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号