首页 | 本学科首页   官方微博 | 高级检索  
     检索      

海量数据下线性混合效应模型的估计算法
引用本文:耿俏,李志强,陈少东.海量数据下线性混合效应模型的估计算法[J].北京化工大学学报(自然科学版),2019,46(3):123-128.
作者姓名:耿俏  李志强  陈少东
作者单位:北京化工大学理学院,北京,100029;北京化工大学理学院,北京,100029;北京化工大学理学院,北京,100029
摘    要:基于以往文献提出线性混合效应模型参数的三步估计方法,避免了繁杂的极大似然估计迭代步骤。同时为进一步解决海量数据下计算估计量时存在的存储瓶颈及计算时间过长问题,在海量纵向数据的两种不同数据格式下,分别基于三步估计方法利用分治算法计算模型参数的估计量。数值模拟和实证分析结果表明,本文所提出的三步估计方法和估计量的分治算法可以减轻计算负担,减少占用内存,解决内存不足的问题,并提高计算速度。

关 键 词:海量数据  纵向数据  线性混合效应模型  三步估计方法  分治算法
收稿时间:2018-09-15

Estimation algorithm for a linear mixed effect model with massive data
GENG Qiao,LI ZhiQiang,CHEN ShaoDong.Estimation algorithm for a linear mixed effect model with massive data[J].Journal of Beijing University of Chemical Technology,2019,46(3):123-128.
Authors:GENG Qiao  LI ZhiQiang  CHEN ShaoDong
Institution:Faculty of Science, Beijing University of Chemical Technology, Beijing 100029, China
Abstract:Based on the previous literature, a three-step method for the estimation of the parameters of a linear mixed effect model has been proposed, which avoids the complicated iterative steps of maximum likelihood estimation. At the same time, in order to further solve the storage bottleneck and calculation time when calculating the estimator with massive data, the estimator of the model parameters has been calculated using the divide-and-conquer algorithm based on the three-step estimation method for two different data formats of massive vertical data. The results of numerical simulation and empirical analysis show that the three-step estimation method and the estimator divide-and-conquer algorithm proposed in this paper can reduce the computational burden, reduce the memory consumption, solve the problem of insufficient memory, and improve the calculation speed.
Keywords:massive data                                                                                                                        longitudinal data                                                                                                                        linear mixed effect model                                                                                                                        three-step estimation method                                                                                                                        divide-and-conquer algorithm
本文献已被 CNKI 万方数据 等数据库收录!
点击此处可从《北京化工大学学报(自然科学版)》浏览原始摘要信息
点击此处可从《北京化工大学学报(自然科学版)》下载免费的PDF全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号