首页 | 本学科首页   官方微博 | 高级检索  
     检索      

基于柯西分布的水文序列异常值检测方法
引用本文:高熠飞,王建平,李林峰.基于柯西分布的水文序列异常值检测方法[J].河海大学学报(自然科学版),2020,48(4):307-313.
作者姓名:高熠飞  王建平  李林峰
作者单位:河海大学水文水资源学院,江苏 南京 210098;南瑞集团(国网电力科学研究院)有限公司,江苏 南京 211000,南瑞集团(国网电力科学研究院)有限公司,江苏 南京 211000,南瑞集团(国网电力科学研究院)有限公司,江苏 南京 211000
基金项目:国家电网公司总部科技项目(SGFJDK00DYJS1600091)
摘    要:针对基于正态分布的检测算法在窗口中出现偏差较大的极端异常值时,检测模型出现不稳定的现象,提出一种基于柯西分布的异常检测算法。通过试验发现,用滑动窗口内的中位数以及中位数绝对偏差来代替均值以及标准差,可以较好地消除滑动窗口内极端异常值对检测算法的影响。探讨了算法中滑动窗口以及置信度的设置,并通过实例对算法进行验证。结果表明,所提算法的检出率在窗口以及置信度设置恰当的情况下保持较高水平。与其他算法对比表明,所提算法对于处理局部波动剧烈的流量时间序列展现出较好的适用性以及鲁棒性。

关 键 词:水文时间序列  数据异常检测  滑动窗口  中位数  中位数绝对偏差  柯西分布

Outlier detection method of hydrological time series based on Cauchy distribution
GAO Yifei,WANG Jianping,LI Linfeng.Outlier detection method of hydrological time series based on Cauchy distribution[J].Journal of Hohai University (Natural Sciences ),2020,48(4):307-313.
Authors:GAO Yifei  WANG Jianping  LI Linfeng
Institution:College of Hydrology and Water Resources, Hohai University, Nanjing 210098, China; State Grid Electric Power Research Institute, NARI Group Corporation, Nanjing 211000, China
Abstract:When the algorithm based on the normal distribution is applied in the sliding window, the detection model will yield an extreme outlier and exhibit unstable phenomenon. To address this issue, this study proposed an algorithm based on the Cauchy distribution for detecting outliers in hydrological time series. Test results indicate that using the median and median absolute deviation in the sliding window instead of the mean and standard deviation can well eliminate the influence of extreme outliers. The setup of the sliding window and the confidence in the algorithm were analyzed. Examples were used to verify this method and the results indicate that the detection rate of the proposed algorithm maintains a high level when the window and confidence settings are appropriate. The comparison with other algorithms shows that the proposed algorithm exhibits good applicability and robustness for dealing with time series with severe local fluctuations.
Keywords:hydrological time series  outlier detection  sliding window  median value  median absolute deviation  Cauchy distribution
本文献已被 万方数据 等数据库收录!
点击此处可从《河海大学学报(自然科学版)》浏览原始摘要信息
点击此处可从《河海大学学报(自然科学版)》下载免费的PDF全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号