首页 | 本学科首页   官方微博 | 高级检索  
     检索      

大数据存储中的容错关键技术综述
引用本文:宫婧,王文君.大数据存储中的容错关键技术综述[J].南京邮电大学学报(自然科学版),2014(4):20-25.
作者姓名:宫婧  王文君
作者单位:南京邮电大学宽带无线通信与传感网技术教育部重点实验室,江苏南京210003
基金项目:国家自然科学基金(60973140,61170276,61373135,)、江苏省产学研项目(BY2013011)、江苏省科技型企业创新基金(BC2013027)和江苏省高校自然科学研究重大项目(12KJA520003)资助项目
摘    要:不断增长的海量数据需要被可靠存储,而分布式存储系统庞大的节点规模和数据规模,大大提升了发生节点失效的概率,容错技术成为大数据存储中不可忽视的关键技术.文中介绍了数据容错的两种基本策略:复制和纠删码,并分别总结了将这两种容错策略具体应用于大数据存储时所面对的问题和相关解决技术,如与基于复制的容错技术相关的副本系数设置、副本放置策略、副本一致性策略、副本修复策略和纠删码领域的再生码技术等.

关 键 词:大数据存储  分布式存储  容错  复制  纠删码  再生码

Fault Tolerance Technology for Big Data Storage
GONG Jing,WANG Wen-jun.Fault Tolerance Technology for Big Data Storage[J].Journal of Nanjing University of Posts and Telecommunications,2014(4):20-25.
Authors:GONG Jing  WANG Wen-jun
Institution:(Key Lab of Broadband Wireless Communication and Sensor Network Technology, Ministry of Education,Nanjing University of Posts and Telecommunications, Nanjing 210003, China)
Abstract:The growing massive data needs to be reliably stored,but the large scale of the nodes and data of distributed storage system greatly enhance the probability of node failure.The fault tolerance technology has become the key technology which cannot be ignored in big data storage.This paper introduces two basic strategies of data fault tolerance:replication and erasure codes,and summarizes related technology using these two strategies for big data storage.Technologies include the coefficient setting of duplicates,the replica placement strategy,the replica consistency and the repair strategy related to replication technology,and regenerative code technology related to erasure codes.
Keywords:big data storage  distributed storage  fault tolerant  replication  erasure code  regenerating code
本文献已被 维普 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号