一种分布式冗余的实时数据存储检索机制

为解决传统集中式实时数据库吞吐量、容错性、可扩展性不足的难题,提出一种基于分布式架构、具备多重副本管理功能的实时数据存储检索机制.该机制结合一致性哈希算法与基于多版本控制的数据组织方案,从实时数据的存储、管理、查询三方面进行设计和优化,在保证数据存取实时性的基础上实现了备份同步、一致性修复等核心功能,从而有效提高了实时数据库的海量数据存储与处理能力,为实时数据库向分布式存储、多重冗余备份、系统规模动态调整等方向的转变奠定了基础.通过在原型系统中测试验证,结果表明该机制能够达到设计预期目标和性能要求.

A Distributed Redundant Real-Time Data Storage Mechanism

A real-time data storage and retrieval mechanism with the management of multi-replication based on distributed architecture was proposed to solve the deficiencies in throughput, fault tolerance, and scalability of traditional centralized real-time database. Combining the consistent hashing algorithm with data organization based on multi-version control, the mechanism was designed and optimized from three aspects of real time data storage, management and query. It implements backup synchronization and consistency repair under the premise of ensuring real-time data access, thus improves mass data storage and processing capacity of real time database, and lays a good foundation on the changes of real time database distributed storage, multiple redundant backup, dynamically adjustment of system’s scale and other directions. By simulation and testing the mechanism in the prototype system, it is shown that this mechanism can achieve the design targets and performance requirements.