开源软件中的大数据管理技术

 随着谷歌文件系统和宽表结构为代表的技术打破依赖关系数据库管理海量数据的限制，以Apache Hadoop为代表的开源大数据管理系统软件新技术与系统不断涌现，并快速成熟应用。针对Apache开源社区中面向在线事务处理和在线分析处理场景的大数据管理软件，介绍了大数据管理中的数据存储、数据分区、副本机制、分布式协议等，并比较分析了分布式文件系统、键值库、时序数据库等典型分布式数据管理系统的优缺点。

Big data technologies in open source software: A survey

The Google's GFS and Big Table have broken the limitations of the technology of having to use the relational databases to manage the big data in the past decade. A number of open source big data management systems, such as the Apache Hadoop, carry the technology further by developing more matured technologies and applications. This paper reviews the big data management systems in addressing the usage scenarios of the OLTP and the OLAP based on the Apache software, and the state of art of the data storage engine, the data partition, the data replication, the distributed system protocol, together with a comparison of the pros and the cons of the current distributed file system, the key value store, and the time series database.