分布式数据库中海量数据采集完整性约束

在分布式数据库系统的建立过程中,需要把大量的异构信息转化成数据库管理系统可以识别和处理的数据.在把信息装载到数据库前,需要对这些源数据进行完整性校验.利用数据库关系的偏序性把数据划分成不相交的子集,给出了一种描述数据库统计概貌的模型,把全局完整性约束局部化,对以文件形式存在的源数据进行分布武完整性检查,然后在后台将其批量装载到数据库中.此种方法在黑龙江省防洪决策数据库系统的建立过程中,明显提高了数据的可信度及装载效率.

Integrity constraints of distributed database in massive data collection

During the development of the distributed database system, massive information needs to be converted into the data that can be identified and dealt with by the database management system. However when the information is loaded into the database, the integrity of the source data must be checked and corrected. The statistical profile method is adopted to describe the structure of the database and the quantitative properties of the data. As to the source data stored as files, the authors have to check the integrality of the database and then load the data into the database in batches. This method has been applied to the distributed system, has successfully solved the problem of collecting the massive data.