首页 | 本学科首页   官方微博 | 高级检索  
     

基于Hadoop的大数据处理平台研究
引用本文:朱颢东,冯嘉美,张志锋. 基于Hadoop的大数据处理平台研究[J]. 华中师范大学学报(自然科学版), 2017, 51(5): 585-590
作者姓名:朱颢东  冯嘉美  张志锋
作者单位:1.郑州轻工业学院 计算机与通信工程学院, 郑州 450002; 2.郑州轻工业学院 软件学院, 郑州 450002
摘    要:大数据时代的到来伴随着海量数据,进而使得筛选出具有价值的信息成为大数据被广泛应用的核心步骤.在此情况下Apache Hadoop顺势而生,其通过简化数据密集、高度并行的分布式应用来应对大数据带来的挑战.由于目前基于Hadoop的大数据平台在多领域普遍使用,从而平台搭建成为进行大数据探索的第一步.而很多文章介绍的平台搭建是在虚拟机中完成,与真实情况存在相应差异.本文讨论以真实集群为基础搭建Hadoop平台的原因,Hadoop集群的强大功能,搭建平台所需设备、环境、安装、设置及测试过程.

关 键 词:Hadoop   大数据   分布式应用  
收稿时间:2017-10-09

Study on big data processing platform based on Hadoop
ZHU Haodong,FENG Jiamei,ZHANG Zhifeng. Study on big data processing platform based on Hadoop[J]. Journal of Central China Normal University(Natural Sciences), 2017, 51(5): 585-590
Authors:ZHU Haodong  FENG Jiamei  ZHANG Zhifeng
Affiliation:1.School of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou 450002;2.School of Software, Zhengzhou University of Light Industry, Zhengzhou 450002
Abstract:The age of big data is companied by massive data, making the selection of valuable information become a core step for wide usage of big data. Apache Hadoop is invented in this case and addressing the challenges from big data via simplifying data intensive and highly parallel distributed applications. The current big data based on Hadoop platform is widely used, so constructing a platform becomes the first step of exploration in big data. This paper describes the reason of Hadoop platform construct based on real cluster and the powerful function of Hadoop cluster as well as equipment, environment, installation, setting and testing process in the construction process.
Keywords:Hadoop   dig data   distributed application  
本文献已被 CNKI 等数据库收录!
点击此处可从《华中师范大学学报(自然科学版)》浏览原始摘要信息
点击此处可从《华中师范大学学报(自然科学版)》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号