| Hadoop平台下MapReduce模型调度算法研究 |
| |
| 引用本文： | 刘伟,杜永文,吕晓剑.Hadoop平台下MapReduce模型调度算法研究[J].广西民族大学学报,2014(3):72-74. |
| |
| 作者姓名： | 刘伟 杜永文 吕晓剑 |
| |
| 作者单位： | 兰州交通大学电子与信息工程学院,甘肃兰州730070 |
| |
| 摘 要： | 针对Hadoop默认FIFO调度算法和Fair调度算法、Capacity调度算法的不足,引入了一种基于优先权的自适应MapReduce调度算法.该算法利用作业权值为不同的Job分配不同的系统资源,同时根据各TaskTracker节点反馈回来的消息调整可执行队列的长度,以达到各节点负载平衡,提高系统的执行效率.
|
| 关 键 词： | Hadoop MapReduce 调度算法 基于优先权的自适应调度算法 |
The Research of The Scheduling Algorithm of MapReduce Model under The Hadoop |
| |
| LIU Wei,DU Yong-wen,LV Xiao-jian.The Research of The Scheduling Algorithm of MapReduce Model under The Hadoop[J].Journal of Guangxi University For Nationalities(Natural Science Edition),2014(3):72-74. |
| |
| Authors: | LIU Wei DU Yong-wen LV Xiao-jian |
| |
| Institution: | (College of Lanzhou Jiaotong University , Electronic and Information Engineer, Lanzhou 730070 ,China) |
| |
| Abstract: | Aiming at the shortage of Hadoop default FIFO scheduling algorithm and Fair scheduling algorithm, we introduce an adaptive scheduler algorithm based on priority, system can assign appropriate computing resources and execution time to job based on its priority, at the same time, with the feedback message fromTaskTracker node system can dynamically adjust the length of active queue, in order to achieve the load balance and improve the efficiency of the system. |
| |
| Keywords: | Hadoop MapReduce Scheduling algorithm ASBP |
| 本文献已被 维普 等数据库收录！ |
