A prediction mechanism of file access popularity and optimal strategy of replicas deployment in cloud computing |
| |
Authors: | Wang Ning Yang Yang Chen Yu Mi Zhenqiang Meng Kun Ji Qing |
| |
Institution: | 1. School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, P.R.China;Department of Mechanical and Electrical Engineering, Yantai Engineering & Technology College, Yantai 264006, P.R.China 2. School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, P.R.China 3. Department of Computer Science and Technology, Tsinghua University, Beijing 100084, P.R.China |
| |
Abstract: | In cloud computing,the number of replicas and deployment strategy have extensive impacts on user's requirement and storage efficiency.Therefore,in this paper,a new definition of file access popularity according to users' preferences,and its prediction algorithm are provided to predict file access trend with historical data.Files are sorted by priority depending on their popularity.A mathematical model between file access popularity and the number of replicas is built so that the reliability is increased efficiently.Most importantly,we present an optimal strategy of dynamic replicas deployment based on the file access popularity strategy with the overall concern of nodes' performance and load condition.By this strategy,files with high priority will be deployed on nodes with better performance therefore higher quality of service is guaranteed.The strategy is realized in the Hadoop platform.Performance is compared with that of default strategy in Hadoop and CDRM strategy.The result shows that the proposed strategy can not only maintain the system load balance,but also supply better service performance,which is consistent with the theoretical analysis. |
| |
Keywords: | cloud computing Hadoop file access popularity load balance quality of service |
本文献已被 CNKI 万方数据 等数据库收录! |
|