首页 | 本学科首页   官方微博 | 高级检索  
     检索      


FastDu: Efficient Directory Summaries Harvest by Tracking File System Changes
Authors:Likun Liu  刘立坤  Nuo Wu  吴诺  Chuncong Xu  许春聪  Yongwei Wu  武永卫  Guangwen Yang  杨广文
Institution:Ministry of Education Key Laboratory for Earth System Modeling, Center for Earth System Science, Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China
Abstract:FastDu is a file system service that tracks file system changes by intercepting file system calls to maintain directory summaries, which play important roles in both storage administration and improvement of user experiences for some applications. In most circumstances, directory summaries are independently harvested by applications via traversing the file system hierarchy and calling stat () on every file in each directory. For large file systems, this brute-force traverse-based approach can take many hours to complete, even if only a small percentage of the files have changed. This paper describes FastDu, which uses a pre-built database to store harvested directory summaries, and tracks the file system changes by intercepting file system calls, so that new harvesting is restricted to the small subset of directories that contain modified files. Tests using FastDu show that this approach reduces the time needed to get a directory summary by one or two orders of magnitude with almost negligible penalty to application-aware file system performance.
Keywords:file system metadata  metadata crawl  file system changes  file system intercepts
本文献已被 CNKI ScienceDirect 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号