THCASN——一种基于内容存储区域网络

基于内容存储(CAS)是一种可用于保存内容不变数字记录的存储设备。为解决CAS在安全和性能上的问题,该文介绍了清华大学实现的基于内容存储区域网络原型——THCASN,遵从对象存储设备标准OSDT-10,提出一个分析I/O路径上开销的性能评价模型,找出系统性能瓶颈是对象内容Hash值计算和Hash-元数据变换表搜索。THCASN、NFS和iSCSI存储器性能测试结果表明其性能是接近的,但THCASN写性能高出一倍。实验结果与评价模型对性能瓶颈的分析相符。     

基于I/O通道的存储系统性能模型

基于数据存储I/O通道,为“服务器存储”和“数据中心”两种典型存储结构建立排队模型,利用模型对比分析两种结构的性能特点。结果表明:与服务器存储相比,数据中心的“用户绕过服务器直接访问存储设备”结构,避免了服务器成为系统瓶颈,提高了存储设备利用率,使系统总吞吐量有较大幅度增长。实验证明:该模型可有效地反映实际存储系统的性能变化趋势,并给出大致性能评价。     

对象存储系统中基于负载均衡的设备选择算法

为解决大规模海量存储系统中用户数据访问过程中出现的系统负载不均衡现象,深入分析了对象存储节点的负载特征,提出一种对象存储设备的选择算法,检测和计算各个对象存储设备的实时负载信息,并依此从中选择当前负载较低的设备进行数据访问.测试和仿真结果均表明:对于I/O请求中写请求占主导的负载,该算法实现了负载的均衡分布,消除了单点过载,缩短了系统响应时间.该算法不仅适用于写请求到达时的设备选择,也适用于重要数据的备份选择以及链式MDS中后继节点的选择,具有较广的应用范围.     

基于对象存储的集群文件系统CFSlight设计与实现

在线存储以及数据密集型应用的发展,对信息存储性能的要求越来越高,分布式存储系统是应对数据存储需求的重要研究方向.基于对象存储技术和Linux操作系统平台设计与实现的集群文件系统CFSlight,能够有效提高存储系统的可扩展性、I/O性能、可用性等技术指标,具有很好的发展前景.     

网络存储技术综述

本文介绍了几种典型的网络存储系统结构,包括直接连接存储DAS、附网存储NAS和存储区域网SAN,并对近年来发展迅速的基于对象的存储系统和云存储相关技术进行了探讨分析。     

Rapid framing mass storage system on the internet

Mass storage system is now very important for storing huge volume of data in many application system such as VOD systems, electronic library, scientific computation and so on. Besides the storage device and network devices, the real performance of mass storage system is greatly influenced by the connection way between the host and storage system. Here we propose a new design of mass storage system by promoting the storage devices' functions and involving, them directly into data delivering. It can easily meet the demands both for capacity and I/O bandwidth in those applications, and has better service quality and performance compared with the traditional system in delivering mass data over network. Foundation item: Supported by the National Natural Science Foundation of China under grant (69973017) and Defense Advanced Research Foundation of China under grant (98J15. 1. 1. JW0520) Biography: Wang Fang(1972-), female, Ph. D candidate, research interest: mass storage system.     

THCASN——一种基于内容存储区域网络

基于内容存储(CAS)是一种可用于保存内容不变数字记录的存储设备。为解决CAS在安全和性能上的问题,该文介绍了清华大学实现的基于内容存储的区域网络原型——THCASN,遵从对象存储设备标准OSDT-10,提出一个分析I/O路径上开销的性能评价模型,找出系统性能瓶颈是对象内容Hash值计算和Hash-元数据变换表搜索。THCASN、NFS和iSCSI存储器性能测试结果表明其性能是接近的,但THCASN写性能高出一倍。实验结果与评价模型对性能瓶颈的分析相符。     

Design and Implementation of SCSI Target Emulator

Introduction With the explosion in the amount of information, the performance and scalability of storage systems have become critical issues along with the system cost-effectiveness. Storage area network (SAN)[1] is a new storage system model with excelle…     

高性能处理器中干扰公平队列I/O调度器

高性能处理器和系统需要高存储带宽和高效的外部I/O处理, 需要同时服务吞吐率密集应用和延迟敏感应用, 给多道程序计算机系统和多租户模式的超级计算机系统的公平性带来巨大的挑战。针对这两类应用共享SSD (solid-state disks)等可并发的存储设备问题, 开发一款基于队列的干扰公平(interference fair queueing, IFQ)调度器。在Linux操作系统实现IFQ调度器, 并与其他调度器进行对比, 包括Linux的 CFQ调度器、STF调度器、MFAP的时间片流转调度器和MFAP的短时间片流转调度器。基于合成工作集、访问踪迹工作集和真实应用工作集的结果显示, IFQ调度器可以同时保证公平性和响应延迟。     

数据网格中存储I/O的SPN建模与性能评价

针对数据网格中存储资源的结构、协议和I/O模式的复杂性问题,分析了存储网络的并行存储I/O请求模型,采用随机Petri网(SPN)建立了SPN并行存储I/O传输的数学模型,描述了系统请求响应时间与系统负载、网络带宽和节点处理能力之间的关系,然后通过排队论进行了并行I/O的性能分析,最后归纳了影响存储网络系统I/O性能的因素,在并行策略和数据组织与分配等方面提出了提高整体存储性能的改进方法.为改进提高数据网格的整体存储I/O性能提供了有效的建模方法和具体的理论依据.     

基于SAN的虚拟化系统元数据组织策略

SAN(storage area netw ork)结构的实现使得多服务器平台可以共享多种存储设备,为了有效利用存储空间并提高数据存储的可靠性,提出一种基于SAN的虚拟化系统元数据分布策略,并将这种分布策略在I/O节点机的SCS I(sm a ll com pu ter system in terface)目标器中间层用软件的方法实现。通过映射位图方式将设备端的存储资源虚拟化,为光纤网络前端的各种异构平台服务器提供统一的存储资源视图。同时对元数据进行分布冗余存储提高系统可靠性。实验与结果表明:该设计减小了对物理存储设备的需求,使存储设备得到可靠且有效的利用。     

存储区域网络基于主机接口卡的负载均衡

为提高存储区域网络中主机的I/O吞吐能力,在主机上加入冗余路径驱动程序,对逻辑单元(LUN)的I/O请求进行处理.将LUN的I/O请求分配到它的所有路径上,使主机的负载均匀地分布在存储网络中.应用排队理论的多服务员聚集模型,分析了总吞吐能力与主机负载、主机接口卡(HBA)数目、HBA性能之间的关系.实现了基于HBA的负载均衡算法,提高了主机的吞吐能力,缩短了I/O平均响应时间.     

Applying File Information to Block-Level Content Addressable Storage

Content addressable storage (CAS) is a promising technology for improving storage efficiency as well as access throughput.Currently,many CAS products are implemented on the block level,which results in loss of file information.Thus,some sophisticated optimizations cannot be achieved,such as accurate fileprefetching.This paper presents a file-aware block-level storage system combined with the CAS function.In contrast with some existing file-level CAS,this system is transparent to upper-level applications,including the operating system and the file system.These features are achieved by using smart-disk technologies to help the storage system to learn the file-system layout.A prototype was implemented on an open-source virtual machine (VM) with the guest operating system being Windows XP.Tests show that this combination significantly reduces the size of the VM image file and improves the storage performance by discarding unused blocks and using a simple file-level prefetching strategy.     

一种基于属性的对象访问方法

基于对象存储,吸取NAS和SAN的优点。成为下一代网络存储模式．Ext2作为对象存储的文件系统,数据访问至少需两次以上的磁盘操作,由此提出了一种基于属性的对象访问方法．将数据的块地址和长度链接在一起,作为对象的扩展属性,连同数据对象一起存储到磁盘中,无论数据对象大小。磁盘访问次数仅为两次。有效地提高了数据访问效率．     

Design and Implementation of a Storage Virtualization System Based on SCSI Target Simulator in SAN

The ideal storage virtualization system is compatible with all operating systems in storage are anetworks (SANs). However, current storage systems on clustered hosts and multiple operating systems are not practical. This paper presents a storage virtualization system based on a SCSI target simulator in a SAN to solve these problems. This storage virtualization system runs in the target hosts of the SAN, dynamically stores the physical information, and uses the mapping table method to modify the SCSI command addresses. The system uses the bitmap technique to manage the free space. The storage virtualization system provides various functions, such as logical volume resizing, data mirroring, and snapshots, and is compatible with clustered hosts and multiple operating systems, such as Windows NT and RedHat.     

VISA系统设计及性能分析

利用虚拟接口网络通信协议,设计了基于块级元数据管理、具有高性能的存储区域网VISA(virtual interface storage architecture).它利用开放式的数据块动态映射算法实现了物理设备与逻辑设备地址之间的映射,增加了系统的灵活性,同时合理地分配存储资源,改善了系统的I/O性能.利用Matlab对采集到的视频数据Trace进行了传统RAID0算法与动态映射算法之间的性能分析比较.结果表明,采用动态算法使得系统的平均响应时间减少了8%～10%.     

Design and Implementation of a Fibre Channel Target Driver Supporting SCSI

Fibre channel storage area networks (FC-SAN) are effective solutions to address storage management problems caused by very large volumes of data. But the expense of fibre channel devices limits FC-SAN applications. The use of IP networks instead of fibre channel networks will reduce SAN cost, but will also reduce the performance. Therefore, small computer system interface (SCSI) devices were considered to replace FC disks to reduce the SAN cost. A driver for the FC network adapter and the FC target, designed and implemented to support this structure, obeys the SCSI protocol and works in target mode with 200 MB/s bandwidth. The FC target architecture and implementation were compared with the FC initiator.The SCSI command transfer process in the FC layer was described. The performance test results show that the maximum I/O throughput reachs 167 MB/s for read requests and 196 MB/s for write requests (FC bandwidth is 200 MB/s), verifying that the FC target is very efficient. The modularization, efficiency, and low cost of the FC target will enable SAN and fibre channel to be more widely used in applications.     

一种统一存储网的Cache方案

统一存储网融合了NAS和SAN的优点,但对小写数据其I／O性能不高．在客户端采用NVRAM和日志磁盘构成一个两层的Cache,可以将小写数据积累成大写数据,达到提高性能的目的;采用基于租约的Cache一致性协议可以保证网络中断或客户出错时USN的可用性和数据的一致性;实验显示Cache方案可以使USN的性能最大提高50％．     

网络存储中分布式I/O缓存机制研究

针对网络存储中I/O的瓶颈问题,设计了一个基于网络存储的分布式I/O缓存机制,通过本地缓存和远程缓存的两级缓存机制进行I/O性能的优化.其中本地缓存用来保存本地磁盘的读写信息,远程缓存用来协调远程机器的本地缓存.针对以上的缓存机制,设计了相应的数据块更新算法和缓存一致性策略,有效地保证了I/O缓存的性能.     

Performance analysis of an iSCSI-based unified storage network

In this paper, we introduced a novel storage architecture “Unified Storage Network“, which merges NAC( Network Attached Channel) and SAN( Storage Area Network) , and provides the file I/O services as NAS devices and provides the block I/O services as SAN. To overcome the drawbacks from FC, we employ iSCSI to implement the USN( Unified Storage Network) . To evaluate whether iSCSI is more suitable for implementing the USN, we analyze iSCSI protocol and compare it with FC protocol from several components of a network protocol which impact the performance of the network. From the analysis and comparison, we can conclude that the iSCSI is more suitable for implementing the storage network than the FC under condition of the wide-area network. At last, we designed two groups of experiments carefully.