The Experts below are selected from a list of 8310 Experts worldwide ranked by ideXlab platform
Ninghui Sun - One of the best experts on this subject based on the ideXlab platform.
-
IPDPS - United-FS: A Logical File System Providing a Single Image of Multiple Physical File Systems on NFS Server
2007 IEEE International Parallel and Distributed Processing Symposium, 2007Co-Authors: Huan Chen, Yi Zhao, Jin Xiong, Ninghui SunAbstract:NFS is considered to be the bottleneck in cluster computing environment because of its limited resources and centralized data management. With the development of hardware, NFS server has more than one I/O channel, more storage space and more powerful CPU. In this paper, we describe the design and the implementation of a new logical File System called United-FS. It can make storage devices connected to multiple I/O channels work concurrently and cooperatively. It can be exported by NFS server to provide a single File System Image to clients by hiding a variety of native File Systems built on different type of storage devices. This paper also compares the United-FS with the software RAID System both from theoretical analysis and experiments. The results show that United-FS is much more flexible and its performance is better than software RAID in most cases.
-
united fs a logical File System providing a single Image of multiple physical File Systems on nfs server
International Parallel and Distributed Processing Symposium, 2007Co-Authors: Huan Chen, Yi Zhao, Jin Xiong, Ninghui SunAbstract:NFS is considered to be the bottleneck in cluster computing environment because of its limited resources and centralized data management. With the development of hardware, NFS server has more than one I/O channel, more storage space and more powerful CPU. In this paper, we describe the design and the implementation of a new logical File System called United-FS. It can make storage devices connected to multiple I/O channels work concurrently and cooperatively. It can be exported by NFS server to provide a single File System Image to clients by hiding a variety of native File Systems built on different type of storage devices. This paper also compares the United-FS with the software RAID System both from theoretical analysis and experiments. The results show that United-FS is much more flexible and its performance is better than software RAID in most cases.
Huan Chen - One of the best experts on this subject based on the ideXlab platform.
-
IPDPS - United-FS: A Logical File System Providing a Single Image of Multiple Physical File Systems on NFS Server
2007 IEEE International Parallel and Distributed Processing Symposium, 2007Co-Authors: Huan Chen, Yi Zhao, Jin Xiong, Ninghui SunAbstract:NFS is considered to be the bottleneck in cluster computing environment because of its limited resources and centralized data management. With the development of hardware, NFS server has more than one I/O channel, more storage space and more powerful CPU. In this paper, we describe the design and the implementation of a new logical File System called United-FS. It can make storage devices connected to multiple I/O channels work concurrently and cooperatively. It can be exported by NFS server to provide a single File System Image to clients by hiding a variety of native File Systems built on different type of storage devices. This paper also compares the United-FS with the software RAID System both from theoretical analysis and experiments. The results show that United-FS is much more flexible and its performance is better than software RAID in most cases.
-
united fs a logical File System providing a single Image of multiple physical File Systems on nfs server
International Parallel and Distributed Processing Symposium, 2007Co-Authors: Huan Chen, Yi Zhao, Jin Xiong, Ninghui SunAbstract:NFS is considered to be the bottleneck in cluster computing environment because of its limited resources and centralized data management. With the development of hardware, NFS server has more than one I/O channel, more storage space and more powerful CPU. In this paper, we describe the design and the implementation of a new logical File System called United-FS. It can make storage devices connected to multiple I/O channels work concurrently and cooperatively. It can be exported by NFS server to provide a single File System Image to clients by hiding a variety of native File Systems built on different type of storage devices. This paper also compares the United-FS with the software RAID System both from theoretical analysis and experiments. The results show that United-FS is much more flexible and its performance is better than software RAID in most cases.
Remzi H. Arpaci-dusseau - One of the best experts on this subject based on the ideXlab platform.
-
Emulating goliath storage Systems with David
ACM Transactions on Storage, 2012Co-Authors: Nitin Agrawal, Andrea C. Arpaci-dusseau, Leo Arulraj, Remzi H. Arpaci-dusseauAbstract:Benchmarking File and storage Systems on large File-System Images is important, but difficult and often infeasible. Typically, running benchmarks on such large disk setups is a frequent source of frustration for File-System evaluators; the scale alone acts as a strong deterrent against using larger, albeit realistic, benchmarks. To address this problem, we develop David: a System that makes it practical to run large benchmarks using modest amount of storage or memory capacities readily available on most computers. David creates a “compressed” version of the original File-System Image by omitting all File data and laying out metadata more efficiently; an online storage model determines the runtime of the benchmark workload on the original uncompressed Image. David works under any File System, as demonstrated in this article with ext3 and btrfs. We find that David reduces storage requirements by orders of magnitude; David is able to emulate a 1-TB target workload using only an 80 GB available disk, while still modeling the actual runtime accurately. David can also emulate newer or faster devices, for example, we show how David can effectively emulate a multidisk RAID using a limited amount of memory.
-
FAST - Emulating Goliath storage Systems with David
2011Co-Authors: Nitin Agrawal, Andrea C. Arpaci-dusseau, Leo Arulraj, Remzi H. Arpaci-dusseauAbstract:Benchmarking File and storage Systems on large File-System Images is important, but difficult and often infeasible. Typically, running benchmarks on such large disk setups is a frequent source of frustration for File-System evaluators; the scale alone acts as a strong deterrent against using larger albeit realistic benchmarks. To address this problem, we develop David: a System that makes it practical to run large benchmarks using modest amount of storage ormemory capacities readily available on most computers. David creates a "compressed" version of the original File-System Image by omitting all File data and laying out metadata more efficiently; an online storage model determines the runtime of the benchmark workload on the original uncompressed Image. David works under any File System as demonstrated in this paper with ext3 and btrfs. We find that David reduces storage requirements by orders of magnitude; David is able to emulate a 1 TB target workload using only an 80 GB available disk, while still modeling the actual runtime accurately. David can also emulate newer or faster devices, e.g., we show how David can effectively emulate a multidisk RAID using a limited amount of memory.
-
FAST - Generating realistic impressions for File-System benchmarking
2009Co-Authors: Nitin Agrawal, Andrea C. Arpaci-dusseau, Remzi H. Arpaci-dusseauAbstract:The performance of File Systems and related software depends on characteristics of the underlying File-System Image (i.e., File-System metadata and File contents). Unfortunately, rather than benchmarking with realistic File-System Images, most System designers and evaluators rely on ad hoc assumptions and (often inaccurate) rules of thumb. Furthermore, the lack of standardization and reproducibility makes File-System benchmarking ineffective. To remedy these problems, we develop Impressions, a framework to generate statistically accurate File-System Images with realistic metadata and content. Impressions is flexible, supporting user-specified constraints on various File-System parameters using a number of statistical techniques to generate consistent Images. In this article, we present the design, implementation, and evaluation of Impressions and demonstrate its utility using desktop search as a case study. We believe Impressions will prove to be useful to System developers and users alike.
-
OSDI - SQCK: a declarative File System checker
2008Co-Authors: Haryadi S. Gunawi, Abhishek Rajimwale, Andrea C. Arpaci-dusseau, Remzi H. Arpaci-dusseauAbstract:The lowly state of the art for File System checking and repair does not match what is needed to keep important data available for users. Current File System checkers, such as e2fsck, are complex pieces of imperfect code written in low-level languages. We introduce SQCK, a File System checker based on a declarative query language; declarative queries are a natural match for the cross-checking that must be performed across the many structures of a File System Image. We show that SQCK is able to perform the same functionality as e2fsck with surprisingly elegant and compact queries. We also show that SQCK can easily perform more useful repairs than e2fsck by combining information available across the File System. Finally, our prototype implementation of SQCK achieves this improved functionality with comparable performance to e2fsck.
Jin Xiong - One of the best experts on this subject based on the ideXlab platform.
-
IPDPS - United-FS: A Logical File System Providing a Single Image of Multiple Physical File Systems on NFS Server
2007 IEEE International Parallel and Distributed Processing Symposium, 2007Co-Authors: Huan Chen, Yi Zhao, Jin Xiong, Ninghui SunAbstract:NFS is considered to be the bottleneck in cluster computing environment because of its limited resources and centralized data management. With the development of hardware, NFS server has more than one I/O channel, more storage space and more powerful CPU. In this paper, we describe the design and the implementation of a new logical File System called United-FS. It can make storage devices connected to multiple I/O channels work concurrently and cooperatively. It can be exported by NFS server to provide a single File System Image to clients by hiding a variety of native File Systems built on different type of storage devices. This paper also compares the United-FS with the software RAID System both from theoretical analysis and experiments. The results show that United-FS is much more flexible and its performance is better than software RAID in most cases.
-
united fs a logical File System providing a single Image of multiple physical File Systems on nfs server
International Parallel and Distributed Processing Symposium, 2007Co-Authors: Huan Chen, Yi Zhao, Jin Xiong, Ninghui SunAbstract:NFS is considered to be the bottleneck in cluster computing environment because of its limited resources and centralized data management. With the development of hardware, NFS server has more than one I/O channel, more storage space and more powerful CPU. In this paper, we describe the design and the implementation of a new logical File System called United-FS. It can make storage devices connected to multiple I/O channels work concurrently and cooperatively. It can be exported by NFS server to provide a single File System Image to clients by hiding a variety of native File Systems built on different type of storage devices. This paper also compares the United-FS with the software RAID System both from theoretical analysis and experiments. The results show that United-FS is much more flexible and its performance is better than software RAID in most cases.
Yi Zhao - One of the best experts on this subject based on the ideXlab platform.
-
IPDPS - United-FS: A Logical File System Providing a Single Image of Multiple Physical File Systems on NFS Server
2007 IEEE International Parallel and Distributed Processing Symposium, 2007Co-Authors: Huan Chen, Yi Zhao, Jin Xiong, Ninghui SunAbstract:NFS is considered to be the bottleneck in cluster computing environment because of its limited resources and centralized data management. With the development of hardware, NFS server has more than one I/O channel, more storage space and more powerful CPU. In this paper, we describe the design and the implementation of a new logical File System called United-FS. It can make storage devices connected to multiple I/O channels work concurrently and cooperatively. It can be exported by NFS server to provide a single File System Image to clients by hiding a variety of native File Systems built on different type of storage devices. This paper also compares the United-FS with the software RAID System both from theoretical analysis and experiments. The results show that United-FS is much more flexible and its performance is better than software RAID in most cases.
-
united fs a logical File System providing a single Image of multiple physical File Systems on nfs server
International Parallel and Distributed Processing Symposium, 2007Co-Authors: Huan Chen, Yi Zhao, Jin Xiong, Ninghui SunAbstract:NFS is considered to be the bottleneck in cluster computing environment because of its limited resources and centralized data management. With the development of hardware, NFS server has more than one I/O channel, more storage space and more powerful CPU. In this paper, we describe the design and the implementation of a new logical File System called United-FS. It can make storage devices connected to multiple I/O channels work concurrently and cooperatively. It can be exported by NFS server to provide a single File System Image to clients by hiding a variety of native File Systems built on different type of storage devices. This paper also compares the United-FS with the software RAID System both from theoretical analysis and experiments. The results show that United-FS is much more flexible and its performance is better than software RAID in most cases.