The Experts below are selected from a list of 8376 Experts worldwide ranked by ideXlab platform

Stephen L. Scott - One of the best experts on this subject based on the ideXlab platform.

  • Euro-Par Workshops (1) - 5th workshop on system-Level Virtualization for high performance computing (HPCVirt 2011)
    Euro-Par 2011: Parallel Processing Workshops, 2012
    Co-Authors: Stephen L. Scott, Geoffroy Vallée, Thomas Naughton
    Abstract:

    The emergence of Virtualization enabled hardware, such as the latest generation AMD and Intel processors, has raised significant interest in High Performance Computing (HPC) community. In particular, system-Level Virtualization provides an opportunity to advance the design and development of operating systems, programming environments, administration practices, and resource management tools. This leads to some potential research topics for HPC, such as failure tolerance, system management, and solution for application porting to new HPC platforms. The workshop on System-Level Virtualization for HPC (HPCVirt 2011) is intended to be a forum for the exchange of ideas and experiences on the use of Virtualization technologies for HPC, the challenges and opportunities offered by the development of system-Level Virtualization solutions themselves, as well as case studies in the application of system-Level Virtualization in HPC.

  • 5th workshop on system Level Virtualization for high performance computing hpcvirt 2011
    International Conference on Parallel Processing, 2011
    Co-Authors: Stephen L. Scott, Geoffroy Vallée, Thomas Naughton
    Abstract:

    The emergence of Virtualization enabled hardware, such as the latest generation AMD and Intel processors, has raised significant interest in High Performance Computing (HPC) community. In particular, system-Level Virtualization provides an opportunity to advance the design and development of operating systems, programming environments, administration practices, and resource management tools. This leads to some potential research topics for HPC, such as failure tolerance, system management, and solution for application porting to new HPC platforms. The workshop on System-Level Virtualization for HPC (HPCVirt 2011) is intended to be a forum for the exchange of ideas and experiences on the use of Virtualization technologies for HPC, the challenges and opportunities offered by the development of system-Level Virtualization solutions themselves, as well as case studies in the application of system-Level Virtualization in HPC.

  • system Level Virtualization research at oak ridge national laboratory
    Future Generation Computer Systems, 2010
    Co-Authors: Stephen L. Scott, Geoffroy Vallée, Thomas Naughton, Christian Engelmann, Anand Tikotekar, Hong Ong
    Abstract:

    System-Level Virtualization is today enjoying a rebirth as a technique to effectively share what had been considered large computing resources which subsequently faded from the spotlight as individual workstations gained in popularity with a ''one machine-one user'' approach. One reason for this resurgence is that the simple workstation has grown in capability to rival anything similar, available in the past. Thus, computing centers are again looking at the price/performance benefit of sharing that single computing box via server consolidation. However, industry is only concentrating on the benefits of using Virtualization for server consolidation (enterprise computing) whereas our interest is in leveraging Virtualization to advance high-performance computing (HPC). While these two interests may appear to be orthogonal, one consolidating multiple applications and users on a single machine while the other requires all the power from many machines to be dedicated solely to its purpose, we propose that Virtualization does provide attractive capabilities that may be exploited to the benefit of HPC interests. This does raise the two fundamental questions: is the concept of Virtualization (a machine ''sharing'' technology) really suitable for HPC and if so, how does one go about leveraging these Virtualization capabilities for the benefit of HPC. To address these questions, this document presents ongoing studies on the usage of system-Level Virtualization in a HPC context. These studies include an analysis of the benefits of system-Level Virtualization for HPC, a presentation of research efforts based on Virtualization for system availability, and a presentation of research efforts for the management of virtual systems. The basis for this document was the material presented by Stephen L. Scott at the Collaborative and Grid Computing Technologies meeting held in Cancun, Mexico on April 12-14, 2007.

  • Proceedings of the 3rd ACM Workshop on System-Level Virtualization for High Performance Computing
    2009
    Co-Authors: Stephen L. Scott, Geoffroy Vallée
    Abstract:

    The emergence of Virtualization enabled hardware, such as the latest generation AMD and Intel processors, has raised significant interest in High Performance Computing (HPC) community. In particular, system-Level Virtualization provides an opportunity to advance the design and development of operating systems, programming environments, administration practices, and resource management tools. This leads to some potential research topics for HPC, such as failure tolerance, system management, and solution for application porting to new HPC platforms. The workshop on System-Level Virtualization for HPC (HPCVirt 2009) is intended to be a forum for the exchange of ideas and experiences on the use of Virtualization technologies for HPC, the challenges and opportunities offered by the development of system-Level Virtualization solutions themselves, as well as case studies in the application of system-Level Virtualization in HPC.

  • system Level Virtualization for high performance computing
    Parallel Distributed and Network-Based Processing, 2008
    Co-Authors: Geoffroy Vallée, Thomas Naughton, Christian Engelmann, Hong Ong, Stephen L. Scott
    Abstract:

    System-Level Virtualization has been a research topic since the 70's but regained popularity during the past few years because of the availability of efficient solution such as Xen and the implementation of hardware support in commodity processors (e.g. Intel-VT, AMD-V). However, a majority of system-Level Virtualization projects is guided by the server consolidation market. As a result, current Virtualization solutions appear to not be suitable for high performance computing (HPC) which is typically based on large-scale systems. On another hand there is significant interest in exploiting virtual machines (VMs) within HPC for a number of other reasons. By visualizing the machine, one is able to run a variety of operating systems and environments as needed by the applications. Virtualization allows users to isolate workloads, improving security and reliability. It is also possible to support non-native environments and/or legacy operating environments through Virtualization. In addition, it is possible to balance work loads, use migration techniques to relocate applications from failing machines, and isolate fault systems for repair. This document presents the challenges for the implementation of a system-Level Virtualization solution for HPC. It also presents a brief survey of the different approaches and techniques to address these challenges.

Geoffroy Vallée - One of the best experts on this subject based on the ideXlab platform.

  • Euro-Par Workshops (1) - 5th workshop on system-Level Virtualization for high performance computing (HPCVirt 2011)
    Euro-Par 2011: Parallel Processing Workshops, 2012
    Co-Authors: Stephen L. Scott, Geoffroy Vallée, Thomas Naughton
    Abstract:

    The emergence of Virtualization enabled hardware, such as the latest generation AMD and Intel processors, has raised significant interest in High Performance Computing (HPC) community. In particular, system-Level Virtualization provides an opportunity to advance the design and development of operating systems, programming environments, administration practices, and resource management tools. This leads to some potential research topics for HPC, such as failure tolerance, system management, and solution for application porting to new HPC platforms. The workshop on System-Level Virtualization for HPC (HPCVirt 2011) is intended to be a forum for the exchange of ideas and experiences on the use of Virtualization technologies for HPC, the challenges and opportunities offered by the development of system-Level Virtualization solutions themselves, as well as case studies in the application of system-Level Virtualization in HPC.

  • 5th workshop on system Level Virtualization for high performance computing hpcvirt 2011
    International Conference on Parallel Processing, 2011
    Co-Authors: Stephen L. Scott, Geoffroy Vallée, Thomas Naughton
    Abstract:

    The emergence of Virtualization enabled hardware, such as the latest generation AMD and Intel processors, has raised significant interest in High Performance Computing (HPC) community. In particular, system-Level Virtualization provides an opportunity to advance the design and development of operating systems, programming environments, administration practices, and resource management tools. This leads to some potential research topics for HPC, such as failure tolerance, system management, and solution for application porting to new HPC platforms. The workshop on System-Level Virtualization for HPC (HPCVirt 2011) is intended to be a forum for the exchange of ideas and experiences on the use of Virtualization technologies for HPC, the challenges and opportunities offered by the development of system-Level Virtualization solutions themselves, as well as case studies in the application of system-Level Virtualization in HPC.

  • system Level Virtualization research at oak ridge national laboratory
    Future Generation Computer Systems, 2010
    Co-Authors: Stephen L. Scott, Geoffroy Vallée, Thomas Naughton, Christian Engelmann, Anand Tikotekar, Hong Ong
    Abstract:

    System-Level Virtualization is today enjoying a rebirth as a technique to effectively share what had been considered large computing resources which subsequently faded from the spotlight as individual workstations gained in popularity with a ''one machine-one user'' approach. One reason for this resurgence is that the simple workstation has grown in capability to rival anything similar, available in the past. Thus, computing centers are again looking at the price/performance benefit of sharing that single computing box via server consolidation. However, industry is only concentrating on the benefits of using Virtualization for server consolidation (enterprise computing) whereas our interest is in leveraging Virtualization to advance high-performance computing (HPC). While these two interests may appear to be orthogonal, one consolidating multiple applications and users on a single machine while the other requires all the power from many machines to be dedicated solely to its purpose, we propose that Virtualization does provide attractive capabilities that may be exploited to the benefit of HPC interests. This does raise the two fundamental questions: is the concept of Virtualization (a machine ''sharing'' technology) really suitable for HPC and if so, how does one go about leveraging these Virtualization capabilities for the benefit of HPC. To address these questions, this document presents ongoing studies on the usage of system-Level Virtualization in a HPC context. These studies include an analysis of the benefits of system-Level Virtualization for HPC, a presentation of research efforts based on Virtualization for system availability, and a presentation of research efforts for the management of virtual systems. The basis for this document was the material presented by Stephen L. Scott at the Collaborative and Grid Computing Technologies meeting held in Cancun, Mexico on April 12-14, 2007.

  • Proceedings of the 3rd ACM Workshop on System-Level Virtualization for High Performance Computing
    2009
    Co-Authors: Stephen L. Scott, Geoffroy Vallée
    Abstract:

    The emergence of Virtualization enabled hardware, such as the latest generation AMD and Intel processors, has raised significant interest in High Performance Computing (HPC) community. In particular, system-Level Virtualization provides an opportunity to advance the design and development of operating systems, programming environments, administration practices, and resource management tools. This leads to some potential research topics for HPC, such as failure tolerance, system management, and solution for application porting to new HPC platforms. The workshop on System-Level Virtualization for HPC (HPCVirt 2009) is intended to be a forum for the exchange of ideas and experiences on the use of Virtualization technologies for HPC, the challenges and opportunities offered by the development of system-Level Virtualization solutions themselves, as well as case studies in the application of system-Level Virtualization in HPC.

  • system Level Virtualization for high performance computing
    Parallel Distributed and Network-Based Processing, 2008
    Co-Authors: Geoffroy Vallée, Thomas Naughton, Christian Engelmann, Hong Ong, Stephen L. Scott
    Abstract:

    System-Level Virtualization has been a research topic since the 70's but regained popularity during the past few years because of the availability of efficient solution such as Xen and the implementation of hardware support in commodity processors (e.g. Intel-VT, AMD-V). However, a majority of system-Level Virtualization projects is guided by the server consolidation market. As a result, current Virtualization solutions appear to not be suitable for high performance computing (HPC) which is typically based on large-scale systems. On another hand there is significant interest in exploiting virtual machines (VMs) within HPC for a number of other reasons. By visualizing the machine, one is able to run a variety of operating systems and environments as needed by the applications. Virtualization allows users to isolate workloads, improving security and reliability. It is also possible to support non-native environments and/or legacy operating environments through Virtualization. In addition, it is possible to balance work loads, use migration techniques to relocate applications from failing machines, and isolate fault systems for repair. This document presents the challenges for the implementation of a system-Level Virtualization solution for HPC. It also presents a brief survey of the different approaches and techniques to address these challenges.

Thomas Naughton - One of the best experts on this subject based on the ideXlab platform.

  • Euro-Par Workshops (1) - 5th workshop on system-Level Virtualization for high performance computing (HPCVirt 2011)
    Euro-Par 2011: Parallel Processing Workshops, 2012
    Co-Authors: Stephen L. Scott, Geoffroy Vallée, Thomas Naughton
    Abstract:

    The emergence of Virtualization enabled hardware, such as the latest generation AMD and Intel processors, has raised significant interest in High Performance Computing (HPC) community. In particular, system-Level Virtualization provides an opportunity to advance the design and development of operating systems, programming environments, administration practices, and resource management tools. This leads to some potential research topics for HPC, such as failure tolerance, system management, and solution for application porting to new HPC platforms. The workshop on System-Level Virtualization for HPC (HPCVirt 2011) is intended to be a forum for the exchange of ideas and experiences on the use of Virtualization technologies for HPC, the challenges and opportunities offered by the development of system-Level Virtualization solutions themselves, as well as case studies in the application of system-Level Virtualization in HPC.

  • 5th workshop on system Level Virtualization for high performance computing hpcvirt 2011
    International Conference on Parallel Processing, 2011
    Co-Authors: Stephen L. Scott, Geoffroy Vallée, Thomas Naughton
    Abstract:

    The emergence of Virtualization enabled hardware, such as the latest generation AMD and Intel processors, has raised significant interest in High Performance Computing (HPC) community. In particular, system-Level Virtualization provides an opportunity to advance the design and development of operating systems, programming environments, administration practices, and resource management tools. This leads to some potential research topics for HPC, such as failure tolerance, system management, and solution for application porting to new HPC platforms. The workshop on System-Level Virtualization for HPC (HPCVirt 2011) is intended to be a forum for the exchange of ideas and experiences on the use of Virtualization technologies for HPC, the challenges and opportunities offered by the development of system-Level Virtualization solutions themselves, as well as case studies in the application of system-Level Virtualization in HPC.

  • system Level Virtualization research at oak ridge national laboratory
    Future Generation Computer Systems, 2010
    Co-Authors: Stephen L. Scott, Geoffroy Vallée, Thomas Naughton, Christian Engelmann, Anand Tikotekar, Hong Ong
    Abstract:

    System-Level Virtualization is today enjoying a rebirth as a technique to effectively share what had been considered large computing resources which subsequently faded from the spotlight as individual workstations gained in popularity with a ''one machine-one user'' approach. One reason for this resurgence is that the simple workstation has grown in capability to rival anything similar, available in the past. Thus, computing centers are again looking at the price/performance benefit of sharing that single computing box via server consolidation. However, industry is only concentrating on the benefits of using Virtualization for server consolidation (enterprise computing) whereas our interest is in leveraging Virtualization to advance high-performance computing (HPC). While these two interests may appear to be orthogonal, one consolidating multiple applications and users on a single machine while the other requires all the power from many machines to be dedicated solely to its purpose, we propose that Virtualization does provide attractive capabilities that may be exploited to the benefit of HPC interests. This does raise the two fundamental questions: is the concept of Virtualization (a machine ''sharing'' technology) really suitable for HPC and if so, how does one go about leveraging these Virtualization capabilities for the benefit of HPC. To address these questions, this document presents ongoing studies on the usage of system-Level Virtualization in a HPC context. These studies include an analysis of the benefits of system-Level Virtualization for HPC, a presentation of research efforts based on Virtualization for system availability, and a presentation of research efforts for the management of virtual systems. The basis for this document was the material presented by Stephen L. Scott at the Collaborative and Grid Computing Technologies meeting held in Cancun, Mexico on April 12-14, 2007.

  • system Level Virtualization for high performance computing
    Parallel Distributed and Network-Based Processing, 2008
    Co-Authors: Geoffroy Vallée, Thomas Naughton, Christian Engelmann, Hong Ong, Stephen L. Scott
    Abstract:

    System-Level Virtualization has been a research topic since the 70's but regained popularity during the past few years because of the availability of efficient solution such as Xen and the implementation of hardware support in commodity processors (e.g. Intel-VT, AMD-V). However, a majority of system-Level Virtualization projects is guided by the server consolidation market. As a result, current Virtualization solutions appear to not be suitable for high performance computing (HPC) which is typically based on large-scale systems. On another hand there is significant interest in exploiting virtual machines (VMs) within HPC for a number of other reasons. By visualizing the machine, one is able to run a variety of operating systems and environments as needed by the applications. Virtualization allows users to isolate workloads, improving security and reliability. It is also possible to support non-native environments and/or legacy operating environments through Virtualization. In addition, it is possible to balance work loads, use migration techniques to relocate applications from failing machines, and isolate fault systems for repair. This document presents the challenges for the implementation of a system-Level Virtualization solution for HPC. It also presents a brief survey of the different approaches and techniques to address these challenges.

  • PDP - System-Level Virtualization for High Performance Computing
    16th Euromicro Conference on Parallel Distributed and Network-Based Processing (PDP 2008), 2008
    Co-Authors: Geoffroy Vallée, Thomas Naughton, Christian Engelmann, Hong Ong, Stephen L. Scott
    Abstract:

    System-Level Virtualization has been a research topic since the 70's but regained popularity during the past few years because of the availability of efficient solution such as Xen and the implementation of hardware support in commodity processors (e.g. Intel-VT, AMD-V). However, a majority of system-Level Virtualization projects is guided by the server consolidation market. As a result, current Virtualization solutions appear to not be suitable for high performance computing (HPC) which is typically based on large-scale systems. On another hand there is significant interest in exploiting virtual machines (VMs) within HPC for a number of other reasons. By visualizing the machine, one is able to run a variety of operating systems and environments as needed by the applications. Virtualization allows users to isolate workloads, improving security and reliability. It is also possible to support non-native environments and/or legacy operating environments through Virtualization. In addition, it is possible to balance work loads, use migration techniques to relocate applications from failing machines, and isolate fault systems for repair. This document presents the challenges for the implementation of a system-Level Virtualization solution for HPC. It also presents a brief survey of the different approaches and techniques to address these challenges.

Jinpeng Huai - One of the best experts on this subject based on the ideXlab platform.

  • MultiLanes: Providing Virtualized Storage for OS-Level Virtualization on Manycores
    ACM Transactions on Storage, 2016
    Co-Authors: Junbin Kang, Chunming Hu, Tianyu Wo, Ye Zhai, Benlong Zhang, Jinpeng Huai
    Abstract:

    OS-Level Virtualization is often used for server consolidation in data centers because of its high efficiency. However, the sharing of storage stack services among the colocated containers incurs contention on shared kernel data structures and locks within I/O stack, leading to severe performance degradation on manycore platforms incorporating fast storage technologies (e.g., SSDs based on nonvolatile memories). This article presents MultiLanes, a virtualized storage system for OS-Level Virtualization on manycores. MultiLanes builds an isolated I/O stack on top of a virtualized storage device for each container to eliminate contention on kernel data structures and locks between them, thus scaling them to manycores. Meanwhile, we propose a set of techniques to tune the overhead induced by storage-device Virtualization to be negligible, and to scale the virtualized devices to manycores on the host, which itself scales poorly. To reduce the contention within each single container, we further propose SFS, which runs multiple file-system instances through the proposed virtualized storage devices, distributes all files under each directory among the underlying file-system instances, then stacks a unified namespace on top of them. The evaluation of our prototype system built for Linux container (LXC) on a 32-core machine with both a RAM disk and a modern flash-based SSD demonstrates that MultiLanes scales much better than Linux in micro- and macro-benchmarks, bringing significant performance improvements, and that MultiLanes with SFS can further reduce the contention within each single container.

  • multilanes providing virtualized storage for os Level Virtualization on many cores
    File and Storage Technologies, 2014
    Co-Authors: Junbin Kang, Benlong Zhang, Jinpeng Huai
    Abstract:

    OS-Level Virtualization is an efficient method for server consolidation. However, the sharing of kernel services among the co-located virtualized environments (VEs) incurs performance interference between each other. Especially, interference effects within the shared I/O stack would lead to severe performance degradations on many-core platforms incorporating fast storage technologies (e.g., non-volatile memories). This paper presents MultiLanes, a virtualized storage system for OS-Level Virtualization on many cores. Multi-Lanes builds an isolated I/O stack on top of a virtualized storage device for each VE to eliminate contention on kernel data structures and locks between them, thus scaling them to many cores. Moreover, the overhead of storage device Virtualization is tuned to be negligible so that MultiLanes can deliver competitive performance against Linux. Apart from scalability, MultiLanes also delivers flexibility and security to all the VEs, as the virtualized storage device allows each VE to run its own guest file system. The evaluation of our prototype system built for Linux container (LXC) on a 16-core machine with a RAM disk demonstrates MultiLanes outperforms Linux by up to 11.32X and 11.75X in micro- and macro-benchmarks, and exhibits nearly linear scalability.

Edward David Moreno - One of the best experts on this subject based on the ideXlab platform.

  • performance evaluation of os Level Virtualization solutions for hpc purposes on soc based systems
    Advanced Information Networking and Applications, 2017
    Co-Authors: David Beserra, Manuele Kirsch Pinheiro, Luiz Angelo Steffenel, Carine Souveyet, Edward David Moreno
    Abstract:

    Systems-on-a-chip (SoC) represents a rupture on the traditional HPC infrastructure and started to be adopted together OS-Level Virtualization to provide services in Fog and Edge computing scenarios. In this work, we analyzed the performance of OS-Level Virtualization solutions - Linux Containers (LXC) and Docker - for HPC activities running in SoC systems in order to discover how OS-Level Virtualization and resource sharing affects the performance of virtualized environments. We evaluated CPU and (network and inter-process) communication performance taking in account two different scenarios: without communication between benchmark processes in execution and, with processes communication in a cooperative way. Results shows that both tools are suitable for HPC applications in SoC systems, despite the notice of some performance reduction due resource sharing.

  • Comparing the performance of OS-Level Virtualization tools in SoC-based systems: The case of I/O-bound applications
    2017 IEEE Symposium on Computers and Communications (ISCC), 2017
    Co-Authors: David Beserra, Manuele Kirsch Pinheiro, Luiz Angelo Steffenel, Carine Souveyet, Edward David Moreno
    Abstract:

    Organizations need process data in real time. Cloud Computing is a common choice but it presents high latency on data transfer. As an alternative to reduces the latency, Edge computing based on System-on-a-Chip systems (SoC-based systems) can retain part of the data processing, allowing resource sharing among multiple requests through the use of OS-Level Virtualization. In this work, we analyze the performance of two popular OS-Level Virtualization solutions - Linux Containers (LXC) and Docker - for I/O-bound activities running in SoC systems, in order to understand how resource sharing affects the processing performance.