The Experts below are selected from a list of 9 Experts worldwide ranked by ideXlab platform

Xianhe Sun - One of the best experts on this subject based on the ideXlab platform.

  • hreplica a dynamic data Replication Engine with adaptive compression for multi tiered storage
    International Conference on Big Data, 2020
    Co-Authors: Hariharan Devarajan, Anthony Kougkas, Xianhe Sun
    Abstract:

    As the diversity of big data applications increases, their requirements diverge and often conflict with one other. Managing this diversity in any supercomputer or data center is a major challenge for system designers. Data Replication is a popular approach to meet several of these requirements, such as low latency, read availability, durability, etc. This approach can be enhanced using new modern heterogeneous hardware and software techniques such as data compression. However, both these enhancements work in isolation to the detriment of both. In this work, we present HReplica: a dynamic data Replication Engine which harmoniously leverages data compression and hierarchical storage to increase the effectiveness of data Replication. We have developed a novel dynamic selection algorithm that facilitates the optimal matching of Replication schemes, compression libraries, and tiered storage. Our evaluation shows that HReplica can improve scientific and cloud application performance by 5.2x when compared to other state-of-the-art Replication schemes.

Hariharan Devarajan - One of the best experts on this subject based on the ideXlab platform.

  • hreplica a dynamic data Replication Engine with adaptive compression for multi tiered storage
    International Conference on Big Data, 2020
    Co-Authors: Hariharan Devarajan, Anthony Kougkas, Xianhe Sun
    Abstract:

    As the diversity of big data applications increases, their requirements diverge and often conflict with one other. Managing this diversity in any supercomputer or data center is a major challenge for system designers. Data Replication is a popular approach to meet several of these requirements, such as low latency, read availability, durability, etc. This approach can be enhanced using new modern heterogeneous hardware and software techniques such as data compression. However, both these enhancements work in isolation to the detriment of both. In this work, we present HReplica: a dynamic data Replication Engine which harmoniously leverages data compression and hierarchical storage to increase the effectiveness of data Replication. We have developed a novel dynamic selection algorithm that facilitates the optimal matching of Replication schemes, compression libraries, and tiered storage. Our evaluation shows that HReplica can improve scientific and cloud application performance by 5.2x when compared to other state-of-the-art Replication schemes.

Anthony Kougkas - One of the best experts on this subject based on the ideXlab platform.

  • hreplica a dynamic data Replication Engine with adaptive compression for multi tiered storage
    International Conference on Big Data, 2020
    Co-Authors: Hariharan Devarajan, Anthony Kougkas, Xianhe Sun
    Abstract:

    As the diversity of big data applications increases, their requirements diverge and often conflict with one other. Managing this diversity in any supercomputer or data center is a major challenge for system designers. Data Replication is a popular approach to meet several of these requirements, such as low latency, read availability, durability, etc. This approach can be enhanced using new modern heterogeneous hardware and software techniques such as data compression. However, both these enhancements work in isolation to the detriment of both. In this work, we present HReplica: a dynamic data Replication Engine which harmoniously leverages data compression and hierarchical storage to increase the effectiveness of data Replication. We have developed a novel dynamic selection algorithm that facilitates the optimal matching of Replication schemes, compression libraries, and tiered storage. Our evaluation shows that HReplica can improve scientific and cloud application performance by 5.2x when compared to other state-of-the-art Replication schemes.

Vladimir Cretu - One of the best experts on this subject based on the ideXlab platform.

  • designing a dynamic Replication Engine for grid shared data programming
    Symbolic and Numeric Algorithms for Scientific Computing, 2008
    Co-Authors: Georgiana Macariu, Dacian Tudor, Vladimir Cretu
    Abstract:

    Besides the complexity of grid application programming, achieving high performance has become a real challenge in large scale grid systems mainly because of the high latencies and unpredictable communication paths. We follow the idea of shared data programming in grid environments and we design a Replication component for a shared data programming framework with dynamic Replication capabilities. We define several Replication policies that are dynamically used during the application life-cycle in order to minimize the communication cost and provide better performance. We evaluate several application scenarios in order to prove that dynamic policy based Replication can improve the overall application performance and reduce resource access time.

Georgiana Macariu - One of the best experts on this subject based on the ideXlab platform.

  • designing a dynamic Replication Engine for grid shared data programming
    Symbolic and Numeric Algorithms for Scientific Computing, 2008
    Co-Authors: Georgiana Macariu, Dacian Tudor, Vladimir Cretu
    Abstract:

    Besides the complexity of grid application programming, achieving high performance has become a real challenge in large scale grid systems mainly because of the high latencies and unpredictable communication paths. We follow the idea of shared data programming in grid environments and we design a Replication component for a shared data programming framework with dynamic Replication capabilities. We define several Replication policies that are dynamically used during the application life-cycle in order to minimize the communication cost and provide better performance. We evaluate several application scenarios in order to prove that dynamic policy based Replication can improve the overall application performance and reduce resource access time.