The Experts below are selected from a list of 693 Experts worldwide ranked by ideXlab platform
Xiao Liu - One of the best experts on this subject based on the ideXlab platform.
-
Necessary and sufficient checkpoint selection for Temporal verification of high-confidence cloud workflow systems
Science China Information Sciences, 2015Co-Authors: Futian Wang, Xiao LiuAbstract:On-time completion is an important Temporal QoS (Quality of Service) dimension and one of the fundamental requirements for high-confidence workflow systems. In recent years, a workflow Temporal verification framework, which generally consists of Temporal Constraint Setting, Temporal checkpoint selection, Temporal verification, and Temporal violation handling, has been the major approach for the high Temporal QoS assurance of workflow systems. Among them, effective Temporal checkpoint selection, which aims to timely detect intermediate Temporal violations along workflow execution plays a critical role. Therefore, Temporal checkpoint selection has been a major topic and has attracted significant efforts. In this paper, we will present an overview of work-flow Temporal checkpoint selection for Temporal verification. Specifically, we will first introduce the throughput based and response-time based Temporal consistency models for business and scientific cloud workflow systems, respectively. Then the corresponding benchmarking checkpoint selection strategies that satisfy the property of “necessity and sufficiency” are presented. We also provide experimental results to demonstrate the effectiveness of our checkpoint selection strategies, and finally points out some possible future issues in this research area.
-
Temporal Constraint Setting
Temporal QOS Management in Scientific Cloud Workflow Systems, 2012Co-Authors: Xiao Liu, Yun Yang, Jinjun ChenAbstract:As one of the most important workflow QoS dimensions and the focus in this book, the Temporal Constraint is the foundation of the entire Temporal framework. Temporal Constraint Setting is to deal with Temporal QoS specifications at workflow build time. As mentioned earlier, high Temporal QoS cannot be achieved without proper Setting of high-quality Temporal Constraints.
Jinjun Chen - One of the best experts on this subject based on the ideXlab platform.
-
Temporal Constraint Setting
Temporal QOS Management in Scientific Cloud Workflow Systems, 2012Co-Authors: Xiao Liu, Yun Yang, Jinjun ChenAbstract:As one of the most important workflow QoS dimensions and the focus in this book, the Temporal Constraint is the foundation of the entire Temporal framework. Temporal Constraint Setting is to deal with Temporal QoS specifications at workflow build time. As mentioned earlier, high Temporal QoS cannot be achieved without proper Setting of high-quality Temporal Constraints.
Liu Xiao - One of the best experts on this subject based on the ideXlab platform.
-
A novel probabilistic Temporal framework and its strategies for cost-effective delivery of high QoS in scientific cloud workflow systems
2011Co-Authors: Liu XiaoAbstract:Cloud computing is a latest market-oriented computing paradigm which can provide virtually unlimited scalable high performance computing resources. As a type of high-level middleware services for cloud computing, cloud workflow systems are a research frontier for both cloud computing and workflow technologies. Cloud workflows often underlie many large scale data/computation intensive e-science applications such as earthquake modelling, weather forecast and Astrophysics. At build-time modelling stage, these sophisticated processes are modelled or redesigned as cloud workflow specifications which normally contain the functional requirements for a large number of workflow activities and their non-functional requirements such as Quality of Service (QoS) Constraints. At runtime execution stage, cloud workflow instances are executed by employing the supercomputing and data sharing ability of the underlying cloud computing infrastructures. In this thesis, we focus on scientific cloud workflow systems. In the real world, many scientific applications need to be time constrained, i.e. they are required to be completed by satisfying a set of Temporal Constraints such as local Temporal Constraints (milestones) and global Temporal Constraints (deadlines). Meanwhile, task execution time (or activity duration), as one of the basic measurements for system performance, often needs to be monitored and controlled by specific system management mechanisms. Therefore, how to ensure satisfactory Temporal correctness (high Temporal QoS), i.e. how to guarantee on-time completion of most, if not all, workflow applications, is a critical issue for enhancing the overall performance and usability of scientific cloud workflow systems. At present, workflow Temporal verification is a key research area which focuses on time-constrained large-scale complex workflow applications in distributed high performance computing environments. However, existing studies mainly emphasise on monitoring and detection of Temporal violations (i.e. violations of Temporal Constraints) at workflow runtime, there is still no comprehensive framework which can support the whole lifecycle of time-constrained workflow applications in order to achieve high Temporal QoS. Meanwhile, cloud computing adopts a marketoriented resource model, i.e. cloud resources such as computing, storage and network are charged by their usage. Hence, the cost for supporting Temporal QoS (including both time overheads and monetary cost) should be managed effectively in scientific cloud workflow systems. This thesis proposes a novel probabilistic Temporal framework and its strategies for cost-effective delivery of high QoS in scientific cloud workflow systems (or Temporal framework for short in this thesis). By investigating the limitations of conventional Temporal QoS related research, our Temporal framework can provide a systematic and cost-effective support for time-constrained scientific cloud workflow applications over their whole lifecycles. With a probability based Temporal consistency model, there are three major components in the Temporal framework: Component 1 – Temporal Constraint Setting; Component 2 – Temporal consistency monitoring; Component 3 – Temporal violation handling. Based on the investigation and analysis, we propose some new concepts and develop a set of innovative strategies and algorithms towards cost-effective delivery of high Temporal QoS in scientific cloud workflow systems. Case study, comparisons, quantitative evaluations and/or mathematical proofs are presented for the evaluation of each component. These demonstrate that our new concepts, innovative strategies and algorithms for the Temporal framework can significantly reduce the cost for the detection and handling of Temporal violations while achieving high Temporal QoS in scientific cloud workflow systems. Specifically, at scientific cloud workflow build time, in Component 1, a statistical time-series pattern based forecasting strategy is first conducted to predict accurate duration intervals of scientific cloud workflow activities. Afterwards, based on the weighted joint normal distribution of workflow activity durations, a probabilistic Setting strategy is applied to assign coarse-grained Temporal Constraints through a negotiation process between service users and service providers, and then fine-grained Temporal Constraints can be propagated along scientific cloud workflows in an automatic fashion. At scientific cloud workflow runtime, in Component 2, the state of scientific cloud workflow execution towards specific Temporal Constraints, i.e. Temporal consistency, is monitored constantly with the following two steps: first, a minimum probability time redundancy based Temporal checkpoint selection strategy determines the workflow activities where potential Temporal violations take place; second, according to the probability based Temporal consistency model, Temporal verification is conducted on the selected checkpoints to check the current Temporal consistency states and the type of Temporal violations. In Component 3, detected Temporal violations are handled with the following two steps: first, an adaptive Temporal violation handling point selection strategy decides whether a Temporal checkpoint should be selected as a Temporal violation handling point to trigger Temporal violation handling strategies; Second, at Temporal violation handling points, different Temporal violation handling strategies are executed accordingly to tackle different types of Temporal violations. In our Temporal framework, we focus on metaheuristics based workflow rescheduling strategies for handling statistically recoverable Temporal violations. The major contributions of this research are that we have proposed a novel comprehensive Temporal framework which consists of a set of new concepts, innovative strategies and algorithms for supporting time-constrained scientific applications over their whole lifecycles in cloud workflow systems. With these, we can significantly reduce the cost for detection and handling of Temporal violations whilst delivering high Temporal QoS in scientific cloud workflow systems. This would eventually improve the overall performance and usability of cloud workflow systems because a Temporal framework can be viewed as a software service for cloud workflow systems. Consequently, by deploying the new concepts, innovative strategies and algorithms, scientific cloud workflow systems would be able to better support large-scale sophisticated e-science applications in the context of cloud economy
Yun Yang - One of the best experts on this subject based on the ideXlab platform.
-
Temporal Constraint Setting
Temporal QOS Management in Scientific Cloud Workflow Systems, 2012Co-Authors: Xiao Liu, Yun Yang, Jinjun ChenAbstract:As one of the most important workflow QoS dimensions and the focus in this book, the Temporal Constraint is the foundation of the entire Temporal framework. Temporal Constraint Setting is to deal with Temporal QoS specifications at workflow build time. As mentioned earlier, high Temporal QoS cannot be achieved without proper Setting of high-quality Temporal Constraints.
Futian Wang - One of the best experts on this subject based on the ideXlab platform.
-
Necessary and sufficient checkpoint selection for Temporal verification of high-confidence cloud workflow systems
Science China Information Sciences, 2015Co-Authors: Futian Wang, Xiao LiuAbstract:On-time completion is an important Temporal QoS (Quality of Service) dimension and one of the fundamental requirements for high-confidence workflow systems. In recent years, a workflow Temporal verification framework, which generally consists of Temporal Constraint Setting, Temporal checkpoint selection, Temporal verification, and Temporal violation handling, has been the major approach for the high Temporal QoS assurance of workflow systems. Among them, effective Temporal checkpoint selection, which aims to timely detect intermediate Temporal violations along workflow execution plays a critical role. Therefore, Temporal checkpoint selection has been a major topic and has attracted significant efforts. In this paper, we will present an overview of work-flow Temporal checkpoint selection for Temporal verification. Specifically, we will first introduce the throughput based and response-time based Temporal consistency models for business and scientific cloud workflow systems, respectively. Then the corresponding benchmarking checkpoint selection strategies that satisfy the property of “necessity and sufficiency” are presented. We also provide experimental results to demonstrate the effectiveness of our checkpoint selection strategies, and finally points out some possible future issues in this research area.
