The Experts below are selected from a list of 10689 Experts worldwide ranked by ideXlab platform
Ting Dai - One of the best experts on this subject based on the ideXlab platform.
-
tfix automatic timeout bug fixing in Production Server systems
International Conference on Distributed Computing Systems, 2019Co-Authors: Ting DaiAbstract:Timeout is widely used to handle unexpected failures in distributed systems. However, improper use of timeout schemes can cause serious availability and performance issues, which is often difficult to fix due to lack of diagnostic information. In this paper, we present TFix, an automatic timeout bug fixing system for correcting misused timeout bugs in Production systems. TFix adopts a drill-down bug analysis protocol that can narrow down the root cause of a misused timeout bug and producing recommendations for correcting the root cause. TFix first employs a system call frequent episode mining scheme to check whether a timeout bug is caused by a misused timeout variable. TFix then employs application tracing to identify timeout affected functions. Next, TFix uses taint analysis to localize the misused timeout variable. Last, TFix produces recommendations for proper timeout variable values based on the tracing results during normal runs. We have implemented a prototype of TFix and conducted extensive experiments using 13 real world Server timeout bugs. Our experimental results show that TFix can correctly localize the misused timeout variables and suggest proper timeout values for fixing those bugs.
-
ICDCS - TFix: Automatic Timeout Bug Fixing in Production Server Systems
2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS), 2019Co-Authors: Ting DaiAbstract:Timeout is widely used to handle unexpected failures in distributed systems. However, improper use of timeout schemes can cause serious availability and performance issues, which is often difficult to fix due to lack of diagnostic information. In this paper, we present TFix, an automatic timeout bug fixing system for correcting misused timeout bugs in Production systems. TFix adopts a drill-down bug analysis protocol that can narrow down the root cause of a misused timeout bug and producing recommendations for correcting the root cause. TFix first employs a system call frequent episode mining scheme to check whether a timeout bug is caused by a misused timeout variable. TFix then employs application tracing to identify timeout affected functions. Next, TFix uses taint analysis to localize the misused timeout variable. Last, TFix produces recommendations for proper timeout variable values based on the tracing results during normal runs. We have implemented a prototype of TFix and conducted extensive experiments using 13 real world Server timeout bugs. Our experimental results show that TFix can correctly localize the misused timeout variables and suggest proper timeout values for fixing those bugs.
-
ICAC - TScope: Automatic Timeout Bug Identification for Server Systems
2018 IEEE International Conference on Autonomic Computing (ICAC), 2018Co-Authors: Ting DaiAbstract:Timeout is commonly used to handle unexpected failures in Server systems. However, improper use of timeout can cause Server systems to hang or experience performance degradation. In this paper, we present TScope, an automatic timeout bug identification tool for Server systems. TScope leverages kernel-level system call tracing and machine learning based anomaly detection and feature extraction schemes to achieve timeout bug identification. TScope introduces a unique system call selection scheme to achieve higher accuracy than existing generic performance bug detection tools. We have implemented a prototype of TScope and conducted extensive experiments using 19 real-world Server performance bugs, including 12 timeout bugs and 7 non-timeout performance bugs. The experimental results show that TScope correctly classifies 18 out of 19 bugs. Compared to existing runtime bug detection schemes, TScope reduces the average false positive rate from 47.24% to 0.8%. TScope is light-weight and does not require application instrumentation, which makes it practical for Production Server performance bug identification.
Vivek Narasayya - One of the best experts on this subject based on the ideXlab platform.
-
database tuning advisor for microsoft sql Server 2005 demo
International Conference on Management of Data, 2005Co-Authors: Sanjay Agrawal, Surajit Chaudhuri, Vivek Narasayya, Lubor Kollar, Arun Marathe, Manoj SyamalaAbstract:Database Tuning Advisor (DTA) is a physical database design tool that is part of Microsoft's SQL Server 2005 relational database management system. Previously known as "Index Tuning Wizard" in SQL Server 7.0 and SQL Server 2000, DTA adds new functionality that is not available in other contemporary physical design tuning tools. Novel aspects of DTA that will be demonstrated include: (a) Ability to take into account both performance and manageability requirements of DBAs (b) Fully integrated recommendations for indexes, materialized views and horizontal partitioning (c) Transparently leverage a test Server to offload tuning load from Production Server and (d) Easy programmability and scriptability.
-
SIGMOD Conference - Database tuning advisor for microsoft SQL Server 2005: demo
Proceedings of the 2005 ACM SIGMOD international conference on Management of data - SIGMOD '05, 2005Co-Authors: Sanjay Agrawal, Surajit Chaudhuri, Vivek Narasayya, Lubor Kollar, Arun Marathe, Manoj SyamalaAbstract:Database Tuning Advisor (DTA) is a physical database design tool that is part of Microsoft's SQL Server 2005 relational database management system. Previously known as "Index Tuning Wizard" in SQL Server 7.0 and SQL Server 2000, DTA adds new functionality that is not available in other contemporary physical design tuning tools. Novel aspects of DTA that will be demonstrated include: (a) Ability to take into account both performance and manageability requirements of DBAs (b) Fully integrated recommendations for indexes, materialized views and horizontal partitioning (c) Transparently leverage a test Server to offload tuning load from Production Server and (d) Easy programmability and scriptability.
-
ICDE - SQLCM: a continuous monitoring framework for relational database engines
Proceedings. 20th International Conference on Data Engineering, 2004Co-Authors: Surajit Chaudhuri, A.c. Konig, Vivek NarasayyaAbstract:The ability to monitor a database Server is crucial for effective database administration. Today's commercial database systems support two basic mechanisms for monitoring: (a) obtaining a snapshot of counters to capture current state, and (b) logging events in the Server to a table/file to capture history. We show that for a large class of important database administration tasks the above mechanisms are inadequate in functionality or performance. We present an infrastructure called SQLCM that enables continuous monitoring inside the database Server and that has the ability to automatically take actions based on monitoring. We describe the implementation of SQLCM in Microsoft SQL Server and show how several common and important monitoring tasks can be easily specified in SQLCM. Our experimental evaluation indicates that SQLCM imposes low overhead on normal Server execution end enables monitoring tasks on a Production Server that would be too expensive using today's monitoring mechanisms.
-
database tuning advisor for microsoft sql Server 2005
Very Large Data Bases, 2004Co-Authors: Sanjay Agrawal, Surajit Chaudhuri, Vivek Narasayya, Lubor Kollar, Arunprasad P Marathe, Manoj SyamalaAbstract:Publisher Summary This chapter provides an overview of Database Tuning Advisor's (DTA's) novel functionality, the rationale for its architecture, and demonstrates DTA's quality and scalability on large customer workloads. The DTA is part of Microsoft SQL Server 2005. It is an automated physical database design tool that significantly advances the state-of-the-art in several ways. First, the DTA is capable of providing an integrated physical design recommendation for horizontal partitioning, indexes, and materialized views. Second, unlike today's physical design tools that focus solely on performance, the DTA also supports the capability for a database administrator (DBA) to specify manageability requirements while optimizing for performance. Third, the DTA is able to scale to large databases and workloads using several novel techniques including: workload compression, reduced statistics creation, and exploiting test Server to reduce load on Production Server. Finally, the DTA greatly enhances scriptability and customization through the use of a public XML schema for input and output.
-
VLDB - Database Tuning Advisor for Microsoft SQL Server 2005
Proceedings 2004 VLDB Conference, 2004Co-Authors: Sanjay Agrawal, Surajit Chaudhuri, Vivek Narasayya, Lubor Kollar, Arunprasad P Marathe, Manoj SyamalaAbstract:Publisher Summary This chapter provides an overview of Database Tuning Advisor's (DTA's) novel functionality, the rationale for its architecture, and demonstrates DTA's quality and scalability on large customer workloads. The DTA is part of Microsoft SQL Server 2005. It is an automated physical database design tool that significantly advances the state-of-the-art in several ways. First, the DTA is capable of providing an integrated physical design recommendation for horizontal partitioning, indexes, and materialized views. Second, unlike today's physical design tools that focus solely on performance, the DTA also supports the capability for a database administrator (DBA) to specify manageability requirements while optimizing for performance. Third, the DTA is able to scale to large databases and workloads using several novel techniques including: workload compression, reduced statistics creation, and exploiting test Server to reduce load on Production Server. Finally, the DTA greatly enhances scriptability and customization through the use of a public XML schema for input and output.
Surajit Chaudhuri - One of the best experts on this subject based on the ideXlab platform.
-
database tuning advisor for microsoft sql Server 2005 demo
International Conference on Management of Data, 2005Co-Authors: Sanjay Agrawal, Surajit Chaudhuri, Vivek Narasayya, Lubor Kollar, Arun Marathe, Manoj SyamalaAbstract:Database Tuning Advisor (DTA) is a physical database design tool that is part of Microsoft's SQL Server 2005 relational database management system. Previously known as "Index Tuning Wizard" in SQL Server 7.0 and SQL Server 2000, DTA adds new functionality that is not available in other contemporary physical design tuning tools. Novel aspects of DTA that will be demonstrated include: (a) Ability to take into account both performance and manageability requirements of DBAs (b) Fully integrated recommendations for indexes, materialized views and horizontal partitioning (c) Transparently leverage a test Server to offload tuning load from Production Server and (d) Easy programmability and scriptability.
-
SIGMOD Conference - Database tuning advisor for microsoft SQL Server 2005: demo
Proceedings of the 2005 ACM SIGMOD international conference on Management of data - SIGMOD '05, 2005Co-Authors: Sanjay Agrawal, Surajit Chaudhuri, Vivek Narasayya, Lubor Kollar, Arun Marathe, Manoj SyamalaAbstract:Database Tuning Advisor (DTA) is a physical database design tool that is part of Microsoft's SQL Server 2005 relational database management system. Previously known as "Index Tuning Wizard" in SQL Server 7.0 and SQL Server 2000, DTA adds new functionality that is not available in other contemporary physical design tuning tools. Novel aspects of DTA that will be demonstrated include: (a) Ability to take into account both performance and manageability requirements of DBAs (b) Fully integrated recommendations for indexes, materialized views and horizontal partitioning (c) Transparently leverage a test Server to offload tuning load from Production Server and (d) Easy programmability and scriptability.
-
database tuning advisor
2004Co-Authors: Alexander Raizman, Sanjay Agrawal, Lubor Kollar, Manoj Syamala, Arunprasad P Marathe, Djana Ophelia Clay Milton, Dmitry Sonkin, Maciej Sarnowicz, Raja S Duddupudi, Surajit ChaudhuriAbstract:An automated physical database design tool may provide an integrated physical design recommendation for horizontal partitioning, indexes and indexed views, all three features being tuned together (in concert). Manageability requirements may be specified when optimizing for performance. User-specified configuration may enable the specification of a partial physical design without materialization of the physical design. The tuning process may be performed for a Production Server but may be conducted substantially on a test Server. Secondary indexes may be suggested for XML columns. Tuning of a database may be invoked by any owner of a database. Usage of objects may be evaluated and a recommendation for dropping unused objects may be issued. Reports may be provided concerning the count and percentage of queries in the workload that reference a particular database, and/or the count and percentage of queries in the workload that reference a particular table or column. A feature may be provided whereby a weight may be associated with each statement in the workload, enabling relative importance of particular statements to be specified. An in-row length for a column may be specified. If a value for the column exceeds the specified in-row length for that column, the portion of the value not exceeding the specified in-row length may be stored in the row while the portion of the value exceeding the specified in-row length may be stored in an overflow area. Rebuild and reorganization recommendations may be generated.
-
ICDE - SQLCM: a continuous monitoring framework for relational database engines
Proceedings. 20th International Conference on Data Engineering, 2004Co-Authors: Surajit Chaudhuri, A.c. Konig, Vivek NarasayyaAbstract:The ability to monitor a database Server is crucial for effective database administration. Today's commercial database systems support two basic mechanisms for monitoring: (a) obtaining a snapshot of counters to capture current state, and (b) logging events in the Server to a table/file to capture history. We show that for a large class of important database administration tasks the above mechanisms are inadequate in functionality or performance. We present an infrastructure called SQLCM that enables continuous monitoring inside the database Server and that has the ability to automatically take actions based on monitoring. We describe the implementation of SQLCM in Microsoft SQL Server and show how several common and important monitoring tasks can be easily specified in SQLCM. Our experimental evaluation indicates that SQLCM imposes low overhead on normal Server execution end enables monitoring tasks on a Production Server that would be too expensive using today's monitoring mechanisms.
-
database tuning advisor for microsoft sql Server 2005
Very Large Data Bases, 2004Co-Authors: Sanjay Agrawal, Surajit Chaudhuri, Vivek Narasayya, Lubor Kollar, Arunprasad P Marathe, Manoj SyamalaAbstract:Publisher Summary This chapter provides an overview of Database Tuning Advisor's (DTA's) novel functionality, the rationale for its architecture, and demonstrates DTA's quality and scalability on large customer workloads. The DTA is part of Microsoft SQL Server 2005. It is an automated physical database design tool that significantly advances the state-of-the-art in several ways. First, the DTA is capable of providing an integrated physical design recommendation for horizontal partitioning, indexes, and materialized views. Second, unlike today's physical design tools that focus solely on performance, the DTA also supports the capability for a database administrator (DBA) to specify manageability requirements while optimizing for performance. Third, the DTA is able to scale to large databases and workloads using several novel techniques including: workload compression, reduced statistics creation, and exploiting test Server to reduce load on Production Server. Finally, the DTA greatly enhances scriptability and customization through the use of a public XML schema for input and output.
Manoj Syamala - One of the best experts on this subject based on the ideXlab platform.
-
database tuning advisor for microsoft sql Server 2005 demo
International Conference on Management of Data, 2005Co-Authors: Sanjay Agrawal, Surajit Chaudhuri, Vivek Narasayya, Lubor Kollar, Arun Marathe, Manoj SyamalaAbstract:Database Tuning Advisor (DTA) is a physical database design tool that is part of Microsoft's SQL Server 2005 relational database management system. Previously known as "Index Tuning Wizard" in SQL Server 7.0 and SQL Server 2000, DTA adds new functionality that is not available in other contemporary physical design tuning tools. Novel aspects of DTA that will be demonstrated include: (a) Ability to take into account both performance and manageability requirements of DBAs (b) Fully integrated recommendations for indexes, materialized views and horizontal partitioning (c) Transparently leverage a test Server to offload tuning load from Production Server and (d) Easy programmability and scriptability.
-
SIGMOD Conference - Database tuning advisor for microsoft SQL Server 2005: demo
Proceedings of the 2005 ACM SIGMOD international conference on Management of data - SIGMOD '05, 2005Co-Authors: Sanjay Agrawal, Surajit Chaudhuri, Vivek Narasayya, Lubor Kollar, Arun Marathe, Manoj SyamalaAbstract:Database Tuning Advisor (DTA) is a physical database design tool that is part of Microsoft's SQL Server 2005 relational database management system. Previously known as "Index Tuning Wizard" in SQL Server 7.0 and SQL Server 2000, DTA adds new functionality that is not available in other contemporary physical design tuning tools. Novel aspects of DTA that will be demonstrated include: (a) Ability to take into account both performance and manageability requirements of DBAs (b) Fully integrated recommendations for indexes, materialized views and horizontal partitioning (c) Transparently leverage a test Server to offload tuning load from Production Server and (d) Easy programmability and scriptability.
-
database tuning advisor
2004Co-Authors: Alexander Raizman, Sanjay Agrawal, Lubor Kollar, Manoj Syamala, Arunprasad P Marathe, Djana Ophelia Clay Milton, Dmitry Sonkin, Maciej Sarnowicz, Raja S Duddupudi, Surajit ChaudhuriAbstract:An automated physical database design tool may provide an integrated physical design recommendation for horizontal partitioning, indexes and indexed views, all three features being tuned together (in concert). Manageability requirements may be specified when optimizing for performance. User-specified configuration may enable the specification of a partial physical design without materialization of the physical design. The tuning process may be performed for a Production Server but may be conducted substantially on a test Server. Secondary indexes may be suggested for XML columns. Tuning of a database may be invoked by any owner of a database. Usage of objects may be evaluated and a recommendation for dropping unused objects may be issued. Reports may be provided concerning the count and percentage of queries in the workload that reference a particular database, and/or the count and percentage of queries in the workload that reference a particular table or column. A feature may be provided whereby a weight may be associated with each statement in the workload, enabling relative importance of particular statements to be specified. An in-row length for a column may be specified. If a value for the column exceeds the specified in-row length for that column, the portion of the value not exceeding the specified in-row length may be stored in the row while the portion of the value exceeding the specified in-row length may be stored in an overflow area. Rebuild and reorganization recommendations may be generated.
-
database tuning advisor for microsoft sql Server 2005
Very Large Data Bases, 2004Co-Authors: Sanjay Agrawal, Surajit Chaudhuri, Vivek Narasayya, Lubor Kollar, Arunprasad P Marathe, Manoj SyamalaAbstract:Publisher Summary This chapter provides an overview of Database Tuning Advisor's (DTA's) novel functionality, the rationale for its architecture, and demonstrates DTA's quality and scalability on large customer workloads. The DTA is part of Microsoft SQL Server 2005. It is an automated physical database design tool that significantly advances the state-of-the-art in several ways. First, the DTA is capable of providing an integrated physical design recommendation for horizontal partitioning, indexes, and materialized views. Second, unlike today's physical design tools that focus solely on performance, the DTA also supports the capability for a database administrator (DBA) to specify manageability requirements while optimizing for performance. Third, the DTA is able to scale to large databases and workloads using several novel techniques including: workload compression, reduced statistics creation, and exploiting test Server to reduce load on Production Server. Finally, the DTA greatly enhances scriptability and customization through the use of a public XML schema for input and output.
-
VLDB - Database Tuning Advisor for Microsoft SQL Server 2005
Proceedings 2004 VLDB Conference, 2004Co-Authors: Sanjay Agrawal, Surajit Chaudhuri, Vivek Narasayya, Lubor Kollar, Arunprasad P Marathe, Manoj SyamalaAbstract:Publisher Summary This chapter provides an overview of Database Tuning Advisor's (DTA's) novel functionality, the rationale for its architecture, and demonstrates DTA's quality and scalability on large customer workloads. The DTA is part of Microsoft SQL Server 2005. It is an automated physical database design tool that significantly advances the state-of-the-art in several ways. First, the DTA is capable of providing an integrated physical design recommendation for horizontal partitioning, indexes, and materialized views. Second, unlike today's physical design tools that focus solely on performance, the DTA also supports the capability for a database administrator (DBA) to specify manageability requirements while optimizing for performance. Third, the DTA is able to scale to large databases and workloads using several novel techniques including: workload compression, reduced statistics creation, and exploiting test Server to reduce load on Production Server. Finally, the DTA greatly enhances scriptability and customization through the use of a public XML schema for input and output.
Björn Franke - One of the best experts on this subject based on the ideXlab platform.
-
ICDCS - Right-Sizing Server Capacity Headroom for Global Online Services
2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS), 2018Co-Authors: Chad Verbowski, Ed Thayer, Paolo Costa, Hugh Leather, Björn FrankeAbstract:We present a capacity planning case study showing a significant opportunity for improving the utilization of a large, low-latency, highly available online service containing 100K+ Servers spanning 9 geographic regions. Analyzing 30 PB of traces over 90 days we devised a new iterative black-box capacity planning model using the discovered relationships between workload, utilization, and quality. We verified the model on 1,000s of Servers showing capacity reductions between 20% and 40% with effectively no impact on workload latency, availability, or the capacity required for disaster recovery. These results are confirmed experimentally by shrinking Production Server pools to cause the remaining Servers to run at higher utilization, and using data from real-world large scale unplanned failures. Finally, we show examples of using our model for offline regression analysis to detect critical issues before their deployment.
