The Experts below are selected from a list of 12 Experts worldwide ranked by ideXlab platform
Ismail Akturk - One of the best experts on this subject based on the ideXlab platform.
-
replication of Metadata in distributed storage systems asynchronous replication across multi Master servers
2011Co-Authors: Ismail AkturkAbstract:In this study, we examine various Metadata server layouts for distributed data storage systems in terms of high availability, scalability and performance. A central Metadata server is a single point of failure leading to low availability. Ensuring high availability requires replication of Metadata servers. Synchronously replicated Metadata servers layout introduces synchronization overhead which degrades the performance of data operations. We propose an asynchronously replicated multi-Master Metadata servers layout which ensures high availability, scalability and provides better performance. We discuss the implications of asynchronously replicated multi-Master Metadata servers on Metadata consistency and conict resolution. Furthermore, we introduce an asynchronous multi-Master replication tool that is deployed in the state-wide distributed data storage system called PetaShare, and compare performance of all three Metadata server layouts: central Metadata server, synchronously replicated multi-Master Metadata servers and asynchronously replicated multi-Master meta- data servers.
Wen Zhang - One of the best experts on this subject based on the ideXlab platform.
-
Master Metadata repository and Metadata management system
2007Co-Authors: Edward Armstrong, Nate Reed, Wen ZhangAbstract:A Master Metadata repository (MMR) software system manages the storage and searching of Metadata pertaining to data from national and international satellite sources of the Global Ocean Data Assimilation Experiment (GODAE) High Resolution Sea Surface Temperature Pilot Project [GHRSSTPP]. These sources produce a total of hundreds of data files daily, each file classified as one of more than ten data products representing global sea-surface temperatures. The MMR is a relational database wherein the Metadata are divided into granulelevel records [denoted file records (FRs)] for individual satellite files and collection-level records [denoted data set descriptions (DSDs)] that describe Metadata common to all the files from a specific data product. FRs and DSDs adhere to the NASA Directory Interchange Format (DIF). The FRs and DSDs are contained in separate subdatabases linked by a common field. The MMR is configured in MySQL database software with custom Practical Extraction and Reporting Language (PERL) programs to validate and ingest the Metadata records. The database contents are converted into the Federal Geographic Data Committee (FGDC) standard format by use of the Extensible Markup Language (XML). A Web interface enables users to search for availability of data from all sources.
David Loshin - One of the best experts on this subject based on the ideXlab platform.
-
chapter 7 identifying Master Metadata and Master data
Master Data Management, 2008Co-Authors: David LoshinAbstract:Publisher Summary It is necessary to identify the Master data object types and determine the data assets that make up those object types across the enterprise. This chapter discusses the process of identifying and finding the data sets that are candidates as sources for Master data and how to qualify them in terms of usability. This chapter considers the challenge of Master data discovery, which depends on the effective collection of Metadata from the many application data sets that are subject to inclusion in the Master data repository. This depends on a process for analyzing enterprise Metadata—assessing the similarity of syntax, structure, and semantics as a prelude to identifying enterprise sources of Master data. Because the objective in identifying and consolidating Master data representations requires empirical analysis and similarity assessment as part of the resolution process, it is reasonable to expect that tools will help in the process. The same kinds of tools and techniques that will subsequently be used to facilitate data integration can also be employed to isolate and catalog organizational Master data.
Edward Armstrong - One of the best experts on this subject based on the ideXlab platform.
-
Master Metadata repository and Metadata management system
2007Co-Authors: Edward Armstrong, Nate Reed, Wen ZhangAbstract:A Master Metadata repository (MMR) software system manages the storage and searching of Metadata pertaining to data from national and international satellite sources of the Global Ocean Data Assimilation Experiment (GODAE) High Resolution Sea Surface Temperature Pilot Project [GHRSSTPP]. These sources produce a total of hundreds of data files daily, each file classified as one of more than ten data products representing global sea-surface temperatures. The MMR is a relational database wherein the Metadata are divided into granulelevel records [denoted file records (FRs)] for individual satellite files and collection-level records [denoted data set descriptions (DSDs)] that describe Metadata common to all the files from a specific data product. FRs and DSDs adhere to the NASA Directory Interchange Format (DIF). The FRs and DSDs are contained in separate subdatabases linked by a common field. The MMR is configured in MySQL database software with custom Practical Extraction and Reporting Language (PERL) programs to validate and ingest the Metadata records. The database contents are converted into the Federal Geographic Data Committee (FGDC) standard format by use of the Extensible Markup Language (XML). A Web interface enables users to search for availability of data from all sources.
Nate Reed - One of the best experts on this subject based on the ideXlab platform.
-
Master Metadata repository and Metadata management system
2007Co-Authors: Edward Armstrong, Nate Reed, Wen ZhangAbstract:A Master Metadata repository (MMR) software system manages the storage and searching of Metadata pertaining to data from national and international satellite sources of the Global Ocean Data Assimilation Experiment (GODAE) High Resolution Sea Surface Temperature Pilot Project [GHRSSTPP]. These sources produce a total of hundreds of data files daily, each file classified as one of more than ten data products representing global sea-surface temperatures. The MMR is a relational database wherein the Metadata are divided into granulelevel records [denoted file records (FRs)] for individual satellite files and collection-level records [denoted data set descriptions (DSDs)] that describe Metadata common to all the files from a specific data product. FRs and DSDs adhere to the NASA Directory Interchange Format (DIF). The FRs and DSDs are contained in separate subdatabases linked by a common field. The MMR is configured in MySQL database software with custom Practical Extraction and Reporting Language (PERL) programs to validate and ingest the Metadata records. The database contents are converted into the Federal Geographic Data Committee (FGDC) standard format by use of the Extensible Markup Language (XML). A Web interface enables users to search for availability of data from all sources.