Data Quality Process

14,000,000 Leading Edge Experts on the ideXlab platform

Scan Science and Technology

Contact Leading Edge Experts & Companies

Scan Science and Technology

Contact Leading Edge Experts & Companies

The Experts below are selected from a list of 459666 Experts worldwide ranked by ideXlab platform

Melinda Hodkiewicz - One of the best experts on this subject based on the ideXlab platform.

  • goal hierarchy improving asset Data Quality by improving motivation
    Reliability Engineering & System Safety, 2011
    Co-Authors: Kerrie L. Unsworth, Elisa Adriasola, Amber Johnstonbillings, Alina Dmitrieva, Melinda Hodkiewicz
    Abstract:

    Many have recognized the need for high Quality Data on assets and the problems in obtaining them, particularly when there is a need for human observation and manual recording. Yet very few have looked at the role of the Data collectors themselves in the Data Quality Process. This paper argues that there are benefits to more fully understanding the psychological factors that lay behind Data collection and we use goal hierarchy theory to understand these factors. Given the myriad of potential reasons for poor-Quality Data it has previously proven difficult to identify and successfully deploy employee-driven interventions; however, the goal hierarchy approach looks at all of the goals that an individual has in their life and the connections between them. For instance, does collecting Data relate to whether or not they get a promotion? Stay safe? Get a new job? and so on. By eliciting these goals and their connections we can identify commonalities across different groups, sites or organizations that can influence the Quality of Data collection. Thus, rather than assuming what the Data collectors want, a goal hierarchy approach determines that empirically. Practically, this supports the development of customized interventions that will be much more effective and sustainable than previous efforts.

Kerrie L. Unsworth - One of the best experts on this subject based on the ideXlab platform.

  • goal hierarchy improving asset Data Quality by improving motivation
    Reliability Engineering & System Safety, 2011
    Co-Authors: Kerrie L. Unsworth, Elisa Adriasola, Amber Johnstonbillings, Alina Dmitrieva, Melinda Hodkiewicz
    Abstract:

    Many have recognized the need for high Quality Data on assets and the problems in obtaining them, particularly when there is a need for human observation and manual recording. Yet very few have looked at the role of the Data collectors themselves in the Data Quality Process. This paper argues that there are benefits to more fully understanding the psychological factors that lay behind Data collection and we use goal hierarchy theory to understand these factors. Given the myriad of potential reasons for poor-Quality Data it has previously proven difficult to identify and successfully deploy employee-driven interventions; however, the goal hierarchy approach looks at all of the goals that an individual has in their life and the connections between them. For instance, does collecting Data relate to whether or not they get a promotion? Stay safe? Get a new job? and so on. By eliciting these goals and their connections we can identify commonalities across different groups, sites or organizations that can influence the Quality of Data collection. Thus, rather than assuming what the Data collectors want, a goal hierarchy approach determines that empirically. Practically, this supports the development of customized interventions that will be much more effective and sustainable than previous efforts.

Ordenã, Antónia Melicia De Sousa - One of the best experts on this subject based on the ideXlab platform.

  • Análise e implementação de melhorias de qualidade de dados no Processo de migração da informação de clientes
    Instituto Superior de Economia e Gestão, 2018
    Co-Authors: Ordenã, Antónia Melicia De Sousa
    Abstract:

    Mestrado em Gestão de Sistemas de InformaçãoO aumento da quantidade de dados relevou a importância da qualidade nos dados. Considerando este fator a empresa FinanceQ, no âmbito do projeto de migração, reconheceu a importância de melhorar a qualidade dos dados a migrar. Nesse sentido requisitou os serviços da empresa SIGQ e definiu como objetivos de projeto analisar a qualidade de dados atual; aplicar medidas de normalização nos dados; e aplicar medidas de enriquecimento nos atributos de morada. Considerando os objetivos definidos utilizou-se o software SAS Dataflux e aplicou-se a metodologia da aplicação composta por três fases: planeamento; ação; e monitorização. Durante o Processo de qualidade foram aplicadas técnicas de Data profiling para analisar os dados e a taxonomia de Oliveira et al.(2005) para identificar o tipo de anomalia nos dados. Quanto a melhoria de qualidade de dados seguiu-se a estratégia reativa onde foram aplicadas técnicas de normalização e enriquecimento para solucionar os problemas identificados: valores sem significado; valores a null; padrões inadequados para o atributo; erros ortográficos; existência de sinónimos; e valores fora do domínio dos atributos. Na fase final do projeto foi possível identificar que as técnicas aplicadas permitiram designar corretamente os géneros, reorganizar os números de telefone e validar os padrões de valores; as ações de limpeza e correção dos dados eliminaram os valores sem significado e corrigiram os erros ortográficos; O Processo de enriquecimento normalizou os dados e enriqueceu os atributos de código postal em 80% dos registos. Na generalidade as técnicas aplicadas impactaram as características dos dados exatidão, objetividade, completude e consistência.The increasing availability of Data highlighted the importance of Data Quality. Considering this factor the company FinanceQ acknowledged the importance of improving Data Quality in their migration project. With this goal in mind, they requested the services of the company SIGQ to analyse and implement Data Quality procedures. The goal of this project centred on three key issues: analysis of the current Data Quality; normalization of Data; and address Data enrichment. To fulfil the defined goals FinanceQ acquired the software SAS Dataflux and applied the SAS Dataflux methodology composed of three steps: planning; action; and monitoring. During the Data Quality Process, Data profiling techniques were applied to analyse Data and the taxonomy of Oliveira et al. (2005) was considered to identify anomaly types. A Data driven strategy was used for Quality improvement and the techniques applied were Data normalization and Data enrichment to solve the identified problems: meaningless values; missing values; inadequate patterns; misspellings; synonymous; and values behind the context. In the last stage of the project it was possible to verify that the applied techniques allowed for correct designation of the gender fields, reorganization of telephone numbers and identification of measures to validate value patterns; the Data cleaning and treatment helped to eliminate meaningless values and correct misspellings; the Data enrichment Process of addresses permitted normalisation and enrichment of the postal code fields in 80% of the records. In general, the goals of the applied techniques were to improve the Data Quality dimensions accuracy, objectivity, completeness and consistency.info:eu-repo/semantics/publishedVersio

Elisa Adriasola - One of the best experts on this subject based on the ideXlab platform.

  • goal hierarchy improving asset Data Quality by improving motivation
    Reliability Engineering & System Safety, 2011
    Co-Authors: Kerrie L. Unsworth, Elisa Adriasola, Amber Johnstonbillings, Alina Dmitrieva, Melinda Hodkiewicz
    Abstract:

    Many have recognized the need for high Quality Data on assets and the problems in obtaining them, particularly when there is a need for human observation and manual recording. Yet very few have looked at the role of the Data collectors themselves in the Data Quality Process. This paper argues that there are benefits to more fully understanding the psychological factors that lay behind Data collection and we use goal hierarchy theory to understand these factors. Given the myriad of potential reasons for poor-Quality Data it has previously proven difficult to identify and successfully deploy employee-driven interventions; however, the goal hierarchy approach looks at all of the goals that an individual has in their life and the connections between them. For instance, does collecting Data relate to whether or not they get a promotion? Stay safe? Get a new job? and so on. By eliciting these goals and their connections we can identify commonalities across different groups, sites or organizations that can influence the Quality of Data collection. Thus, rather than assuming what the Data collectors want, a goal hierarchy approach determines that empirically. Practically, this supports the development of customized interventions that will be much more effective and sustainable than previous efforts.

Amber Johnstonbillings - One of the best experts on this subject based on the ideXlab platform.

  • goal hierarchy improving asset Data Quality by improving motivation
    Reliability Engineering & System Safety, 2011
    Co-Authors: Kerrie L. Unsworth, Elisa Adriasola, Amber Johnstonbillings, Alina Dmitrieva, Melinda Hodkiewicz
    Abstract:

    Many have recognized the need for high Quality Data on assets and the problems in obtaining them, particularly when there is a need for human observation and manual recording. Yet very few have looked at the role of the Data collectors themselves in the Data Quality Process. This paper argues that there are benefits to more fully understanding the psychological factors that lay behind Data collection and we use goal hierarchy theory to understand these factors. Given the myriad of potential reasons for poor-Quality Data it has previously proven difficult to identify and successfully deploy employee-driven interventions; however, the goal hierarchy approach looks at all of the goals that an individual has in their life and the connections between them. For instance, does collecting Data relate to whether or not they get a promotion? Stay safe? Get a new job? and so on. By eliciting these goals and their connections we can identify commonalities across different groups, sites or organizations that can influence the Quality of Data collection. Thus, rather than assuming what the Data collectors want, a goal hierarchy approach determines that empirically. Practically, this supports the development of customized interventions that will be much more effective and sustainable than previous efforts.