Utility-driven assessment of data quality

• Published in: ACM SIGMIS Database: the DATABASE for Advances in Information Systems Vol. 38; no. 2; pp. 75 - 93
• Main Authors: Even, Adir, Shankaranarayanan, G.
• Format: Journal Article Trade Publication Article
• Language: English
• Published: New York ACM-SIGMIS 28.05.2007
• Subjects: Information management; Measurement techniques; Metadata; Studies; Total quality
• ISSN: 0095-0033; 1532-0936; 1532-0936
• DOI: 10.1145/1240616.1240623

Data consumers assess quality within specific business contexts or decision tasks. The same data resource may have an acceptable level of quality for some contexts but this quality may be unacceptable for other contexts. However, existing data quality metrics are mostly derived impartially, disconnected from the specific contextual characteristics. This study argues for the need to revise data quality metrics and measurement techniques to incorporate and better reflect contextual assessment. It contributes to that end by developing new metrics for assessing data quality along commonly used dimensions - completeness, validity, accuracy, and currency. The metrics are driven by data utility, a conceptual measure of the business value that is associated with the data within a specific usage context. The suggested data quality measurement framework uses utility as a scaling factor for calculating quality measurements at different levels of data hierarchy. Examples are used to demonstrate the use of utility-driven assessment in real-world data management scenarios and the broader implications for data management are discussed