Document (#36137)

Author
Arazy, O.
Kopak, R.
Title
On the measurability of information quality
Source
Journal of the American Society for Information Science and Technology. 62(2011) no.1, S.89-99
Year
2011
Abstract
The notion of information quality (IQ) has been investigated extensively in recent years. Much of this research has been aimed at conceptualizing IQ and its underlying dimensions (e.g., accuracy, completeness) and at developing instruments for measuring these quality dimensions. However, less attention has been given to the measurability of IQ. The objective of this study is to explore the extent to which a set of IQ dimensions-accuracy, completeness, objectivity, and representation-lend themselves to reliable measurement. By reliable measurement, we refer to the degree to which independent assessors are able to agree when rating objects on these various dimensions. Our study reveals that multiple assessors tend to agree more on certain dimensions (e.g., accuracy) while finding it more difficult to agree on others (e.g., completeness). We argue that differences in measurability stem from properties inherent to the quality dimension (i.e., the availability of heuristics that make the assessment more tangible) as well as on assessors' reliance on these cues. Implications for theory and practice are discussed.

Similar documents (author)

  1. Arazy, O.; Yeo, L.; Nov, O.: Stay on the Wikipedia task : when task-related disagreements slip into personal and procedural conflicts (2013) 3.70
    3.701674 = sum of:
      3.701674 = weight(author_txt:arazy in 3007) [ClassicSimilarity], result of:
        3.701674 = fieldWeight in 3007, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.871131 = idf(docFreq=5, maxDocs=42740)
          0.375 = fieldNorm(doc=3007)
    
  2. Arazy, O.; Lifshitz-Assaf, H.; Balila, A.: Neither a Bazaar nor a cathedral : the interplay between structure and agency in Wikipedia's role system (2019) 3.70
    3.701674 = sum of:
      3.701674 = weight(author_txt:arazy in 671) [ClassicSimilarity], result of:
        3.701674 = fieldWeight in 671, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.871131 = idf(docFreq=5, maxDocs=42740)
          0.375 = fieldNorm(doc=671)
    
  3. Arazy, O.; Gellatly, I.; Brainin, E.; Nov, O.: Motivation to share knowledge using wiki technology and the moderating effect of role perceptions (2016) 3.08
    3.0847285 = sum of:
      3.0847285 = weight(author_txt:arazy in 5144) [ClassicSimilarity], result of:
        3.0847285 = fieldWeight in 5144, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.871131 = idf(docFreq=5, maxDocs=42740)
          0.3125 = fieldNorm(doc=5144)
    
  4. Arazy, O.; Stroulia, E.; Ruecker, S.; Arias, C.; Fiorentino, C.; Ganev, V.; Yau, T.: Recognizing contributions in wikis : authorship categories, algorithms, and visualizations (2010) 2.47
    2.4677827 = sum of:
      2.4677827 = weight(author_txt:arazy in 468) [ClassicSimilarity], result of:
        2.4677827 = fieldWeight in 468, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.871131 = idf(docFreq=5, maxDocs=42740)
          0.25 = fieldNorm(doc=468)
    

Similar documents (content)

  1. Miller, H.: ¬The multiple dimensions of information quality (1996) 0.21
    0.20705442 = sum of:
      0.20705442 = product of:
        1.0352721 = sum of:
          0.02517204 = weight(abstract_txt:these in 4829) [ClassicSimilarity], result of:
            0.02517204 = score(doc=4829,freq=1.0), product of:
              0.06256034 = queryWeight, product of:
                1.3911109 = boost
                3.2189133 = idf(docFreq=4646, maxDocs=42740)
                0.01397102 = queryNorm
              0.40236416 = fieldWeight in 4829, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2189133 = idf(docFreq=4646, maxDocs=42740)
                0.125 = fieldNorm(doc=4829)
          0.16358426 = weight(abstract_txt:accuracy in 4829) [ClassicSimilarity], result of:
            0.16358426 = score(doc=4829,freq=1.0), product of:
              0.21786185 = queryWeight, product of:
                2.5959885 = boost
                6.006899 = idf(docFreq=285, maxDocs=42740)
                0.01397102 = queryNorm
              0.75086236 = fieldWeight in 4829, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.006899 = idf(docFreq=285, maxDocs=42740)
                0.125 = fieldNorm(doc=4829)
          0.103335656 = weight(abstract_txt:quality in 4829) [ClassicSimilarity], result of:
            0.103335656 = score(doc=4829,freq=1.0), product of:
              0.17653598 = queryWeight, product of:
                2.6983492 = boost
                4.6828146 = idf(docFreq=1074, maxDocs=42740)
                0.01397102 = queryNorm
              0.5853518 = fieldWeight in 4829, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6828146 = idf(docFreq=1074, maxDocs=42740)
                0.125 = fieldNorm(doc=4829)
          0.3628964 = weight(abstract_txt:completeness in 4829) [ClassicSimilarity], result of:
            0.3628964 = score(doc=4829,freq=1.0), product of:
              0.3705743 = queryWeight, product of:
                3.3857105 = boost
                7.834249 = idf(docFreq=45, maxDocs=42740)
                0.01397102 = queryNorm
              0.9792811 = fieldWeight in 4829, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.834249 = idf(docFreq=45, maxDocs=42740)
                0.125 = fieldNorm(doc=4829)
          0.38028368 = weight(abstract_txt:dimensions in 4829) [ClassicSimilarity], result of:
            0.38028368 = score(doc=4829,freq=2.0), product of:
              0.35977548 = queryWeight, product of:
                4.3067765 = boost
                5.979311 = idf(docFreq=293, maxDocs=42740)
                0.01397102 = queryNorm
              1.0570028 = fieldWeight in 4829, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.979311 = idf(docFreq=293, maxDocs=42740)
                0.125 = fieldNorm(doc=4829)
        0.2 = coord(5/25)
    
  2. Gonçalves, M.A.; Moreira, B.L.; Fox, E.A.; Watson, L.T.: "What is a good digital library?" : a quality model for digital libraries (2007) 0.18
    0.18457034 = sum of:
      0.18457034 = product of:
        0.7690431 = sum of:
          0.0051819277 = weight(abstract_txt:that in 2938) [ClassicSimilarity], result of:
            0.0051819277 = score(doc=2938,freq=1.0), product of:
              0.034623243 = queryWeight, product of:
                1.0348945 = boost
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.01397102 = queryNorm
              0.14966616 = fieldWeight in 2938, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.0625 = fieldNorm(doc=2938)
          0.08558098 = weight(abstract_txt:measurement in 2938) [ClassicSimilarity], result of:
            0.08558098 = score(doc=2938,freq=1.0), product of:
              0.19615284 = queryWeight, product of:
                2.0112398 = boost
                6.980759 = idf(docFreq=107, maxDocs=42740)
                0.01397102 = queryNorm
              0.43629745 = fieldWeight in 2938, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.980759 = idf(docFreq=107, maxDocs=42740)
                0.0625 = fieldNorm(doc=2938)
          0.08179213 = weight(abstract_txt:accuracy in 2938) [ClassicSimilarity], result of:
            0.08179213 = score(doc=2938,freq=1.0), product of:
              0.21786185 = queryWeight, product of:
                2.5959885 = boost
                6.006899 = idf(docFreq=285, maxDocs=42740)
                0.01397102 = queryNorm
              0.37543118 = fieldWeight in 2938, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.006899 = idf(docFreq=285, maxDocs=42740)
                0.0625 = fieldNorm(doc=2938)
          0.14613868 = weight(abstract_txt:quality in 2938) [ClassicSimilarity], result of:
            0.14613868 = score(doc=2938,freq=8.0), product of:
              0.17653598 = queryWeight, product of:
                2.6983492 = boost
                4.6828146 = idf(docFreq=1074, maxDocs=42740)
                0.01397102 = queryNorm
              0.8278125 = fieldWeight in 2938, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                4.6828146 = idf(docFreq=1074, maxDocs=42740)
                0.0625 = fieldNorm(doc=2938)
          0.1814482 = weight(abstract_txt:completeness in 2938) [ClassicSimilarity], result of:
            0.1814482 = score(doc=2938,freq=1.0), product of:
              0.3705743 = queryWeight, product of:
                3.3857105 = boost
                7.834249 = idf(docFreq=45, maxDocs=42740)
                0.01397102 = queryNorm
              0.48964056 = fieldWeight in 2938, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.834249 = idf(docFreq=45, maxDocs=42740)
                0.0625 = fieldNorm(doc=2938)
          0.2689012 = weight(abstract_txt:dimensions in 2938) [ClassicSimilarity], result of:
            0.2689012 = score(doc=2938,freq=4.0), product of:
              0.35977548 = queryWeight, product of:
                4.3067765 = boost
                5.979311 = idf(docFreq=293, maxDocs=42740)
                0.01397102 = queryNorm
              0.7474139 = fieldWeight in 2938, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.979311 = idf(docFreq=293, maxDocs=42740)
                0.0625 = fieldNorm(doc=2938)
        0.24 = coord(6/25)
    
  3. Verberne, S.; Heijden, M. van der; Hinne, M.; Sappelli, M.; Koldijk, S.; Hoenkamp, E.; Kraaij, W.: Reliability and validity of query intent assessments (2013) 0.17
    0.1709411 = sum of:
      0.1709411 = product of:
        0.7122546 = sum of:
          0.010519273 = weight(abstract_txt:study in 3105) [ClassicSimilarity], result of:
            0.010519273 = score(doc=3105,freq=1.0), product of:
              0.048491642 = queryWeight, product of:
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.01397102 = queryNorm
              0.2169296 = fieldWeight in 3105, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.0625 = fieldNorm(doc=3105)
          0.008975362 = weight(abstract_txt:that in 3105) [ClassicSimilarity], result of:
            0.008975362 = score(doc=3105,freq=3.0), product of:
              0.034623243 = queryWeight, product of:
                1.0348945 = boost
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.01397102 = queryNorm
              0.2592294 = fieldWeight in 3105, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.0625 = fieldNorm(doc=3105)
          0.01779932 = weight(abstract_txt:these in 3105) [ClassicSimilarity], result of:
            0.01779932 = score(doc=3105,freq=2.0), product of:
              0.06256034 = queryWeight, product of:
                1.3911109 = boost
                3.2189133 = idf(docFreq=4646, maxDocs=42740)
                0.01397102 = queryNorm
              0.28451443 = fieldWeight in 3105, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.2189133 = idf(docFreq=4646, maxDocs=42740)
                0.0625 = fieldNorm(doc=3105)
          0.051667828 = weight(abstract_txt:quality in 3105) [ClassicSimilarity], result of:
            0.051667828 = score(doc=3105,freq=1.0), product of:
              0.17653598 = queryWeight, product of:
                2.6983492 = boost
                4.6828146 = idf(docFreq=1074, maxDocs=42740)
                0.01397102 = queryNorm
              0.2926759 = fieldWeight in 3105, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6828146 = idf(docFreq=1074, maxDocs=42740)
                0.0625 = fieldNorm(doc=3105)
          0.43315095 = weight(abstract_txt:assessors in 3105) [ClassicSimilarity], result of:
            0.43315095 = score(doc=3105,freq=3.0), product of:
              0.45894355 = queryWeight, product of:
                3.7678344 = boost
                8.7184515 = idf(docFreq=18, maxDocs=42740)
                0.01397102 = queryNorm
              0.94380003 = fieldWeight in 3105, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                8.7184515 = idf(docFreq=18, maxDocs=42740)
                0.0625 = fieldNorm(doc=3105)
          0.19014184 = weight(abstract_txt:dimensions in 3105) [ClassicSimilarity], result of:
            0.19014184 = score(doc=3105,freq=2.0), product of:
              0.35977548 = queryWeight, product of:
                4.3067765 = boost
                5.979311 = idf(docFreq=293, maxDocs=42740)
                0.01397102 = queryNorm
              0.5285014 = fieldWeight in 3105, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.979311 = idf(docFreq=293, maxDocs=42740)
                0.0625 = fieldNorm(doc=3105)
        0.24 = coord(6/25)
    
  4. Zhang, Y.; Sun, Y.; Xie, B.: Quality of health information for consumers on the web : a systematic review of indicators, criteria, tools, and evaluation results (2015) 0.17
    0.17072164 = sum of:
      0.17072164 = product of:
        0.53350514 = sum of:
          0.010519273 = weight(abstract_txt:study in 4219) [ClassicSimilarity], result of:
            0.010519273 = score(doc=4219,freq=1.0), product of:
              0.048491642 = queryWeight, product of:
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.01397102 = queryNorm
              0.2169296 = fieldWeight in 4219, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.0625 = fieldNorm(doc=4219)
          0.011587143 = weight(abstract_txt:that in 4219) [ClassicSimilarity], result of:
            0.011587143 = score(doc=4219,freq=5.0), product of:
              0.034623243 = queryWeight, product of:
                1.0348945 = boost
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.01397102 = queryNorm
              0.33466372 = fieldWeight in 4219, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.0625 = fieldNorm(doc=4219)
          0.07128309 = weight(abstract_txt:instruments in 4219) [ClassicSimilarity], result of:
            0.07128309 = score(doc=4219,freq=2.0), product of:
              0.10939079 = queryWeight, product of:
                1.0620426 = boost
                7.3724313 = idf(docFreq=72, maxDocs=42740)
                0.01397102 = queryNorm
              0.651637 = fieldWeight in 4219, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.3724313 = idf(docFreq=72, maxDocs=42740)
                0.0625 = fieldNorm(doc=4219)
          0.01258602 = weight(abstract_txt:these in 4219) [ClassicSimilarity], result of:
            0.01258602 = score(doc=4219,freq=1.0), product of:
              0.06256034 = queryWeight, product of:
                1.3911109 = boost
                3.2189133 = idf(docFreq=4646, maxDocs=42740)
                0.01397102 = queryNorm
              0.20118208 = fieldWeight in 4219, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2189133 = idf(docFreq=4646, maxDocs=42740)
                0.0625 = fieldNorm(doc=4219)
          0.018150572 = weight(abstract_txt:been in 4219) [ClassicSimilarity], result of:
            0.018150572 = score(doc=4219,freq=1.0), product of:
              0.07985468 = queryWeight, product of:
                1.5716736 = boost
                3.6367204 = idf(docFreq=3059, maxDocs=42740)
                0.01397102 = queryNorm
              0.22729503 = fieldWeight in 4219, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6367204 = idf(docFreq=3059, maxDocs=42740)
                0.0625 = fieldNorm(doc=4219)
          0.08179213 = weight(abstract_txt:accuracy in 4219) [ClassicSimilarity], result of:
            0.08179213 = score(doc=4219,freq=1.0), product of:
              0.21786185 = queryWeight, product of:
                2.5959885 = boost
                6.006899 = idf(docFreq=285, maxDocs=42740)
                0.01397102 = queryNorm
              0.37543118 = fieldWeight in 4219, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.006899 = idf(docFreq=285, maxDocs=42740)
                0.0625 = fieldNorm(doc=4219)
          0.14613868 = weight(abstract_txt:quality in 4219) [ClassicSimilarity], result of:
            0.14613868 = score(doc=4219,freq=8.0), product of:
              0.17653598 = queryWeight, product of:
                2.6983492 = boost
                4.6828146 = idf(docFreq=1074, maxDocs=42740)
                0.01397102 = queryNorm
              0.8278125 = fieldWeight in 4219, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                4.6828146 = idf(docFreq=1074, maxDocs=42740)
                0.0625 = fieldNorm(doc=4219)
          0.1814482 = weight(abstract_txt:completeness in 4219) [ClassicSimilarity], result of:
            0.1814482 = score(doc=4219,freq=1.0), product of:
              0.3705743 = queryWeight, product of:
                3.3857105 = boost
                7.834249 = idf(docFreq=45, maxDocs=42740)
                0.01397102 = queryNorm
              0.48964056 = fieldWeight in 4219, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.834249 = idf(docFreq=45, maxDocs=42740)
                0.0625 = fieldNorm(doc=4219)
        0.32 = coord(8/25)
    
  5. Park, J.-r.: Metadata quality in digital repositories : a survey of the current state of the art (2009) 0.15
    0.151674 = sum of:
      0.151674 = product of:
        0.631975 = sum of:
          0.018595621 = weight(abstract_txt:study in 4983) [ClassicSimilarity], result of:
            0.018595621 = score(doc=4983,freq=2.0), product of:
              0.048491642 = queryWeight, product of:
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.01397102 = queryNorm
              0.38348097 = fieldWeight in 4983, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.078125 = fieldNorm(doc=4983)
          0.00647741 = weight(abstract_txt:that in 4983) [ClassicSimilarity], result of:
            0.00647741 = score(doc=4983,freq=1.0), product of:
              0.034623243 = queryWeight, product of:
                1.0348945 = boost
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.01397102 = queryNorm
              0.18708271 = fieldWeight in 4983, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.078125 = fieldNorm(doc=4983)
          0.10697623 = weight(abstract_txt:measurement in 4983) [ClassicSimilarity], result of:
            0.10697623 = score(doc=4983,freq=1.0), product of:
              0.19615284 = queryWeight, product of:
                2.0112398 = boost
                6.980759 = idf(docFreq=107, maxDocs=42740)
                0.01397102 = queryNorm
              0.54537183 = fieldWeight in 4983, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.980759 = idf(docFreq=107, maxDocs=42740)
                0.078125 = fieldNorm(doc=4983)
          0.10224016 = weight(abstract_txt:accuracy in 4983) [ClassicSimilarity], result of:
            0.10224016 = score(doc=4983,freq=1.0), product of:
              0.21786185 = queryWeight, product of:
                2.5959885 = boost
                6.006899 = idf(docFreq=285, maxDocs=42740)
                0.01397102 = queryNorm
              0.46928898 = fieldWeight in 4983, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.006899 = idf(docFreq=285, maxDocs=42740)
                0.078125 = fieldNorm(doc=4983)
          0.17087528 = weight(abstract_txt:quality in 4983) [ClassicSimilarity], result of:
            0.17087528 = score(doc=4983,freq=7.0), product of:
              0.17653598 = queryWeight, product of:
                2.6983492 = boost
                4.6828146 = idf(docFreq=1074, maxDocs=42740)
                0.01397102 = queryNorm
              0.9679346 = fieldWeight in 4983, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.6828146 = idf(docFreq=1074, maxDocs=42740)
                0.078125 = fieldNorm(doc=4983)
          0.22681026 = weight(abstract_txt:completeness in 4983) [ClassicSimilarity], result of:
            0.22681026 = score(doc=4983,freq=1.0), product of:
              0.3705743 = queryWeight, product of:
                3.3857105 = boost
                7.834249 = idf(docFreq=45, maxDocs=42740)
                0.01397102 = queryNorm
              0.6120507 = fieldWeight in 4983, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.834249 = idf(docFreq=45, maxDocs=42740)
                0.078125 = fieldNorm(doc=4983)
        0.24 = coord(6/25)