Document (#34362)

Author
Zhang, Y.
Title
Developing a holistic model for digital library evaluation
Source
Journal of the American Society for Information Science and Technology. 61(2010) no.1, S.88-110
Year
2010
Abstract
This article reports the author's recent research in developing a holistic model for various levels of digital library (DL) evaluation in which perceived important criteria from heterogeneous stakeholder groups are organized and presented. To develop such a model, the author applied a three-stage research approach: exploration, confirmation, and verification. During the exploration stage, a literature review was conducted followed by an interview, along with a card sorting technique, to collect important criteria perceived by DL experts. Then the criteria identified were used for developing an online survey during the confirmation stage. Survey respondents (431 in total) from 22 countries rated the importance of the criteria. A holistic DL evaluation model was constructed using statistical techniques. Eventually, the verification stage was devised to test the reliability of the model in the context of searching and evaluating an operational DL. The proposed model fills two lacunae in the DL domain: (a) the lack of a comprehensive and flexible framework to guide and benchmark evaluations, and (b) the uncertainty about what divergence exists among heterogeneous DL stakeholders, including general users.

Similar documents (author)

  1. Zhang, M.; Zhang, Y.: Professional organizations in Twittersphere : an empirical study of U.S. library and information science professional organizations-related Tweets (2020) 4.60
    4.603307 = sum of:
      4.603307 = weight(author_txt:zhang in 776) [ClassicSimilarity], result of:
        4.603307 = fieldWeight in 776, product of:
          1.4142135 = tf(freq=2.0), with freq of:
            2.0 = termFreq=2.0
          6.510059 = idf(docFreq=174, maxDocs=43254)
          0.5 = fieldNorm(doc=776)
    
  2. Zhang, Y.; Zhang, C.: Enhancing keyphrase extraction from microblogs using human reading time (2021) 4.60
    4.603307 = sum of:
      4.603307 = weight(author_txt:zhang in 1239) [ClassicSimilarity], result of:
        4.603307 = fieldWeight in 1239, product of:
          1.4142135 = tf(freq=2.0), with freq of:
            2.0 = termFreq=2.0
          6.510059 = idf(docFreq=174, maxDocs=43254)
          0.5 = fieldNorm(doc=1239)
    
  3. Zhang, J.: TOFIR: A tool of facilitating information retrieval : introduce a visual retrieval model (2001) 4.07
    4.0687866 = sum of:
      4.0687866 = weight(author_txt:zhang in 711) [ClassicSimilarity], result of:
        4.0687866 = fieldWeight in 711, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          6.510059 = idf(docFreq=174, maxDocs=43254)
          0.625 = fieldNorm(doc=711)
    
  4. Zhang, A.: Multimedia file formats on the Internet : a beginner's guide for PC users (1995) 4.07
    4.0687866 = sum of:
      4.0687866 = weight(author_txt:zhang in 4281) [ClassicSimilarity], result of:
        4.0687866 = fieldWeight in 4281, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          6.510059 = idf(docFreq=174, maxDocs=43254)
          0.625 = fieldNorm(doc=4281)
    
  5. Zhang, J.: ¬A representational analysis of relational information displays (1996) 4.07
    4.0687866 = sum of:
      4.0687866 = weight(author_txt:zhang in 472) [ClassicSimilarity], result of:
        4.0687866 = fieldWeight in 472, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          6.510059 = idf(docFreq=174, maxDocs=43254)
          0.625 = fieldNorm(doc=472)
    

Similar documents (content)

  1. Xie, H.I.: Users' evaluation of digital libraries (DLs) : their uses, their criteria, and their assessment (2008) 0.14
    0.14369121 = sum of:
      0.14369121 = product of:
        0.71845603 = sum of:
          0.039326493 = weight(abstract_txt:important in 4084) [ClassicSimilarity], result of:
            0.039326493 = score(doc=4084,freq=2.0), product of:
              0.08411211 = queryWeight, product of:
                1.2135203 = boost
                4.2317667 = idf(docFreq=1707, maxDocs=43254)
                0.016379088 = queryNorm
              0.46754855 = fieldWeight in 4084, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.2317667 = idf(docFreq=1707, maxDocs=43254)
                0.078125 = fieldNorm(doc=4084)
          0.1055212 = weight(abstract_txt:digital in 4084) [ClassicSimilarity], result of:
            0.1055212 = score(doc=4084,freq=12.0), product of:
              0.08938083 = queryWeight, product of:
                1.2509501 = boost
                4.3622913 = idf(docFreq=1498, maxDocs=43254)
                0.016379088 = queryNorm
              1.1805798 = fieldWeight in 4084, product of:
                3.4641016 = tf(freq=12.0), with freq of:
                  12.0 = termFreq=12.0
                4.3622913 = idf(docFreq=1498, maxDocs=43254)
                0.078125 = fieldNorm(doc=4084)
          0.14665881 = weight(abstract_txt:perceived in 4084) [ClassicSimilarity], result of:
            0.14665881 = score(doc=4084,freq=3.0), product of:
              0.17670278 = queryWeight, product of:
                1.7588933 = boost
                6.1335816 = idf(docFreq=254, maxDocs=43254)
                0.016379088 = queryNorm
              0.82997453 = fieldWeight in 4084, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.1335816 = idf(docFreq=254, maxDocs=43254)
                0.078125 = fieldNorm(doc=4084)
          0.14094283 = weight(abstract_txt:evaluation in 4084) [ClassicSimilarity], result of:
            0.14094283 = score(doc=4084,freq=8.0), product of:
              0.14204983 = queryWeight, product of:
                1.9314516 = boost
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.016379088 = queryNorm
              0.9922069 = fieldWeight in 4084, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.078125 = fieldNorm(doc=4084)
          0.28600672 = weight(abstract_txt:criteria in 4084) [ClassicSimilarity], result of:
            0.28600672 = score(doc=4084,freq=5.0), product of:
              0.2931 = queryWeight, product of:
                3.203618 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.016379088 = queryNorm
              0.9757991 = fieldWeight in 4084, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.078125 = fieldNorm(doc=4084)
        0.2 = coord(5/25)
    
  2. Bateman, J.: Modelling the importance of end-user relevance criteria (1999) 0.13
    0.13498643 = sum of:
      0.13498643 = product of:
        0.5624435 = sum of:
          0.08631386 = weight(abstract_txt:rated in 1607) [ClassicSimilarity], result of:
            0.08631386 = score(doc=1607,freq=2.0), product of:
              0.14301448 = queryWeight, product of:
                1.118904 = boost
                7.803644 = idf(docFreq=47, maxDocs=43254)
                0.016379088 = queryNorm
              0.6035323 = fieldWeight in 1607, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.803644 = idf(docFreq=47, maxDocs=43254)
                0.0546875 = fieldNorm(doc=1607)
          0.027528545 = weight(abstract_txt:important in 1607) [ClassicSimilarity], result of:
            0.027528545 = score(doc=1607,freq=2.0), product of:
              0.08411211 = queryWeight, product of:
                1.2135203 = boost
                4.2317667 = idf(docFreq=1707, maxDocs=43254)
                0.016379088 = queryNorm
              0.32728398 = fieldWeight in 1607, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.2317667 = idf(docFreq=1707, maxDocs=43254)
                0.0546875 = fieldNorm(doc=1607)
          0.044672806 = weight(abstract_txt:survey in 1607) [ClassicSimilarity], result of:
            0.044672806 = score(doc=1607,freq=2.0), product of:
              0.11615337 = queryWeight, product of:
                1.4260466 = boost
                4.9728847 = idf(docFreq=813, maxDocs=43254)
                0.016379088 = queryNorm
              0.3846019 = fieldWeight in 1607, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.9728847 = idf(docFreq=813, maxDocs=43254)
                0.0546875 = fieldNorm(doc=1607)
          0.03488157 = weight(abstract_txt:evaluation in 1607) [ClassicSimilarity], result of:
            0.03488157 = score(doc=1607,freq=1.0), product of:
              0.14204983 = queryWeight, product of:
                1.9314516 = boost
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.016379088 = queryNorm
              0.24555868 = fieldWeight in 1607, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.0546875 = fieldNorm(doc=1607)
          0.28313223 = weight(abstract_txt:criteria in 1607) [ClassicSimilarity], result of:
            0.28313223 = score(doc=1607,freq=10.0), product of:
              0.2931 = queryWeight, product of:
                3.203618 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.016379088 = queryNorm
              0.96599185 = fieldWeight in 1607, product of:
                3.1622777 = tf(freq=10.0), with freq of:
                  10.0 = termFreq=10.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0546875 = fieldNorm(doc=1607)
          0.08591446 = weight(abstract_txt:model in 1607) [ClassicSimilarity], result of:
            0.08591446 = score(doc=1607,freq=3.0), product of:
              0.22632046 = queryWeight, product of:
                3.4477863 = boost
                4.0076866 = idf(docFreq=2136, maxDocs=43254)
                0.016379088 = queryNorm
              0.3796142 = fieldWeight in 1607, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.0076866 = idf(docFreq=2136, maxDocs=43254)
                0.0546875 = fieldNorm(doc=1607)
        0.24 = coord(6/25)
    
  3. Tang, R.; Solomon, P.: Use of relevance criteria across stages of document evaluation : on the complementarity of experimental and naturalistic studies (2001) 0.13
    0.13417771 = sum of:
      0.13417771 = product of:
        0.67088854 = sum of:
          0.033715446 = weight(abstract_txt:important in 214) [ClassicSimilarity], result of:
            0.033715446 = score(doc=214,freq=3.0), product of:
              0.08411211 = queryWeight, product of:
                1.2135203 = boost
                4.2317667 = idf(docFreq=1707, maxDocs=43254)
                0.016379088 = queryNorm
              0.4008394 = fieldWeight in 214, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.2317667 = idf(docFreq=1707, maxDocs=43254)
                0.0546875 = fieldNorm(doc=214)
          0.03488157 = weight(abstract_txt:evaluation in 214) [ClassicSimilarity], result of:
            0.03488157 = score(doc=214,freq=1.0), product of:
              0.14204983 = queryWeight, product of:
                1.9314516 = boost
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.016379088 = queryNorm
              0.24555868 = fieldWeight in 214, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.0546875 = fieldNorm(doc=214)
          0.21931328 = weight(abstract_txt:criteria in 214) [ClassicSimilarity], result of:
            0.21931328 = score(doc=214,freq=6.0), product of:
              0.2931 = queryWeight, product of:
                3.203618 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.016379088 = queryNorm
              0.7482541 = fieldWeight in 214, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0546875 = fieldNorm(doc=214)
          0.049602736 = weight(abstract_txt:model in 214) [ClassicSimilarity], result of:
            0.049602736 = score(doc=214,freq=1.0), product of:
              0.22632046 = queryWeight, product of:
                3.4477863 = boost
                4.0076866 = idf(docFreq=2136, maxDocs=43254)
                0.016379088 = queryNorm
              0.21917036 = fieldWeight in 214, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.0076866 = idf(docFreq=2136, maxDocs=43254)
                0.0546875 = fieldNorm(doc=214)
          0.33337548 = weight(abstract_txt:stage in 214) [ClassicSimilarity], result of:
            0.33337548 = score(doc=214,freq=8.0), product of:
              0.35205898 = queryWeight, product of:
                3.5110784 = boost
                6.1218853 = idf(docFreq=257, maxDocs=43254)
                0.016379088 = queryNorm
              0.94693077 = fieldWeight in 214, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                6.1218853 = idf(docFreq=257, maxDocs=43254)
                0.0546875 = fieldNorm(doc=214)
        0.2 = coord(5/25)
    
  4. Kuhlthau, C.C.: Information search process (ISP) model (2009) 0.11
    0.105302885 = sum of:
      0.105302885 = product of:
        0.65814304 = sum of:
          0.124485575 = weight(abstract_txt:uncertainty in 284) [ClassicSimilarity], result of:
            0.124485575 = score(doc=284,freq=4.0), product of:
              0.11423373 = queryWeight, product of:
                6.9743648 = idf(docFreq=109, maxDocs=43254)
                0.016379088 = queryNorm
              1.0897444 = fieldWeight in 284, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.9743648 = idf(docFreq=109, maxDocs=43254)
                0.078125 = fieldNorm(doc=284)
          0.19531947 = weight(abstract_txt:holistic in 284) [ClassicSimilarity], result of:
            0.19531947 = score(doc=284,freq=1.0), product of:
              0.35313365 = queryWeight, product of:
                3.0453205 = boost
                7.0797253 = idf(docFreq=98, maxDocs=43254)
                0.016379088 = queryNorm
              0.55310357 = fieldWeight in 284, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.0797253 = idf(docFreq=98, maxDocs=43254)
                0.078125 = fieldNorm(doc=284)
          0.100212656 = weight(abstract_txt:model in 284) [ClassicSimilarity], result of:
            0.100212656 = score(doc=284,freq=2.0), product of:
              0.22632046 = queryWeight, product of:
                3.4477863 = boost
                4.0076866 = idf(docFreq=2136, maxDocs=43254)
                0.016379088 = queryNorm
              0.442791 = fieldWeight in 284, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.0076866 = idf(docFreq=2136, maxDocs=43254)
                0.078125 = fieldNorm(doc=284)
          0.23812535 = weight(abstract_txt:stage in 284) [ClassicSimilarity], result of:
            0.23812535 = score(doc=284,freq=2.0), product of:
              0.35205898 = queryWeight, product of:
                3.5110784 = boost
                6.1218853 = idf(docFreq=257, maxDocs=43254)
                0.016379088 = queryNorm
              0.67637914 = fieldWeight in 284, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.1218853 = idf(docFreq=257, maxDocs=43254)
                0.078125 = fieldNorm(doc=284)
        0.16 = coord(4/25)
    
  5. Park, J.-R.; Tosaka, Y.: Metadata quality control in digital repositories and collections : criteria, semantics, and mechanisms (2010) 0.09
    0.08858573 = sum of:
      0.08858573 = product of:
        0.4429286 = sum of:
          0.043078847 = weight(abstract_txt:digital in 628) [ClassicSimilarity], result of:
            0.043078847 = score(doc=628,freq=2.0), product of:
              0.08938083 = queryWeight, product of:
                1.2509501 = boost
                4.3622913 = idf(docFreq=1498, maxDocs=43254)
                0.016379088 = queryNorm
              0.48196965 = fieldWeight in 628, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.3622913 = idf(docFreq=1498, maxDocs=43254)
                0.078125 = fieldNorm(doc=628)
          0.0638183 = weight(abstract_txt:survey in 628) [ClassicSimilarity], result of:
            0.0638183 = score(doc=628,freq=2.0), product of:
              0.11615337 = queryWeight, product of:
                1.4260466 = boost
                4.9728847 = idf(docFreq=813, maxDocs=43254)
                0.016379088 = queryNorm
              0.5494313 = fieldWeight in 628, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.9728847 = idf(docFreq=813, maxDocs=43254)
                0.078125 = fieldNorm(doc=628)
          0.08467351 = weight(abstract_txt:perceived in 628) [ClassicSimilarity], result of:
            0.08467351 = score(doc=628,freq=1.0), product of:
              0.17670278 = queryWeight, product of:
                1.7588933 = boost
                6.1335816 = idf(docFreq=254, maxDocs=43254)
                0.016379088 = queryNorm
              0.47918606 = fieldWeight in 628, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.1335816 = idf(docFreq=254, maxDocs=43254)
                0.078125 = fieldNorm(doc=628)
          0.07047141 = weight(abstract_txt:evaluation in 628) [ClassicSimilarity], result of:
            0.07047141 = score(doc=628,freq=2.0), product of:
              0.14204983 = queryWeight, product of:
                1.9314516 = boost
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.016379088 = queryNorm
              0.49610344 = fieldWeight in 628, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.078125 = fieldNorm(doc=628)
          0.18088652 = weight(abstract_txt:criteria in 628) [ClassicSimilarity], result of:
            0.18088652 = score(doc=628,freq=2.0), product of:
              0.2931 = queryWeight, product of:
                3.203618 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.016379088 = queryNorm
              0.61714953 = fieldWeight in 628, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.078125 = fieldNorm(doc=628)
        0.2 = coord(5/25)