Document (#35633)

Author

Buchanan, S.
Salako, A.

Title

Evaluating the usability and usefulness of a digital library

Source

Library review. 58(2009) no.9, S.638-651

Year

2009

Abstract

Purpose - System usability and system usefulness are interdependent properties of system interaction, which in combination, determine system satisfaction and usage. Often approached separately, or in the case of digital libraries, often focused upon usability, there is emerging consensus among the research community for their unified treatment and research attention. However, a key challenge is to identify, both respectively and relatively, what to measure and how, compounded by concerns regarding common understanding of usability measures, and associated calls for more valid and complete measures within integrated and comprehensive models. The purpose of this paper is to address this challenge. Design/methodology/approach - Identified key usability and usefulness attributes and associated measures, compiled an integrated measurement framework, identified a suitable methodological approach for application of the framework, and conducted a pilot study on an interactive search system developed by a Health Service as part of their e-library service. Findings - Effectiveness, efficiency, aesthetic appearance, terminology, navigation, and learnability are key attributes of system usability; and relevance, reliability, and currency key attributes of system usefulness. There are shared aspects to several of these attributes, but each is also sufficiently unique to preserve its respective validity. They can be combined as part of a multi-method approach to system evaluation. Research limitations/implications - Pilot study has demonstrated that usability and usefulness can be readily combined, and that questionnaire and observation are valid multi-method approaches, but further research is called for under a variety of conditions, with further combinations of methods, and larger samples. Originality/value - This paper provides an integrated measurement framework, derived from the goal, question, metric paradigm, which provides a relatively comprehensive and representative set of system usability and system usefulness attributes and associated measures, which could be adapted and further refined on a case-by-case basis.

Theme

Information Gateway

Similar documents (author)

1. Buchanan, B.: Glossary of indexing terms (1976) 5.30

   5.298757 = sum of:
     5.298757 = weight(author_txt:buchanan in 2501) [ClassicSimilarity], result of:
       5.298757 = fieldWeight in 2501, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.478011 = idf(docFreq=24, maxDocs=44218)
         0.625 = fieldNorm(doc=2501)
   

2. Buchanan, N.L.: ¬The FirstSearch catalog : 37 databases and still growing (1993) 5.30

   5.298757 = sum of:
     5.298757 = weight(author_txt:buchanan in 6968) [ClassicSimilarity], result of:
       5.298757 = fieldWeight in 6968, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.478011 = idf(docFreq=24, maxDocs=44218)
         0.625 = fieldNorm(doc=6968)
   

3. Buchanan, E.A.: Ethical transformations in a global information age (1996) 5.30

   5.298757 = sum of:
     5.298757 = weight(author_txt:buchanan in 2449) [ClassicSimilarity], result of:
       5.298757 = fieldWeight in 2449, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.478011 = idf(docFreq=24, maxDocs=44218)
         0.625 = fieldNorm(doc=2449)
   

4. Buchanan, B.: Bibliothekarische Klassifikationstheorie (1989) 5.30

   5.298757 = sum of:
     5.298757 = weight(author_txt:buchanan in 3921) [ClassicSimilarity], result of:
       5.298757 = fieldWeight in 3921, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.478011 = idf(docFreq=24, maxDocs=44218)
         0.625 = fieldNorm(doc=3921)
   

5. Buchanan, S.A.: Regional information science : education and disciplinary precept in the Los Angeles Chapter of ASIST, 1961-2011 (2011) 5.30

   5.298757 = sum of:
     5.298757 = weight(author_txt:buchanan in 4928) [ClassicSimilarity], result of:
       5.298757 = fieldWeight in 4928, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.478011 = idf(docFreq=24, maxDocs=44218)
         0.625 = fieldNorm(doc=4928)
   

Similar documents (content)

1. O'Brien, H.L.; Lebow, M.: Mixed-methods approach to measuring user experience in online news interactions (2013) 0.22

   0.21539661 = sum of:
     0.21539661 = product of:
       0.6731144 = sum of:
         0.017755782 = weight(abstract_txt:approach in 1001) [ClassicSimilarity], result of:
           0.017755782 = score(doc=1001,freq=1.0), product of:
             0.075852506 = queryWeight, product of:
               1.2265037 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.016512437 = queryNorm
             0.234083 = fieldWeight in 1001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.0625 = fieldNorm(doc=1001)
         0.02030676 = weight(abstract_txt:research in 1001) [ClassicSimilarity], result of:
           0.02030676 = score(doc=1001,freq=2.0), product of:
             0.07246697 = queryWeight, product of:
               1.384278 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.016512437 = queryNorm
             0.28022093 = fieldWeight in 1001, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=1001)
         0.03185392 = weight(abstract_txt:framework in 1001) [ClassicSimilarity], result of:
           0.03185392 = score(doc=1001,freq=1.0), product of:
             0.11199157 = queryWeight, product of:
               1.49031 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.016512437 = queryNorm
             0.28443143 = fieldWeight in 1001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.0625 = fieldNorm(doc=1001)
         0.07486254 = weight(abstract_txt:measurement in 1001) [ClassicSimilarity], result of:
           0.07486254 = score(doc=1001,freq=1.0), product of:
             0.17293756 = queryWeight, product of:
               1.5121086 = boost
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.016512437 = queryNorm
             0.43288767 = fieldWeight in 1001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.0625 = fieldNorm(doc=1001)
         0.044432797 = weight(abstract_txt:associated in 1001) [ClassicSimilarity], result of:
           0.044432797 = score(doc=1001,freq=1.0), product of:
             0.13981244 = queryWeight, product of:
               1.6651633 = boost
               5.084846 = idf(docFreq=743, maxDocs=44218)
               0.016512437 = queryNorm
             0.31780288 = fieldWeight in 1001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.084846 = idf(docFreq=743, maxDocs=44218)
               0.0625 = fieldNorm(doc=1001)
         0.07236065 = weight(abstract_txt:measures in 1001) [ClassicSimilarity], result of:
           0.07236065 = score(doc=1001,freq=1.0), product of:
             0.21300572 = queryWeight, product of:
               2.3732798 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.016512437 = queryNorm
             0.33971223 = fieldWeight in 1001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=1001)
         0.043204684 = weight(abstract_txt:system in 1001) [ClassicSimilarity], result of:
           0.043204684 = score(doc=1001,freq=1.0), product of:
             0.20498568 = queryWeight, product of:
               3.681163 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.016512437 = queryNorm
             0.21076928 = fieldWeight in 1001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=1001)
         0.3683373 = weight(abstract_txt:usability in 1001) [ClassicSimilarity], result of:
           0.3683373 = score(doc=1001,freq=3.0), product of:
             0.55062556 = queryWeight, product of:
               5.396305 = boost
               6.1794343 = idf(docFreq=248, maxDocs=44218)
               0.016512437 = queryNorm
             0.66894335 = fieldWeight in 1001, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.1794343 = idf(docFreq=248, maxDocs=44218)
               0.0625 = fieldNorm(doc=1001)
       0.32 = coord(8/25)
   

2. Yao, Y.Y.: Measuring retrieval effectiveness based on user preference of documents (1995) 0.21

   0.21230006 = sum of:
     0.21230006 = product of:
       0.6634377 = sum of:
         0.022194726 = weight(abstract_txt:approach in 1748) [ClassicSimilarity], result of:
           0.022194726 = score(doc=1748,freq=1.0), product of:
             0.075852506 = queryWeight, product of:
               1.2265037 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.016512437 = queryNorm
             0.29260373 = fieldWeight in 1748, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.078125 = fieldNorm(doc=1748)
         0.039817404 = weight(abstract_txt:framework in 1748) [ClassicSimilarity], result of:
           0.039817404 = score(doc=1748,freq=1.0), product of:
             0.11199157 = queryWeight, product of:
               1.49031 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.016512437 = queryNorm
             0.3555393 = fieldWeight in 1748, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.078125 = fieldNorm(doc=1748)
         0.0928986 = weight(abstract_txt:valid in 1748) [ClassicSimilarity], result of:
           0.0928986 = score(doc=1748,freq=1.0), product of:
             0.17209929 = queryWeight, product of:
               1.5084393 = boost
               6.9093957 = idf(docFreq=119, maxDocs=44218)
               0.016512437 = queryNorm
             0.53979653 = fieldWeight in 1748, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9093957 = idf(docFreq=119, maxDocs=44218)
               0.078125 = fieldNorm(doc=1748)
         0.09357817 = weight(abstract_txt:measurement in 1748) [ClassicSimilarity], result of:
           0.09357817 = score(doc=1748,freq=1.0), product of:
             0.17293756 = queryWeight, product of:
               1.5121086 = boost
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.016512437 = queryNorm
             0.54110956 = fieldWeight in 1748, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.078125 = fieldNorm(doc=1748)
         0.04306329 = weight(abstract_txt:further in 1748) [ClassicSimilarity], result of:
           0.04306329 = score(doc=1748,freq=1.0), product of:
             0.11799806 = queryWeight, product of:
               1.5297532 = boost
               4.671349 = idf(docFreq=1124, maxDocs=44218)
               0.016512437 = queryNorm
             0.36494914 = fieldWeight in 1748, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.671349 = idf(docFreq=1124, maxDocs=44218)
               0.078125 = fieldNorm(doc=1748)
         0.090450816 = weight(abstract_txt:measures in 1748) [ClassicSimilarity], result of:
           0.090450816 = score(doc=1748,freq=1.0), product of:
             0.21300572 = queryWeight, product of:
               2.3732798 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.016512437 = queryNorm
             0.4246403 = fieldWeight in 1748, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.078125 = fieldNorm(doc=1748)
         0.093540885 = weight(abstract_txt:system in 1748) [ClassicSimilarity], result of:
           0.093540885 = score(doc=1748,freq=3.0), product of:
             0.20498568 = queryWeight, product of:
               3.681163 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.016512437 = queryNorm
             0.45632887 = fieldWeight in 1748, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.078125 = fieldNorm(doc=1748)
         0.18789387 = weight(abstract_txt:usefulness in 1748) [ClassicSimilarity], result of:
           0.18789387 = score(doc=1748,freq=1.0), product of:
             0.39696765 = queryWeight, product of:
               3.968044 = boost
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.016512437 = queryNorm
             0.47332287 = fieldWeight in 1748, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.078125 = fieldNorm(doc=1748)
       0.32 = coord(8/25)
   

3. Craven, J.; Johnson, F.; Butters, G.: ¬The usability and functionality of an online catalogue (2010) 0.19

   0.19328862 = sum of:
     0.19328862 = product of:
       0.9664431 = sum of:
         0.017755782 = weight(abstract_txt:approach in 3952) [ClassicSimilarity], result of:
           0.017755782 = score(doc=3952,freq=1.0), product of:
             0.075852506 = queryWeight, product of:
               1.2265037 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.016512437 = queryNorm
             0.234083 = fieldWeight in 3952, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.0625 = fieldNorm(doc=3952)
         0.12989825 = weight(abstract_txt:attributes in 3952) [ClassicSimilarity], result of:
           0.12989825 = score(doc=3952,freq=1.0), product of:
             0.33891842 = queryWeight, product of:
               3.3470013 = boost
               6.1323667 = idf(docFreq=260, maxDocs=44218)
               0.016512437 = queryNorm
             0.38327292 = fieldWeight in 3952, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1323667 = idf(docFreq=260, maxDocs=44218)
               0.0625 = fieldNorm(doc=3952)
         0.10582943 = weight(abstract_txt:system in 3952) [ClassicSimilarity], result of:
           0.10582943 = score(doc=3952,freq=6.0), product of:
             0.20498568 = queryWeight, product of:
               3.681163 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.016512437 = queryNorm
             0.5162772 = fieldWeight in 3952, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=3952)
         0.15031509 = weight(abstract_txt:usefulness in 3952) [ClassicSimilarity], result of:
           0.15031509 = score(doc=3952,freq=1.0), product of:
             0.39696765 = queryWeight, product of:
               3.968044 = boost
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.016512437 = queryNorm
             0.3786583 = fieldWeight in 3952, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.0625 = fieldNorm(doc=3952)
         0.56264454 = weight(abstract_txt:usability in 3952) [ClassicSimilarity], result of:
           0.56264454 = score(doc=3952,freq=7.0), product of:
             0.55062556 = queryWeight, product of:
               5.396305 = boost
               6.1794343 = idf(docFreq=248, maxDocs=44218)
               0.016512437 = queryNorm
             1.0218278 = fieldWeight in 3952, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.1794343 = idf(docFreq=248, maxDocs=44218)
               0.0625 = fieldNorm(doc=3952)
       0.2 = coord(5/25)
   

4. Treglown, M.: HIBROWSE for bibliographic databases : a study of the application of usability techniques in view-based searching (1997) 0.19

   0.18819518 = sum of:
     0.18819518 = product of:
       0.9409759 = sum of:
         0.04732431 = weight(abstract_txt:multi in 767) [ClassicSimilarity], result of:
           0.04732431 = score(doc=767,freq=1.0), product of:
             0.12738037 = queryWeight, product of:
               1.2977456 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.016512437 = queryNorm
             0.37151965 = fieldWeight in 767, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.0625 = fieldNorm(doc=767)
         0.07486254 = weight(abstract_txt:measurement in 767) [ClassicSimilarity], result of:
           0.07486254 = score(doc=767,freq=1.0), product of:
             0.17293756 = queryWeight, product of:
               1.5121086 = boost
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.016512437 = queryNorm
             0.43288767 = fieldWeight in 767, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.0625 = fieldNorm(doc=767)
         0.10582943 = weight(abstract_txt:system in 767) [ClassicSimilarity], result of:
           0.10582943 = score(doc=767,freq=6.0), product of:
             0.20498568 = queryWeight, product of:
               3.681163 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.016512437 = queryNorm
             0.5162772 = fieldWeight in 767, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=767)
         0.15031509 = weight(abstract_txt:usefulness in 767) [ClassicSimilarity], result of:
           0.15031509 = score(doc=767,freq=1.0), product of:
             0.39696765 = queryWeight, product of:
               3.968044 = boost
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.016512437 = queryNorm
             0.3786583 = fieldWeight in 767, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.0625 = fieldNorm(doc=767)
         0.56264454 = weight(abstract_txt:usability in 767) [ClassicSimilarity], result of:
           0.56264454 = score(doc=767,freq=7.0), product of:
             0.55062556 = queryWeight, product of:
               5.396305 = boost
               6.1794343 = idf(docFreq=248, maxDocs=44218)
               0.016512437 = queryNorm
             1.0218278 = fieldWeight in 767, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.1794343 = idf(docFreq=248, maxDocs=44218)
               0.0625 = fieldNorm(doc=767)
       0.2 = coord(5/25)
   

5. Cheung, C.M.K.; Lee, M.K.O.: ¬The structure of Web-based information systems satisfaction : testing of competing models (2008) 0.18

   0.1755342 = sum of:
     0.1755342 = product of:
       0.7313925 = sum of:
         0.01794881 = weight(abstract_txt:research in 2005) [ClassicSimilarity], result of:
           0.01794881 = score(doc=2005,freq=1.0), product of:
             0.07246697 = queryWeight, product of:
               1.384278 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.016512437 = queryNorm
             0.24768265 = fieldWeight in 2005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.078125 = fieldNorm(doc=2005)
         0.0928986 = weight(abstract_txt:valid in 2005) [ClassicSimilarity], result of:
           0.0928986 = score(doc=2005,freq=1.0), product of:
             0.17209929 = queryWeight, product of:
               1.5084393 = boost
               6.9093957 = idf(docFreq=119, maxDocs=44218)
               0.016512437 = queryNorm
             0.53979653 = fieldWeight in 2005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9093957 = idf(docFreq=119, maxDocs=44218)
               0.078125 = fieldNorm(doc=2005)
         0.090450816 = weight(abstract_txt:measures in 2005) [ClassicSimilarity], result of:
           0.090450816 = score(doc=2005,freq=1.0), product of:
             0.21300572 = queryWeight, product of:
               2.3732798 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.016512437 = queryNorm
             0.4246403 = fieldWeight in 2005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.078125 = fieldNorm(doc=2005)
         0.07637582 = weight(abstract_txt:system in 2005) [ClassicSimilarity], result of:
           0.07637582 = score(doc=2005,freq=2.0), product of:
             0.20498568 = queryWeight, product of:
               3.681163 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.016512437 = queryNorm
             0.372591 = fieldWeight in 2005, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.078125 = fieldNorm(doc=2005)
         0.18789387 = weight(abstract_txt:usefulness in 2005) [ClassicSimilarity], result of:
           0.18789387 = score(doc=2005,freq=1.0), product of:
             0.39696765 = queryWeight, product of:
               3.968044 = boost
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.016512437 = queryNorm
             0.47332287 = fieldWeight in 2005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.078125 = fieldNorm(doc=2005)
         0.26582456 = weight(abstract_txt:usability in 2005) [ClassicSimilarity], result of:
           0.26582456 = score(doc=2005,freq=1.0), product of:
             0.55062556 = queryWeight, product of:
               5.396305 = boost
               6.1794343 = idf(docFreq=248, maxDocs=44218)
               0.016512437 = queryNorm
             0.4827683 = fieldWeight in 2005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1794343 = idf(docFreq=248, maxDocs=44218)
               0.078125 = fieldNorm(doc=2005)
       0.24 = coord(6/25)