Document (#35631)

Author

Buchanan, S.
Salako, A.

Title

Evaluating the usability and usefulness of a digital library

Source

Library review. 58(2009) no.9, S.638-651

Year

2009

Abstract

Purpose - System usability and system usefulness are interdependent properties of system interaction, which in combination, determine system satisfaction and usage. Often approached separately, or in the case of digital libraries, often focused upon usability, there is emerging consensus among the research community for their unified treatment and research attention. However, a key challenge is to identify, both respectively and relatively, what to measure and how, compounded by concerns regarding common understanding of usability measures, and associated calls for more valid and complete measures within integrated and comprehensive models. The purpose of this paper is to address this challenge. Design/methodology/approach - Identified key usability and usefulness attributes and associated measures, compiled an integrated measurement framework, identified a suitable methodological approach for application of the framework, and conducted a pilot study on an interactive search system developed by a Health Service as part of their e-library service. Findings - Effectiveness, efficiency, aesthetic appearance, terminology, navigation, and learnability are key attributes of system usability; and relevance, reliability, and currency key attributes of system usefulness. There are shared aspects to several of these attributes, but each is also sufficiently unique to preserve its respective validity. They can be combined as part of a multi-method approach to system evaluation. Research limitations/implications - Pilot study has demonstrated that usability and usefulness can be readily combined, and that questionnaire and observation are valid multi-method approaches, but further research is called for under a variety of conditions, with further combinations of methods, and larger samples. Originality/value - This paper provides an integrated measurement framework, derived from the goal, question, metric paradigm, which provides a relatively comprehensive and representative set of system usability and system usefulness attributes and associated measures, which could be adapted and further refined on a case-by-case basis.

Theme

Information Gateway

Similar documents (author)

1. Buchanan, B.: Glossary of indexing terms (1976) 5.29

   5.2893295 = sum of:
     5.2893295 = weight(author_txt:buchanan in 2501) [ClassicSimilarity], result of:
       5.2893295 = fieldWeight in 2501, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.462927 = idf(docFreq=24, maxDocs=43556)
         0.625 = fieldNorm(doc=2501)
   

2. Buchanan, N.L.: ¬The FirstSearch catalog : 37 databases and still growing (1993) 5.29

   5.2893295 = sum of:
     5.2893295 = weight(author_txt:buchanan in 6965) [ClassicSimilarity], result of:
       5.2893295 = fieldWeight in 6965, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.462927 = idf(docFreq=24, maxDocs=43556)
         0.625 = fieldNorm(doc=6965)
   

3. Buchanan, E.A.: Ethical transformations in a global information age (1996) 5.29

   5.2893295 = sum of:
     5.2893295 = weight(author_txt:buchanan in 3447) [ClassicSimilarity], result of:
       5.2893295 = fieldWeight in 3447, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.462927 = idf(docFreq=24, maxDocs=43556)
         0.625 = fieldNorm(doc=3447)
   

4. Buchanan, B.: Bibliothekarische Klassifikationstheorie (1989) 5.29

   5.2893295 = sum of:
     5.2893295 = weight(author_txt:buchanan in 919) [ClassicSimilarity], result of:
       5.2893295 = fieldWeight in 919, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.462927 = idf(docFreq=24, maxDocs=43556)
         0.625 = fieldNorm(doc=919)
   

5. Buchanan, S.A.: Regional information science : education and disciplinary precept in the Los Angeles Chapter of ASIST, 1961-2011 (2011) 5.29

   5.2893295 = sum of:
     5.2893295 = weight(author_txt:buchanan in 1926) [ClassicSimilarity], result of:
       5.2893295 = fieldWeight in 1926, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.462927 = idf(docFreq=24, maxDocs=43556)
         0.625 = fieldNorm(doc=1926)
   

Similar documents (content)

1. O'Brien, H.L.; Lebow, M.: Mixed-methods approach to measuring user experience in online news interactions (2013) 0.22

   0.21600986 = sum of:
     0.21600986 = product of:
       0.6750308 = sum of:
         0.0178991 = weight(abstract_txt:approach in 2999) [ClassicSimilarity], result of:
           0.0178991 = score(doc=2999,freq=1.0), product of:
             0.0762344 = queryWeight, product of:
               1.2300869 = boost
               3.7566452 = idf(docFreq=2765, maxDocs=43556)
               0.016497381 = queryNorm
             0.23479033 = fieldWeight in 2999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7566452 = idf(docFreq=2765, maxDocs=43556)
               0.0625 = fieldNorm(doc=2999)
         0.020652637 = weight(abstract_txt:research in 2999) [ClassicSimilarity], result of:
           0.020652637 = score(doc=2999,freq=2.0), product of:
             0.073262796 = queryWeight, product of:
               1.3924237 = boost
               3.1893122 = idf(docFreq=4877, maxDocs=43556)
               0.016497381 = queryNorm
             0.28189802 = fieldWeight in 2999, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1893122 = idf(docFreq=4877, maxDocs=43556)
               0.0625 = fieldNorm(doc=2999)
         0.0325617 = weight(abstract_txt:framework in 2999) [ClassicSimilarity], result of:
           0.0325617 = score(doc=2999,freq=1.0), product of:
             0.11360609 = queryWeight, product of:
               1.5016237 = boost
               4.5859094 = idf(docFreq=1206, maxDocs=43556)
               0.016497381 = queryNorm
             0.28661934 = fieldWeight in 2999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5859094 = idf(docFreq=1206, maxDocs=43556)
               0.0625 = fieldNorm(doc=2999)
         0.0751329 = weight(abstract_txt:measurement in 2999) [ClassicSimilarity], result of:
           0.0751329 = score(doc=2999,freq=1.0), product of:
             0.1732952 = queryWeight, product of:
               1.5142862 = boost
               6.9368706 = idf(docFreq=114, maxDocs=43556)
               0.016497381 = queryNorm
             0.4335544 = fieldWeight in 2999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9368706 = idf(docFreq=114, maxDocs=43556)
               0.0625 = fieldNorm(doc=2999)
         0.044816542 = weight(abstract_txt:associated in 2999) [ClassicSimilarity], result of:
           0.044816542 = score(doc=2999,freq=1.0), product of:
             0.14056885 = queryWeight, product of:
               1.67034 = boost
               5.1011634 = idf(docFreq=720, maxDocs=43556)
               0.016497381 = queryNorm
             0.3188227 = fieldWeight in 2999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1011634 = idf(docFreq=720, maxDocs=43556)
               0.0625 = fieldNorm(doc=2999)
         0.07214518 = weight(abstract_txt:measures in 2999) [ClassicSimilarity], result of:
           0.07214518 = score(doc=2999,freq=1.0), product of:
             0.21251096 = queryWeight, product of:
               2.3714848 = boost
               5.4318275 = idf(docFreq=517, maxDocs=43556)
               0.016497381 = queryNorm
             0.33948922 = fieldWeight in 2999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4318275 = idf(docFreq=517, maxDocs=43556)
               0.0625 = fieldNorm(doc=2999)
         0.04292825 = weight(abstract_txt:system in 2999) [ClassicSimilarity], result of:
           0.04292825 = score(doc=2999,freq=1.0), product of:
             0.20404153 = queryWeight, product of:
               3.6741676 = boost
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.016497381 = queryNorm
             0.21038976 = fieldWeight in 2999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.0625 = fieldNorm(doc=2999)
         0.36889452 = weight(abstract_txt:usability in 2999) [ClassicSimilarity], result of:
           0.36889452 = score(doc=2999,freq=3.0), product of:
             0.5509948 = queryWeight, product of:
               5.4003067 = boost
               6.1846347 = idf(docFreq=243, maxDocs=43556)
               0.016497381 = queryNorm
             0.6695063 = fieldWeight in 2999, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.1846347 = idf(docFreq=243, maxDocs=43556)
               0.0625 = fieldNorm(doc=2999)
       0.32 = coord(8/25)
   

2. Yao, Y.Y.: Measuring retrieval effectiveness based on user preference of documents (1995) 0.21

   0.21265121 = sum of:
     0.21265121 = product of:
       0.66453505 = sum of:
         0.022373874 = weight(abstract_txt:approach in 1814) [ClassicSimilarity], result of:
           0.022373874 = score(doc=1814,freq=1.0), product of:
             0.0762344 = queryWeight, product of:
               1.2300869 = boost
               3.7566452 = idf(docFreq=2765, maxDocs=43556)
               0.016497381 = queryNorm
             0.2934879 = fieldWeight in 1814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7566452 = idf(docFreq=2765, maxDocs=43556)
               0.078125 = fieldNorm(doc=1814)
         0.040702127 = weight(abstract_txt:framework in 1814) [ClassicSimilarity], result of:
           0.040702127 = score(doc=1814,freq=1.0), product of:
             0.11360609 = queryWeight, product of:
               1.5016237 = boost
               4.5859094 = idf(docFreq=1206, maxDocs=43556)
               0.016497381 = queryNorm
             0.35827416 = fieldWeight in 1814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5859094 = idf(docFreq=1206, maxDocs=43556)
               0.078125 = fieldNorm(doc=1814)
         0.09356492 = weight(abstract_txt:valid in 1814) [ClassicSimilarity], result of:
           0.09356492 = score(doc=1814,freq=1.0), product of:
             0.1728629 = queryWeight, product of:
               1.5123962 = boost
               6.9282126 = idf(docFreq=115, maxDocs=43556)
               0.016497381 = queryNorm
             0.5412666 = fieldWeight in 1814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9282126 = idf(docFreq=115, maxDocs=43556)
               0.078125 = fieldNorm(doc=1814)
         0.093916126 = weight(abstract_txt:measurement in 1814) [ClassicSimilarity], result of:
           0.093916126 = score(doc=1814,freq=1.0), product of:
             0.1732952 = queryWeight, product of:
               1.5142862 = boost
               6.9368706 = idf(docFreq=114, maxDocs=43556)
               0.016497381 = queryNorm
             0.541943 = fieldWeight in 1814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9368706 = idf(docFreq=114, maxDocs=43556)
               0.078125 = fieldNorm(doc=1814)
         0.0435545 = weight(abstract_txt:further in 1814) [ClassicSimilarity], result of:
           0.0435545 = score(doc=1814,freq=1.0), product of:
             0.11885356 = queryWeight, product of:
               1.5359123 = boost
               4.6906257 = idf(docFreq=1086, maxDocs=43556)
               0.016497381 = queryNorm
             0.36645514 = fieldWeight in 1814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6906257 = idf(docFreq=1086, maxDocs=43556)
               0.078125 = fieldNorm(doc=1814)
         0.09018148 = weight(abstract_txt:measures in 1814) [ClassicSimilarity], result of:
           0.09018148 = score(doc=1814,freq=1.0), product of:
             0.21251096 = queryWeight, product of:
               2.3714848 = boost
               5.4318275 = idf(docFreq=517, maxDocs=43556)
               0.016497381 = queryNorm
             0.42436153 = fieldWeight in 1814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4318275 = idf(docFreq=517, maxDocs=43556)
               0.078125 = fieldNorm(doc=1814)
         0.09294238 = weight(abstract_txt:system in 1814) [ClassicSimilarity], result of:
           0.09294238 = score(doc=1814,freq=3.0), product of:
             0.20404153 = queryWeight, product of:
               3.6741676 = boost
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.016497381 = queryNorm
             0.4555072 = fieldWeight in 1814, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.078125 = fieldNorm(doc=1814)
         0.18729967 = weight(abstract_txt:usefulness in 1814) [ClassicSimilarity], result of:
           0.18729967 = score(doc=1814,freq=1.0), product of:
             0.39599666 = queryWeight, product of:
               3.964798 = boost
               6.0541816 = idf(docFreq=277, maxDocs=43556)
               0.016497381 = queryNorm
             0.47298294 = fieldWeight in 1814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0541816 = idf(docFreq=277, maxDocs=43556)
               0.078125 = fieldNorm(doc=1814)
       0.32 = coord(8/25)
   

3. Craven, J.; Johnson, F.; Butters, G.: ¬The usability and functionality of an online catalogue (2010) 0.19

   0.193137 = sum of:
     0.193137 = product of:
       0.965685 = sum of:
         0.0178991 = weight(abstract_txt:approach in 950) [ClassicSimilarity], result of:
           0.0178991 = score(doc=950,freq=1.0), product of:
             0.0762344 = queryWeight, product of:
               1.2300869 = boost
               3.7566452 = idf(docFreq=2765, maxDocs=43556)
               0.016497381 = queryNorm
             0.23479033 = fieldWeight in 950, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7566452 = idf(docFreq=2765, maxDocs=43556)
               0.0625 = fieldNorm(doc=950)
         0.12929817 = weight(abstract_txt:attributes in 950) [ClassicSimilarity], result of:
           0.12929817 = score(doc=950,freq=1.0), product of:
             0.33775985 = queryWeight, product of:
               3.342633 = boost
               6.1249747 = idf(docFreq=258, maxDocs=43556)
               0.016497381 = queryNorm
             0.38281092 = fieldWeight in 950, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1249747 = idf(docFreq=258, maxDocs=43556)
               0.0625 = fieldNorm(doc=950)
         0.10515231 = weight(abstract_txt:system in 950) [ClassicSimilarity], result of:
           0.10515231 = score(doc=950,freq=6.0), product of:
             0.20404153 = queryWeight, product of:
               3.6741676 = boost
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.016497381 = queryNorm
             0.5153476 = fieldWeight in 950, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.0625 = fieldNorm(doc=950)
         0.14983973 = weight(abstract_txt:usefulness in 950) [ClassicSimilarity], result of:
           0.14983973 = score(doc=950,freq=1.0), product of:
             0.39599666 = queryWeight, product of:
               3.964798 = boost
               6.0541816 = idf(docFreq=277, maxDocs=43556)
               0.016497381 = queryNorm
             0.37838635 = fieldWeight in 950, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0541816 = idf(docFreq=277, maxDocs=43556)
               0.0625 = fieldNorm(doc=950)
         0.5634957 = weight(abstract_txt:usability in 950) [ClassicSimilarity], result of:
           0.5634957 = score(doc=950,freq=7.0), product of:
             0.5509948 = queryWeight, product of:
               5.4003067 = boost
               6.1846347 = idf(docFreq=243, maxDocs=43556)
               0.016497381 = queryNorm
             1.0226878 = fieldWeight in 950, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.1846347 = idf(docFreq=243, maxDocs=43556)
               0.0625 = fieldNorm(doc=950)
       0.2 = coord(5/25)
   

4. Treglown, M.: HIBROWSE for bibliographic databases : a study of the application of usability techniques in view-based searching (1997) 0.19

   0.18830915 = sum of:
     0.18830915 = product of:
       0.9415457 = sum of:
         0.04792506 = weight(abstract_txt:multi in 1765) [ClassicSimilarity], result of:
           0.04792506 = score(doc=1765,freq=1.0), product of:
             0.12841277 = queryWeight, product of:
               1.3035233 = boost
               5.971376 = idf(docFreq=301, maxDocs=43556)
               0.016497381 = queryNorm
             0.373211 = fieldWeight in 1765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.971376 = idf(docFreq=301, maxDocs=43556)
               0.0625 = fieldNorm(doc=1765)
         0.0751329 = weight(abstract_txt:measurement in 1765) [ClassicSimilarity], result of:
           0.0751329 = score(doc=1765,freq=1.0), product of:
             0.1732952 = queryWeight, product of:
               1.5142862 = boost
               6.9368706 = idf(docFreq=114, maxDocs=43556)
               0.016497381 = queryNorm
             0.4335544 = fieldWeight in 1765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9368706 = idf(docFreq=114, maxDocs=43556)
               0.0625 = fieldNorm(doc=1765)
         0.10515231 = weight(abstract_txt:system in 1765) [ClassicSimilarity], result of:
           0.10515231 = score(doc=1765,freq=6.0), product of:
             0.20404153 = queryWeight, product of:
               3.6741676 = boost
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.016497381 = queryNorm
             0.5153476 = fieldWeight in 1765, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.0625 = fieldNorm(doc=1765)
         0.14983973 = weight(abstract_txt:usefulness in 1765) [ClassicSimilarity], result of:
           0.14983973 = score(doc=1765,freq=1.0), product of:
             0.39599666 = queryWeight, product of:
               3.964798 = boost
               6.0541816 = idf(docFreq=277, maxDocs=43556)
               0.016497381 = queryNorm
             0.37838635 = fieldWeight in 1765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0541816 = idf(docFreq=277, maxDocs=43556)
               0.0625 = fieldNorm(doc=1765)
         0.5634957 = weight(abstract_txt:usability in 1765) [ClassicSimilarity], result of:
           0.5634957 = score(doc=1765,freq=7.0), product of:
             0.5509948 = queryWeight, product of:
               5.4003067 = boost
               6.1846347 = idf(docFreq=243, maxDocs=43556)
               0.016497381 = queryNorm
             1.0226878 = fieldWeight in 1765, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.1846347 = idf(docFreq=243, maxDocs=43556)
               0.0625 = fieldNorm(doc=1765)
       0.2 = coord(5/25)
   

5. Cheung, C.M.K.; Lee, M.K.O.: ¬The structure of Web-based information systems satisfaction : testing of competing models (2008) 0.18

   0.17553946 = sum of:
     0.17553946 = product of:
       0.73141444 = sum of:
         0.018254526 = weight(abstract_txt:research in 4003) [ClassicSimilarity], result of:
           0.018254526 = score(doc=4003,freq=1.0), product of:
             0.073262796 = queryWeight, product of:
               1.3924237 = boost
               3.1893122 = idf(docFreq=4877, maxDocs=43556)
               0.016497381 = queryNorm
             0.24916501 = fieldWeight in 4003, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1893122 = idf(docFreq=4877, maxDocs=43556)
               0.078125 = fieldNorm(doc=4003)
         0.09356492 = weight(abstract_txt:valid in 4003) [ClassicSimilarity], result of:
           0.09356492 = score(doc=4003,freq=1.0), product of:
             0.1728629 = queryWeight, product of:
               1.5123962 = boost
               6.9282126 = idf(docFreq=115, maxDocs=43556)
               0.016497381 = queryNorm
             0.5412666 = fieldWeight in 4003, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9282126 = idf(docFreq=115, maxDocs=43556)
               0.078125 = fieldNorm(doc=4003)
         0.09018148 = weight(abstract_txt:measures in 4003) [ClassicSimilarity], result of:
           0.09018148 = score(doc=4003,freq=1.0), product of:
             0.21251096 = queryWeight, product of:
               2.3714848 = boost
               5.4318275 = idf(docFreq=517, maxDocs=43556)
               0.016497381 = queryNorm
             0.42436153 = fieldWeight in 4003, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4318275 = idf(docFreq=517, maxDocs=43556)
               0.078125 = fieldNorm(doc=4003)
         0.075887136 = weight(abstract_txt:system in 4003) [ClassicSimilarity], result of:
           0.075887136 = score(doc=4003,freq=2.0), product of:
             0.20404153 = queryWeight, product of:
               3.6741676 = boost
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.016497381 = queryNorm
             0.37192005 = fieldWeight in 4003, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.078125 = fieldNorm(doc=4003)
         0.18729967 = weight(abstract_txt:usefulness in 4003) [ClassicSimilarity], result of:
           0.18729967 = score(doc=4003,freq=1.0), product of:
             0.39599666 = queryWeight, product of:
               3.964798 = boost
               6.0541816 = idf(docFreq=277, maxDocs=43556)
               0.016497381 = queryNorm
             0.47298294 = fieldWeight in 4003, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0541816 = idf(docFreq=277, maxDocs=43556)
               0.078125 = fieldNorm(doc=4003)
         0.2662267 = weight(abstract_txt:usability in 4003) [ClassicSimilarity], result of:
           0.2662267 = score(doc=4003,freq=1.0), product of:
             0.5509948 = queryWeight, product of:
               5.4003067 = boost
               6.1846347 = idf(docFreq=243, maxDocs=43556)
               0.016497381 = queryNorm
             0.4831746 = fieldWeight in 4003, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1846347 = idf(docFreq=243, maxDocs=43556)
               0.078125 = fieldNorm(doc=4003)
       0.24 = coord(6/25)