Document (#38137)

Author

Shani, G.
Rokach, L.
Shapira, B.
Hadash, S.
Tangi, M.

Title

Investigating confidence displays for top-N recommendations

Source

Journal of the American Society for Information Science and Technology. 64(2013) no.12, S.2548-2563

Year

2013

Abstract

Recommendation systems often compute fixed-length lists of recommended items to users. Forcing the system to predict a fixed-length list for each user may result in different confidence levels for the computed recommendations. Reporting the system's confidence in its predictions (the recommendation strength) can provide valuable information to users in making their decisions. In this article, we investigate several different displays of a system's confidence to users and conclude that some displays are easier to understand and are favored by most users. We continue to investigate the effect confidence has on users in terms of their perception of the recommendation quality and the user experience with the system. Our studies show that it is not easier for users to identify relevant items when confidence is displayed. Still, users appreciate the displays and trust them when the relevance of items is difficult to establish.

Similar documents (author)

1. Shapira, B.: Hypertext browsing : a new model for information filtering based on user profiles and data clustering (1996) 1.85

   1.8480085 = sum of:
     1.8480085 = product of:
       3.696017 = sum of:
         3.696017 = weight(author_txt:shapira in 4711) [ClassicSimilarity], result of:
           3.696017 = score(doc=4711,freq=1.0), product of:
             0.6578857 = queryWeight, product of:
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.073189184 = queryNorm
             5.6180234 = fieldWeight in 4711, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.625 = fieldNorm(doc=4711)
       0.5 = coord(1/2)
   

2. Rokach, L.; Mitra, P.: Parsimonious citer-based measures : the artificial intelligence domain as a case study (2013) 1.81

   1.8107673 = sum of:
     1.8107673 = product of:
       3.6215346 = sum of:
         3.6215346 = weight(author_txt:rokach in 212) [ClassicSimilarity], result of:
           3.6215346 = score(doc=212,freq=1.0), product of:
             0.75311774 = queryWeight, product of:
               1.0699321 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.073189184 = queryNorm
             4.808723 = fieldWeight in 212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.5 = fieldNorm(doc=212)
       0.5 = coord(1/2)
   

3. Ofek, N.; Rokach, L.: ¬A classifier to determine which Wikipedia biographies will be accepted (2015) 1.81

   1.8107673 = sum of:
     1.8107673 = product of:
       3.6215346 = sum of:
         3.6215346 = weight(author_txt:rokach in 1610) [ClassicSimilarity], result of:
           3.6215346 = score(doc=1610,freq=1.0), product of:
             0.75311774 = queryWeight, product of:
               1.0699321 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.073189184 = queryNorm
             4.808723 = fieldWeight in 1610, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.5 = fieldNorm(doc=1610)
       0.5 = coord(1/2)
   

4. Shapira, B.; Zabar, B.: Personalized search : integrating collaboration and social networks (2011) 1.48

   1.4784068 = sum of:
     1.4784068 = product of:
       2.9568136 = sum of:
         2.9568136 = weight(author_txt:shapira in 4140) [ClassicSimilarity], result of:
           2.9568136 = score(doc=4140,freq=1.0), product of:
             0.6578857 = queryWeight, product of:
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.073189184 = queryNorm
             4.4944186 = fieldWeight in 4140, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.5 = fieldNorm(doc=4140)
       0.5 = coord(1/2)
   

5. Blank, I.; Rokach, L.; Shani, G.: Leveraging metadata to recommend keywords for academic papers (2016) 1.36

   1.3580754 = sum of:
     1.3580754 = product of:
       2.7161508 = sum of:
         2.7161508 = weight(author_txt:rokach in 3232) [ClassicSimilarity], result of:
           2.7161508 = score(doc=3232,freq=1.0), product of:
             0.75311774 = queryWeight, product of:
               1.0699321 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.073189184 = queryNorm
             3.606542 = fieldWeight in 3232, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.375 = fieldNorm(doc=3232)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Bessa, A.; Santos, R.L.T.; Veloso, A.; Ziviani, N.: Exploiting item co-utility to improve collaborative filtering recommendations (2017) 0.12

   0.11722539 = sum of:
     0.11722539 = product of:
       0.48843914 = sum of:
         0.020781428 = weight(abstract_txt:different in 3824) [ClassicSimilarity], result of:
           0.020781428 = score(doc=3824,freq=3.0), product of:
             0.05237226 = queryWeight, product of:
               1.0817626 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0132079655 = queryNorm
             0.39680222 = fieldWeight in 3824, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0625 = fieldNorm(doc=3824)
         0.012176208 = weight(abstract_txt:user in 3824) [ClassicSimilarity], result of:
           0.012176208 = score(doc=3824,freq=1.0), product of:
             0.052889097 = queryWeight, product of:
               1.0870872 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0132079655 = queryNorm
             0.23022151 = fieldWeight in 3824, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0625 = fieldNorm(doc=3824)
         0.09244786 = weight(abstract_txt:recommendations in 3824) [ClassicSimilarity], result of:
           0.09244786 = score(doc=3824,freq=4.0), product of:
             0.12870717 = queryWeight, product of:
               1.6958313 = boost
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.0132079655 = queryNorm
             0.7182806 = fieldWeight in 3824, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.0625 = fieldNorm(doc=3824)
         0.12689829 = weight(abstract_txt:items in 3824) [ClassicSimilarity], result of:
           0.12689829 = score(doc=3824,freq=4.0), product of:
             0.18197249 = queryWeight, product of:
               2.469618 = boost
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.0132079655 = queryNorm
             0.6973488 = fieldWeight in 3824, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.0625 = fieldNorm(doc=3824)
         0.18127975 = weight(abstract_txt:recommendation in 3824) [ClassicSimilarity], result of:
           0.18127975 = score(doc=3824,freq=2.0), product of:
             0.2908114 = queryWeight, product of:
               3.121998 = boost
               7.0524964 = idf(docFreq=103, maxDocs=44218)
               0.0132079655 = queryNorm
             0.6233585 = fieldWeight in 3824, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.0524964 = idf(docFreq=103, maxDocs=44218)
               0.0625 = fieldNorm(doc=3824)
         0.054855615 = weight(abstract_txt:users in 3824) [ClassicSimilarity], result of:
           0.054855615 = score(doc=3824,freq=2.0), product of:
             0.17385407 = queryWeight, product of:
               3.6872938 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0132079655 = queryNorm
             0.31552678 = fieldWeight in 3824, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0625 = fieldNorm(doc=3824)
       0.24 = coord(6/25)
   

2. Bartolo, L.M.; Smith, T.D.: Interdisciplinary work and the information search process : a comparison of manual and online searching (1993) 0.11

   0.110710956 = sum of:
     0.110710956 = product of:
       0.5535548 = sum of:
         0.026362263 = weight(abstract_txt:user in 5249) [ClassicSimilarity], result of:
           0.026362263 = score(doc=5249,freq=3.0), product of:
             0.052889097 = queryWeight, product of:
               1.0870872 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0132079655 = queryNorm
             0.49844417 = fieldWeight in 5249, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.078125 = fieldNorm(doc=5249)
         0.021739257 = weight(abstract_txt:when in 5249) [ClassicSimilarity], result of:
           0.021739257 = score(doc=5249,freq=1.0), product of:
             0.06707818 = queryWeight, product of:
               1.2242551 = boost
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.0132079655 = queryNorm
             0.32408836 = fieldWeight in 5249, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.078125 = fieldNorm(doc=5249)
         0.07931143 = weight(abstract_txt:items in 5249) [ClassicSimilarity], result of:
           0.07931143 = score(doc=5249,freq=1.0), product of:
             0.18197249 = queryWeight, product of:
               2.469618 = boost
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.0132079655 = queryNorm
             0.435843 = fieldWeight in 5249, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.078125 = fieldNorm(doc=5249)
         0.06856952 = weight(abstract_txt:users in 5249) [ClassicSimilarity], result of:
           0.06856952 = score(doc=5249,freq=2.0), product of:
             0.17385407 = queryWeight, product of:
               3.6872938 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0132079655 = queryNorm
             0.39440846 = fieldWeight in 5249, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.078125 = fieldNorm(doc=5249)
         0.35757232 = weight(abstract_txt:confidence in 5249) [ClassicSimilarity], result of:
           0.35757232 = score(doc=5249,freq=1.0), product of:
             0.6257024 = queryWeight, product of:
               6.476283 = boost
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.0132079655 = queryNorm
             0.5714735 = fieldWeight in 5249, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.078125 = fieldNorm(doc=5249)
       0.2 = coord(5/25)
   

3. Duncan, E.B.: Structuring knowledge bases for designers of learning materials (1989) 0.11

   0.10861435 = sum of:
     0.10861435 = product of:
       0.4525598 = sum of:
         0.016967963 = weight(abstract_txt:different in 2478) [ClassicSimilarity], result of:
           0.016967963 = score(doc=2478,freq=2.0), product of:
             0.05237226 = queryWeight, product of:
               1.0817626 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0132079655 = queryNorm
             0.32398763 = fieldWeight in 2478, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0625 = fieldNorm(doc=2478)
         0.017391406 = weight(abstract_txt:when in 2478) [ClassicSimilarity], result of:
           0.017391406 = score(doc=2478,freq=1.0), product of:
             0.06707818 = queryWeight, product of:
               1.2242551 = boost
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.0132079655 = queryNorm
             0.2592707 = fieldWeight in 2478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.0625 = fieldNorm(doc=2478)
         0.0689943 = weight(abstract_txt:easier in 2478) [ClassicSimilarity], result of:
           0.0689943 = score(doc=2478,freq=1.0), product of:
             0.1680997 = queryWeight, product of:
               1.938049 = boost
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.0132079655 = queryNorm
             0.41043678 = fieldWeight in 2478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.0625 = fieldNorm(doc=2478)
         0.09167374 = weight(abstract_txt:fixed in 2478) [ClassicSimilarity], result of:
           0.09167374 = score(doc=2478,freq=1.0), product of:
             0.20316775 = queryWeight, product of:
               2.130633 = boost
               7.2195506 = idf(docFreq=87, maxDocs=44218)
               0.0132079655 = queryNorm
             0.4512219 = fieldWeight in 2478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2195506 = idf(docFreq=87, maxDocs=44218)
               0.0625 = fieldNorm(doc=2478)
         0.038788777 = weight(abstract_txt:users in 2478) [ClassicSimilarity], result of:
           0.038788777 = score(doc=2478,freq=1.0), product of:
             0.17385407 = queryWeight, product of:
               3.6872938 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0132079655 = queryNorm
             0.22311112 = fieldWeight in 2478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0625 = fieldNorm(doc=2478)
         0.2187436 = weight(abstract_txt:displays in 2478) [ClassicSimilarity], result of:
           0.2187436 = score(doc=2478,freq=2.0), product of:
             0.3627842 = queryWeight, product of:
               4.026433 = boost
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.0132079655 = queryNorm
             0.6029579 = fieldWeight in 2478, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.0625 = fieldNorm(doc=2478)
       0.24 = coord(6/25)
   

4. Duncan, E.B.: ¬A faceted approach to hypertext (1989) 0.11

   0.10861435 = sum of:
     0.10861435 = product of:
       0.4525598 = sum of:
         0.016967963 = weight(abstract_txt:different in 2480) [ClassicSimilarity], result of:
           0.016967963 = score(doc=2480,freq=2.0), product of:
             0.05237226 = queryWeight, product of:
               1.0817626 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0132079655 = queryNorm
             0.32398763 = fieldWeight in 2480, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0625 = fieldNorm(doc=2480)
         0.017391406 = weight(abstract_txt:when in 2480) [ClassicSimilarity], result of:
           0.017391406 = score(doc=2480,freq=1.0), product of:
             0.06707818 = queryWeight, product of:
               1.2242551 = boost
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.0132079655 = queryNorm
             0.2592707 = fieldWeight in 2480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.0625 = fieldNorm(doc=2480)
         0.0689943 = weight(abstract_txt:easier in 2480) [ClassicSimilarity], result of:
           0.0689943 = score(doc=2480,freq=1.0), product of:
             0.1680997 = queryWeight, product of:
               1.938049 = boost
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.0132079655 = queryNorm
             0.41043678 = fieldWeight in 2480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.0625 = fieldNorm(doc=2480)
         0.09167374 = weight(abstract_txt:fixed in 2480) [ClassicSimilarity], result of:
           0.09167374 = score(doc=2480,freq=1.0), product of:
             0.20316775 = queryWeight, product of:
               2.130633 = boost
               7.2195506 = idf(docFreq=87, maxDocs=44218)
               0.0132079655 = queryNorm
             0.4512219 = fieldWeight in 2480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2195506 = idf(docFreq=87, maxDocs=44218)
               0.0625 = fieldNorm(doc=2480)
         0.038788777 = weight(abstract_txt:users in 2480) [ClassicSimilarity], result of:
           0.038788777 = score(doc=2480,freq=1.0), product of:
             0.17385407 = queryWeight, product of:
               3.6872938 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0132079655 = queryNorm
             0.22311112 = fieldWeight in 2480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0625 = fieldNorm(doc=2480)
         0.2187436 = weight(abstract_txt:displays in 2480) [ClassicSimilarity], result of:
           0.2187436 = score(doc=2480,freq=2.0), product of:
             0.3627842 = queryWeight, product of:
               4.026433 = boost
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.0132079655 = queryNorm
             0.6029579 = fieldWeight in 2480, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.0625 = fieldNorm(doc=2480)
       0.24 = coord(6/25)
   

5. Duncan, E.B.: ¬A concept-map thesaurus as a knowledge-based hypertext interface to a bibliographic database (1990) 0.11

   0.10861435 = sum of:
     0.10861435 = product of:
       0.4525598 = sum of:
         0.016967963 = weight(abstract_txt:different in 2481) [ClassicSimilarity], result of:
           0.016967963 = score(doc=2481,freq=2.0), product of:
             0.05237226 = queryWeight, product of:
               1.0817626 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0132079655 = queryNorm
             0.32398763 = fieldWeight in 2481, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0625 = fieldNorm(doc=2481)
         0.017391406 = weight(abstract_txt:when in 2481) [ClassicSimilarity], result of:
           0.017391406 = score(doc=2481,freq=1.0), product of:
             0.06707818 = queryWeight, product of:
               1.2242551 = boost
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.0132079655 = queryNorm
             0.2592707 = fieldWeight in 2481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.0625 = fieldNorm(doc=2481)
         0.0689943 = weight(abstract_txt:easier in 2481) [ClassicSimilarity], result of:
           0.0689943 = score(doc=2481,freq=1.0), product of:
             0.1680997 = queryWeight, product of:
               1.938049 = boost
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.0132079655 = queryNorm
             0.41043678 = fieldWeight in 2481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.0625 = fieldNorm(doc=2481)
         0.09167374 = weight(abstract_txt:fixed in 2481) [ClassicSimilarity], result of:
           0.09167374 = score(doc=2481,freq=1.0), product of:
             0.20316775 = queryWeight, product of:
               2.130633 = boost
               7.2195506 = idf(docFreq=87, maxDocs=44218)
               0.0132079655 = queryNorm
             0.4512219 = fieldWeight in 2481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2195506 = idf(docFreq=87, maxDocs=44218)
               0.0625 = fieldNorm(doc=2481)
         0.038788777 = weight(abstract_txt:users in 2481) [ClassicSimilarity], result of:
           0.038788777 = score(doc=2481,freq=1.0), product of:
             0.17385407 = queryWeight, product of:
               3.6872938 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0132079655 = queryNorm
             0.22311112 = fieldWeight in 2481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0625 = fieldNorm(doc=2481)
         0.2187436 = weight(abstract_txt:displays in 2481) [ClassicSimilarity], result of:
           0.2187436 = score(doc=2481,freq=2.0), product of:
             0.3627842 = queryWeight, product of:
               4.026433 = boost
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.0132079655 = queryNorm
             0.6029579 = fieldWeight in 2481, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.0625 = fieldNorm(doc=2481)
       0.24 = coord(6/25)