Document (#37610)

Author

Lucassen, T.
Muilwijk, R.
Noordzij, M.L.
Schraagen, J.M.

Title

Topic familiarity and information skills in online credibility evaluation

Source

Journal of the American Society for Information Science and Technology. 64(2013) no.2, S.254-264

Year

2013

Abstract

With the rise of user-generated content, evaluating the credibility of information has become increasingly important. It is already known that various user characteristics influence the way credibility evaluation is performed. Domain experts on the topic at hand primarily focus on semantic features of information (e.g., factual accuracy), whereas novices focus more on surface features (e.g., length of a text). In this study, we further explore two key influences on credibility evaluation: topic familiarity and information skills. Participants with varying expected levels of information skills (i.e., high school students, undergraduates, and postgraduates) evaluated Wikipedia articles of varying quality on familiar and unfamiliar topics while thinking aloud. When familiar with the topic, participants indeed focused primarily on semantic features of the information, whereas participants unfamiliar with the topic paid more attention to surface features. The utilization of surface features increased with information skills. Moreover, participants with better information skills calibrated their trust against the quality of the information, whereas trust of participants with poorer information skills did not. This study confirms the enabling character of domain expertise and information skills in credibility evaluation as predicted by the updated 3S-model of credibility evaluation.

Similar documents (content)

1. Lucassen, T.; Schraagen, J.M.: Factual accuracy and trust in information : the role of expertise (2011) 0.54

   0.53622985 = sum of:
     0.53622985 = product of:
       1.1171455 = sum of:
         0.025983136 = weight(abstract_txt:semantic in 1476) [ClassicSimilarity], result of:
           0.025983136 = score(doc=1476,freq=2.0), product of:
             0.06535227 = queryWeight, product of:
               1.1483347 = boost
               4.4981704 = idf(docFreq=1292, maxDocs=42740)
               0.012651916 = queryNorm
             0.39758584 = fieldWeight in 1476, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4981704 = idf(docFreq=1292, maxDocs=42740)
               0.0625 = fieldNorm(doc=1476)
         0.031148164 = weight(abstract_txt:domain in 1476) [ClassicSimilarity], result of:
           0.031148164 = score(doc=1476,freq=2.0), product of:
             0.07374874 = queryWeight, product of:
               1.2198753 = boost
               4.7784038 = idf(docFreq=976, maxDocs=42740)
               0.012651916 = queryNorm
             0.4223552 = fieldWeight in 1476, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7784038 = idf(docFreq=976, maxDocs=42740)
               0.0625 = fieldNorm(doc=1476)
         0.06312996 = weight(abstract_txt:varying in 1476) [ClassicSimilarity], result of:
           0.06312996 = score(doc=1476,freq=1.0), product of:
             0.1488104 = queryWeight, product of:
               1.7328254 = boost
               6.787693 = idf(docFreq=130, maxDocs=42740)
               0.012651916 = queryNorm
             0.4242308 = fieldWeight in 1476, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.787693 = idf(docFreq=130, maxDocs=42740)
               0.0625 = fieldNorm(doc=1476)
         0.19539168 = weight(abstract_txt:trust in 1476) [ClassicSimilarity], result of:
           0.19539168 = score(doc=1476,freq=7.0), product of:
             0.16521432 = queryWeight, product of:
               1.825837 = boost
               7.152031 = idf(docFreq=90, maxDocs=42740)
               0.012651916 = queryNorm
             1.1826559 = fieldWeight in 1476, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               7.152031 = idf(docFreq=90, maxDocs=42740)
               0.0625 = fieldNorm(doc=1476)
         0.011274795 = weight(abstract_txt:with in 1476) [ClassicSimilarity], result of:
           0.011274795 = score(doc=1476,freq=1.0), product of:
             0.07165361 = queryWeight, product of:
               2.2495272 = boost
               2.5176222 = idf(docFreq=9369, maxDocs=42740)
               0.012651916 = queryNorm
             0.15735139 = fieldWeight in 1476, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.5176222 = idf(docFreq=9369, maxDocs=42740)
               0.0625 = fieldNorm(doc=1476)
         0.07493871 = weight(abstract_txt:whereas in 1476) [ClassicSimilarity], result of:
           0.07493871 = score(doc=1476,freq=1.0), product of:
             0.19097543 = queryWeight, product of:
               2.4042108 = boost
               6.2783957 = idf(docFreq=217, maxDocs=42740)
               0.012651916 = queryNorm
             0.39239973 = fieldWeight in 1476, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2783957 = idf(docFreq=217, maxDocs=42740)
               0.0625 = fieldNorm(doc=1476)
         0.06776427 = weight(abstract_txt:features in 1476) [ClassicSimilarity], result of:
           0.06776427 = score(doc=1476,freq=2.0), product of:
             0.16805321 = queryWeight, product of:
               2.9115992 = boost
               4.5620384 = idf(docFreq=1212, maxDocs=42740)
               0.012651916 = queryNorm
             0.40323102 = fieldWeight in 1476, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5620384 = idf(docFreq=1212, maxDocs=42740)
               0.0625 = fieldNorm(doc=1476)
         0.13396692 = weight(abstract_txt:surface in 1476) [ClassicSimilarity], result of:
           0.13396692 = score(doc=1476,freq=1.0), product of:
             0.28130132 = queryWeight, product of:
               2.9178953 = boost
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.012651916 = queryNorm
             0.47623995 = fieldWeight in 1476, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.0625 = fieldNorm(doc=1476)
         0.0390285 = weight(abstract_txt:information in 1476) [ClassicSimilarity], result of:
           0.0390285 = score(doc=1476,freq=6.0), product of:
             0.104906246 = queryWeight, product of:
               3.4120877 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.012651916 = queryNorm
             0.3720322 = fieldWeight in 1476, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.0625 = fieldNorm(doc=1476)
         0.08099511 = weight(abstract_txt:participants in 1476) [ClassicSimilarity], result of:
           0.08099511 = score(doc=1476,freq=1.0), product of:
             0.2384673 = queryWeight, product of:
               3.4683475 = boost
               5.4343796 = idf(docFreq=506, maxDocs=42740)
               0.012651916 = queryNorm
             0.33964872 = fieldWeight in 1476, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4343796 = idf(docFreq=506, maxDocs=42740)
               0.0625 = fieldNorm(doc=1476)
         0.1255905 = weight(abstract_txt:skills in 1476) [ClassicSimilarity], result of:
           0.1255905 = score(doc=1476,freq=1.0), product of:
             0.35738543 = queryWeight, product of:
               5.0238957 = boost
               5.622636 = idf(docFreq=419, maxDocs=42740)
               0.012651916 = queryNorm
             0.35141474 = fieldWeight in 1476, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.622636 = idf(docFreq=419, maxDocs=42740)
               0.0625 = fieldNorm(doc=1476)
         0.26793385 = weight(abstract_txt:credibility in 1476) [ClassicSimilarity], result of:
           0.26793385 = score(doc=1476,freq=1.0), product of:
             0.56260264 = queryWeight, product of:
               5.8357906 = boost
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.012651916 = queryNorm
             0.47623995 = fieldWeight in 1476, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.0625 = fieldNorm(doc=1476)
       0.48 = coord(12/25)
   

2. Metzger, M.J.: Making sense of credibility on the Web : Models for evaluating online information and recommendations for future research (2007) 0.23

   0.2333571 = sum of:
     0.2333571 = product of:
       1.1667855 = sum of:
         0.05720867 = weight(abstract_txt:evaluation in 2624) [ClassicSimilarity], result of:
           0.05720867 = score(doc=2624,freq=1.0), product of:
             0.1629887 = queryWeight, product of:
               2.867391 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.012651916 = queryNorm
             0.35099775 = fieldWeight in 2624, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.078125 = fieldNorm(doc=2624)
         0.083426416 = weight(abstract_txt:topic in 2624) [ClassicSimilarity], result of:
           0.083426416 = score(doc=2624,freq=1.0), product of:
             0.20959714 = queryWeight, product of:
               3.251628 = boost
               5.0948124 = idf(docFreq=711, maxDocs=42740)
               0.012651916 = queryNorm
             0.39803222 = fieldWeight in 2624, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0948124 = idf(docFreq=711, maxDocs=42740)
               0.078125 = fieldNorm(doc=2624)
         0.048785627 = weight(abstract_txt:information in 2624) [ClassicSimilarity], result of:
           0.048785627 = score(doc=2624,freq=6.0), product of:
             0.104906246 = queryWeight, product of:
               3.4120877 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.012651916 = queryNorm
             0.46504024 = fieldWeight in 2624, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.078125 = fieldNorm(doc=2624)
         0.15698813 = weight(abstract_txt:skills in 2624) [ClassicSimilarity], result of:
           0.15698813 = score(doc=2624,freq=1.0), product of:
             0.35738543 = queryWeight, product of:
               5.0238957 = boost
               5.622636 = idf(docFreq=419, maxDocs=42740)
               0.012651916 = queryNorm
             0.4392684 = fieldWeight in 2624, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.622636 = idf(docFreq=419, maxDocs=42740)
               0.078125 = fieldNorm(doc=2624)
         0.8203766 = weight(abstract_txt:credibility in 2624) [ClassicSimilarity], result of:
           0.8203766 = score(doc=2624,freq=6.0), product of:
             0.56260264 = queryWeight, product of:
               5.8357906 = boost
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.012651916 = queryNorm
             1.4581811 = fieldWeight in 2624, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.078125 = fieldNorm(doc=2624)
       0.2 = coord(5/25)
   

3. Hong, T.: ¬The influence of structural and message features an Web site credibility (2006) 0.22

   0.22315942 = sum of:
     0.22315942 = product of:
       1.115797 = sum of:
         0.027531348 = weight(abstract_txt:domain in 788) [ClassicSimilarity], result of:
           0.027531348 = score(doc=788,freq=1.0), product of:
             0.07374874 = queryWeight, product of:
               1.2198753 = boost
               4.7784038 = idf(docFreq=976, maxDocs=42740)
               0.012651916 = queryNorm
             0.3733128 = fieldWeight in 788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7784038 = idf(docFreq=976, maxDocs=42740)
               0.078125 = fieldNorm(doc=788)
         0.019931212 = weight(abstract_txt:with in 788) [ClassicSimilarity], result of:
           0.019931212 = score(doc=788,freq=2.0), product of:
             0.07165361 = queryWeight, product of:
               2.2495272 = boost
               2.5176222 = idf(docFreq=9369, maxDocs=42740)
               0.012651916 = queryNorm
             0.2781606 = fieldWeight in 788, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.5176222 = idf(docFreq=9369, maxDocs=42740)
               0.078125 = fieldNorm(doc=788)
         0.14671396 = weight(abstract_txt:features in 788) [ClassicSimilarity], result of:
           0.14671396 = score(doc=788,freq=6.0), product of:
             0.16805321 = queryWeight, product of:
               2.9115992 = boost
               4.5620384 = idf(docFreq=1212, maxDocs=42740)
               0.012651916 = queryNorm
             0.8730208 = fieldWeight in 788, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.5620384 = idf(docFreq=1212, maxDocs=42740)
               0.078125 = fieldNorm(doc=788)
         0.1012439 = weight(abstract_txt:participants in 788) [ClassicSimilarity], result of:
           0.1012439 = score(doc=788,freq=1.0), product of:
             0.2384673 = queryWeight, product of:
               3.4683475 = boost
               5.4343796 = idf(docFreq=506, maxDocs=42740)
               0.012651916 = queryNorm
             0.4245609 = fieldWeight in 788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4343796 = idf(docFreq=506, maxDocs=42740)
               0.078125 = fieldNorm(doc=788)
         0.8203766 = weight(abstract_txt:credibility in 788) [ClassicSimilarity], result of:
           0.8203766 = score(doc=788,freq=6.0), product of:
             0.56260264 = queryWeight, product of:
               5.8357906 = boost
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.012651916 = queryNorm
             1.4581811 = fieldWeight in 788, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.078125 = fieldNorm(doc=788)
       0.2 = coord(5/25)
   

4. Savolainen, R.: Judging the quality and credibility of information in Internet discussion forums (2011) 0.20

   0.19740872 = sum of:
     0.19740872 = product of:
       0.82253635 = sum of:
         0.046352677 = weight(abstract_txt:quality in 1478) [ClassicSimilarity], result of:
           0.046352677 = score(doc=1478,freq=5.0), product of:
             0.07082765 = queryWeight, product of:
               1.1954725 = boost
               4.6828146 = idf(docFreq=1074, maxDocs=42740)
               0.012651916 = queryNorm
             0.65444326 = fieldWeight in 1478, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.6828146 = idf(docFreq=1074, maxDocs=42740)
               0.0625 = fieldNorm(doc=1478)
         0.011274795 = weight(abstract_txt:with in 1478) [ClassicSimilarity], result of:
           0.011274795 = score(doc=1478,freq=1.0), product of:
             0.07165361 = queryWeight, product of:
               2.2495272 = boost
               2.5176222 = idf(docFreq=9369, maxDocs=42740)
               0.012651916 = queryNorm
             0.15735139 = fieldWeight in 1478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.5176222 = idf(docFreq=9369, maxDocs=42740)
               0.0625 = fieldNorm(doc=1478)
         0.045766935 = weight(abstract_txt:evaluation in 1478) [ClassicSimilarity], result of:
           0.045766935 = score(doc=1478,freq=1.0), product of:
             0.1629887 = queryWeight, product of:
               2.867391 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.012651916 = queryNorm
             0.2807982 = fieldWeight in 1478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0625 = fieldNorm(doc=1478)
         0.0390285 = weight(abstract_txt:information in 1478) [ClassicSimilarity], result of:
           0.0390285 = score(doc=1478,freq=6.0), product of:
             0.104906246 = queryWeight, product of:
               3.4120877 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.012651916 = queryNorm
             0.3720322 = fieldWeight in 1478, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.0625 = fieldNorm(doc=1478)
         0.08099511 = weight(abstract_txt:participants in 1478) [ClassicSimilarity], result of:
           0.08099511 = score(doc=1478,freq=1.0), product of:
             0.2384673 = queryWeight, product of:
               3.4683475 = boost
               5.4343796 = idf(docFreq=506, maxDocs=42740)
               0.012651916 = queryNorm
             0.33964872 = fieldWeight in 1478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4343796 = idf(docFreq=506, maxDocs=42740)
               0.0625 = fieldNorm(doc=1478)
         0.59911835 = weight(abstract_txt:credibility in 1478) [ClassicSimilarity], result of:
           0.59911835 = score(doc=1478,freq=5.0), product of:
             0.56260264 = queryWeight, product of:
               5.8357906 = boost
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.012651916 = queryNorm
             1.0649049 = fieldWeight in 1478, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.0625 = fieldNorm(doc=1478)
       0.24 = coord(6/25)
   

5. Shiri, A.: Topic familiarity and its effects on term selection and browsing in a thesaurus-enhanced search environment (2005) 0.20

   0.19515109 = sum of:
     0.19515109 = product of:
       0.6098472 = sum of:
         0.018372852 = weight(abstract_txt:semantic in 1739) [ClassicSimilarity], result of:
           0.018372852 = score(doc=1739,freq=1.0), product of:
             0.06535227 = queryWeight, product of:
               1.1483347 = boost
               4.4981704 = idf(docFreq=1292, maxDocs=42740)
               0.012651916 = queryNorm
             0.28113565 = fieldWeight in 1739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4981704 = idf(docFreq=1292, maxDocs=42740)
               0.0625 = fieldNorm(doc=1739)
         0.061888635 = weight(abstract_txt:familiar in 1739) [ClassicSimilarity], result of:
           0.061888635 = score(doc=1739,freq=1.0), product of:
             0.14685325 = queryWeight, product of:
               1.7213926 = boost
               6.7429094 = idf(docFreq=136, maxDocs=42740)
               0.012651916 = queryNorm
             0.42143184 = fieldWeight in 1739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7429094 = idf(docFreq=136, maxDocs=42740)
               0.0625 = fieldNorm(doc=1739)
         0.06312996 = weight(abstract_txt:varying in 1739) [ClassicSimilarity], result of:
           0.06312996 = score(doc=1739,freq=1.0), product of:
             0.1488104 = queryWeight, product of:
               1.7328254 = boost
               6.787693 = idf(docFreq=130, maxDocs=42740)
               0.012651916 = queryNorm
             0.4242308 = fieldWeight in 1739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.787693 = idf(docFreq=130, maxDocs=42740)
               0.0625 = fieldNorm(doc=1739)
         0.20857963 = weight(abstract_txt:familiarity in 1739) [ClassicSimilarity], result of:
           0.20857963 = score(doc=1739,freq=5.0), product of:
             0.19304898 = queryWeight, product of:
               1.9736582 = boost
               7.731065 = idf(docFreq=50, maxDocs=42740)
               0.012651916 = queryNorm
             1.0804492 = fieldWeight in 1739, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.731065 = idf(docFreq=50, maxDocs=42740)
               0.0625 = fieldNorm(doc=1739)
         0.09872627 = weight(abstract_txt:unfamiliar in 1739) [ClassicSimilarity], result of:
           0.09872627 = score(doc=1739,freq=1.0), product of:
             0.2004925 = queryWeight, product of:
               2.011348 = boost
               7.8787007 = idf(docFreq=43, maxDocs=42740)
               0.012651916 = queryNorm
             0.4924188 = fieldWeight in 1739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.8787007 = idf(docFreq=43, maxDocs=42740)
               0.0625 = fieldNorm(doc=1739)
         0.027617497 = weight(abstract_txt:with in 1739) [ClassicSimilarity], result of:
           0.027617497 = score(doc=1739,freq=6.0), product of:
             0.07165361 = queryWeight, product of:
               2.2495272 = boost
               2.5176222 = idf(docFreq=9369, maxDocs=42740)
               0.012651916 = queryNorm
             0.38543063 = fieldWeight in 1739, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.5176222 = idf(docFreq=9369, maxDocs=42740)
               0.0625 = fieldNorm(doc=1739)
         0.11559902 = weight(abstract_txt:topic in 1739) [ClassicSimilarity], result of:
           0.11559902 = score(doc=1739,freq=3.0), product of:
             0.20959714 = queryWeight, product of:
               3.251628 = boost
               5.0948124 = idf(docFreq=711, maxDocs=42740)
               0.012651916 = queryNorm
             0.5515296 = fieldWeight in 1739, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.0948124 = idf(docFreq=711, maxDocs=42740)
               0.0625 = fieldNorm(doc=1739)
         0.015933318 = weight(abstract_txt:information in 1739) [ClassicSimilarity], result of:
           0.015933318 = score(doc=1739,freq=1.0), product of:
             0.104906246 = queryWeight, product of:
               3.4120877 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.012651916 = queryNorm
             0.1518815 = fieldWeight in 1739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.0625 = fieldNorm(doc=1739)
       0.32 = coord(8/25)