Document (#42107)

Author

Vakkari, P.
Völske, M.
Potthast, M.
Hagen, M.
Stein, B.

Title

Modeling the usefulness of search results as measured by information use

Source

Information processing and management. 56(2019) no.3, S.879-894

Year

2019

Abstract

The documents retrieved by a web search are useful if the information they contain contributes to some task or information need. To measure search result utility, studies have typically focused on perceived usefulness rather than on actual information use. We investigate the actual usefulness of search results-as indicated by their use as sources in an extensive writing task-and the factors that make a writer successful at retrieving useful sources. Our data comprise 150 essays written by 12 writers whose querying, clicking and writing activities were recorded. By tracking authors' text reuse behavior, we quantify the search results' contribution to the task more accurately than before. We model the overall utility of the search results retrieved throughout the writing process using path analysis, and compare a binary utility model (Reuse Events) to one that quantifies a degree of utility (Reuse Amount). The Reuse Events model has greater explanatory power (63% vs. 48%); in both models, the number of clicks is by far the strongest predictor of useful results-with ß-coefficients up to 0.7-while dwell time has a negative effect (ß between -0.14 and -0.21). As a conclusion, we propose a new measure of search result usefulness based on a source's contribution to an evolving text. Our findings are valid for tasks where text reuse is allowed, but also have implications on designing indicators of search result usefulness for general writing tasks.

Content

Vgl.: https://doi.org/10.1016/j.ipm.2019.02.001.

Similar documents (author)

1. Vakkari, P.; Völske, M.; Potthast, M.; Hagen, M.; Stein, B.: Predicting essay quality from search and writing behavior (2021) 4.67

   4.668343 = sum of:
     4.668343 = sum of:
       1.3583887 = weight(author_txt:vakkari in 260) [ClassicSimilarity], result of:
         1.3583887 = score(doc=260,freq=1.0), product of:
           0.52606755 = queryWeight, product of:
             8.2629 = idf(docFreq=30, maxDocs=44218)
             0.06366621 = queryNorm
           2.5821564 = fieldWeight in 260, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.2629 = idf(docFreq=30, maxDocs=44218)
             0.3125 = fieldNorm(doc=260)
       1.4276682 = weight(author_txt:stein in 260) [ClassicSimilarity], result of:
         1.4276682 = score(doc=260,freq=1.0), product of:
           0.5438056 = queryWeight, product of:
             1.0167193 = boost
             8.401051 = idf(docFreq=26, maxDocs=44218)
             0.06366621 = queryNorm
           2.6253283 = fieldWeight in 260, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.401051 = idf(docFreq=26, maxDocs=44218)
             0.3125 = fieldNorm(doc=260)
       1.882286 = weight(author_txt:hagen in 260) [ClassicSimilarity], result of:
         1.882286 = score(doc=260,freq=1.0), product of:
           0.65385664 = queryWeight, product of:
             1.1148604 = boost
             9.211981 = idf(docFreq=11, maxDocs=44218)
             0.06366621 = queryNorm
           2.8787441 = fieldWeight in 260, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.211981 = idf(docFreq=11, maxDocs=44218)
             0.3125 = fieldNorm(doc=260)
   

2. Hagen, P.-T.: Projekt Einheitsklassifikation (1974) 1.00

   1.0038859 = sum of:
     1.0038859 = product of:
       3.0116575 = sum of:
         3.0116575 = weight(author_txt:hagen in 124) [ClassicSimilarity], result of:
           3.0116575 = score(doc=124,freq=1.0), product of:
             0.65385664 = queryWeight, product of:
               1.1148604 = boost
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.06366621 = queryNorm
             4.6059904 = fieldWeight in 124, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.5 = fieldNorm(doc=124)
       0.33333334 = coord(1/3)
   

3. Hagen-Lautrup, C.B.: ¬The LA series and cataloguing (1989) 1.00

   1.0038859 = sum of:
     1.0038859 = product of:
       3.0116575 = sum of:
         3.0116575 = weight(author_txt:hagen in 1564) [ClassicSimilarity], result of:
           3.0116575 = score(doc=1564,freq=1.0), product of:
             0.65385664 = queryWeight, product of:
               1.1148604 = boost
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.06366621 = queryNorm
             4.6059904 = fieldWeight in 1564, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.5 = fieldNorm(doc=1564)
       0.33333334 = coord(1/3)
   

4. Kubicek, H.; Hagen, M.: Gesellschaftliche Voraussetzungen für die informationstechnische Unterstützung politischer Beteiligung (2000) 1.00

   1.0038859 = sum of:
     1.0038859 = product of:
       3.0116575 = sum of:
         3.0116575 = weight(author_txt:hagen in 5985) [ClassicSimilarity], result of:
           3.0116575 = score(doc=5985,freq=1.0), product of:
             0.65385664 = queryWeight, product of:
               1.1148604 = boost
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.06366621 = queryNorm
             4.6059904 = fieldWeight in 5985, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.5 = fieldNorm(doc=5985)
       0.33333334 = coord(1/3)
   

5. Stein, A.: ¬Die Kunst der Visualisierung von Informationen : neue Präsentationsmöglichkeiten mit modernen graphischen Benutzungsschnittstellen (1992) 0.95

   0.9517788 = sum of:
     0.9517788 = product of:
       2.8553364 = sum of:
         2.8553364 = weight(author_txt:stein in 0) [ClassicSimilarity], result of:
           2.8553364 = score(doc=0,freq=1.0), product of:
             0.5438056 = queryWeight, product of:
               1.0167193 = boost
               8.401051 = idf(docFreq=26, maxDocs=44218)
               0.06366621 = queryNorm
             5.2506566 = fieldWeight in 0, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.401051 = idf(docFreq=26, maxDocs=44218)
               0.625 = fieldNorm(doc=0)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. Vakkari, P.; Huuskonen, S.: Search effort degrades search output but improves task outcome (2012) 0.25

   0.24575368 = sum of:
     0.24575368 = product of:
       0.6826491 = sum of:
         0.00719182 = weight(abstract_txt:information in 46) [ClassicSimilarity], result of:
           0.00719182 = score(doc=46,freq=1.0), product of:
             0.047530636 = queryWeight, product of:
               1.157699 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.01695871 = queryNorm
             0.15130915 = fieldWeight in 46, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.047129 = weight(abstract_txt:retrieved in 46) [ClassicSimilarity], result of:
           0.047129 = score(doc=46,freq=1.0), product of:
             0.13210824 = queryWeight, product of:
               1.3647679 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.01695871 = queryNorm
             0.35674536 = fieldWeight in 46, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.024078695 = weight(abstract_txt:model in 46) [ClassicSimilarity], result of:
           0.024078695 = score(doc=46,freq=1.0), product of:
             0.0966474 = queryWeight, product of:
               1.4296659 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.01695871 = queryNorm
             0.24913962 = fieldWeight in 46, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.11914695 = weight(abstract_txt:task in 46) [ClassicSimilarity], result of:
           0.11914695 = score(doc=46,freq=7.0), product of:
             0.14670923 = queryWeight, product of:
               1.7614413 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.01695871 = queryNorm
             0.81212986 = fieldWeight in 46, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.050499476 = weight(abstract_txt:result in 46) [ClassicSimilarity], result of:
           0.050499476 = score(doc=46,freq=1.0), product of:
             0.15835293 = queryWeight, product of:
               1.830006 = boost
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.01695871 = queryNorm
             0.3189046 = fieldWeight in 46, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.026757011 = weight(abstract_txt:results in 46) [ClassicSimilarity], result of:
           0.026757011 = score(doc=46,freq=1.0), product of:
             0.122935176 = queryWeight, product of:
               2.0816224 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.01695871 = queryNorm
             0.21765138 = fieldWeight in 46, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.13566695 = weight(abstract_txt:writing in 46) [ClassicSimilarity], result of:
           0.13566695 = score(doc=46,freq=1.0), product of:
             0.33681944 = queryWeight, product of:
               3.081821 = boost
               6.444614 = idf(docFreq=190, maxDocs=44218)
               0.01695871 = queryNorm
             0.40278837 = fieldWeight in 46, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.444614 = idf(docFreq=190, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.13128409 = weight(abstract_txt:search in 46) [ClassicSimilarity], result of:
           0.13128409 = score(doc=46,freq=7.0), product of:
             0.21703668 = queryWeight, product of:
               3.4985688 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.01695871 = queryNorm
             0.60489357 = fieldWeight in 46, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.14089505 = weight(abstract_txt:usefulness in 46) [ClassicSimilarity], result of:
           0.14089505 = score(doc=46,freq=1.0), product of:
             0.37209022 = queryWeight, product of:
               3.6214957 = boost
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.01695871 = queryNorm
             0.3786583 = fieldWeight in 46, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
       0.36 = coord(9/25)
   

2. Liu, J.; Belkin, N.J.: Personalizing information retrieval for multi-session tasks : examining the roles of task stage, task type, and topic knowledge on the interpretation of dwell time as an indicator of document usefulness (2015) 0.24

   0.2378898 = sum of:
     0.2378898 = product of:
       0.74340564 = sum of:
         0.21011008 = weight(abstract_txt:dwell in 1608) [ClassicSimilarity], result of:
           0.21011008 = score(doc=1608,freq=4.0), product of:
             0.17892554 = queryWeight, product of:
               1.1230912 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.01695871 = queryNorm
             1.1742878 = fieldWeight in 1608, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.0625 = fieldNorm(doc=1608)
         0.027092952 = weight(abstract_txt:sources in 1608) [ClassicSimilarity], result of:
           0.027092952 = score(doc=1608,freq=1.0), product of:
             0.091336 = queryWeight, product of:
               1.1347883 = boost
               4.7460723 = idf(docFreq=1043, maxDocs=44218)
               0.01695871 = queryNorm
             0.29662952 = fieldWeight in 1608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7460723 = idf(docFreq=1043, maxDocs=44218)
               0.0625 = fieldNorm(doc=1608)
         0.012456598 = weight(abstract_txt:information in 1608) [ClassicSimilarity], result of:
           0.012456598 = score(doc=1608,freq=3.0), product of:
             0.047530636 = queryWeight, product of:
               1.157699 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.01695871 = queryNorm
             0.26207513 = fieldWeight in 1608, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=1608)
         0.03488065 = weight(abstract_txt:tasks in 1608) [ClassicSimilarity], result of:
           0.03488065 = score(doc=1608,freq=1.0), product of:
             0.108092144 = queryWeight, product of:
               1.2344995 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.01695871 = queryNorm
             0.32269365 = fieldWeight in 1608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.0625 = fieldNorm(doc=1608)
         0.100697555 = weight(abstract_txt:task in 1608) [ClassicSimilarity], result of:
           0.100697555 = score(doc=1608,freq=5.0), product of:
             0.14670923 = queryWeight, product of:
               1.7614413 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.01695871 = queryNorm
             0.686375 = fieldWeight in 1608, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0625 = fieldNorm(doc=1608)
         0.026757011 = weight(abstract_txt:results in 1608) [ClassicSimilarity], result of:
           0.026757011 = score(doc=1608,freq=1.0), product of:
             0.122935176 = queryWeight, product of:
               2.0816224 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.01695871 = queryNorm
             0.21765138 = fieldWeight in 1608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=1608)
         0.04962072 = weight(abstract_txt:search in 1608) [ClassicSimilarity], result of:
           0.04962072 = score(doc=1608,freq=1.0), product of:
             0.21703668 = queryWeight, product of:
               3.4985688 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.01695871 = queryNorm
             0.22862828 = fieldWeight in 1608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=1608)
         0.2817901 = weight(abstract_txt:usefulness in 1608) [ClassicSimilarity], result of:
           0.2817901 = score(doc=1608,freq=4.0), product of:
             0.37209022 = queryWeight, product of:
               3.6214957 = boost
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.01695871 = queryNorm
             0.7573166 = fieldWeight in 1608, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.0625 = fieldNorm(doc=1608)
       0.32 = coord(8/25)
   

3. Karanam, S.; Oostendorp, H. van; Sanchiz, M.; Chin, J.; Fu, W.-T.: Cognitive modeling of age-related differences in information search behavior (2017) 0.22

   0.22135982 = sum of:
     0.22135982 = product of:
       0.61488837 = sum of:
         0.08654374 = weight(abstract_txt:clicks in 3825) [ClassicSimilarity], result of:
           0.08654374 = score(doc=3825,freq=1.0), product of:
             0.15723583 = queryWeight, product of:
               1.0528212 = boost
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.01695871 = queryNorm
             0.55040723 = fieldWeight in 3825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.0625 = fieldNorm(doc=3825)
         0.010170769 = weight(abstract_txt:information in 3825) [ClassicSimilarity], result of:
           0.010170769 = score(doc=3825,freq=2.0), product of:
             0.047530636 = queryWeight, product of:
               1.157699 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.01695871 = queryNorm
             0.21398345 = fieldWeight in 3825, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=3825)
         0.08543979 = weight(abstract_txt:tasks in 3825) [ClassicSimilarity], result of:
           0.08543979 = score(doc=3825,freq=6.0), product of:
             0.108092144 = queryWeight, product of:
               1.2344995 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.01695871 = queryNorm
             0.7904348 = fieldWeight in 3825, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.0625 = fieldNorm(doc=3825)
         0.034052417 = weight(abstract_txt:model in 3825) [ClassicSimilarity], result of:
           0.034052417 = score(doc=3825,freq=2.0), product of:
             0.0966474 = queryWeight, product of:
               1.4296659 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.01695871 = queryNorm
             0.35233662 = fieldWeight in 3825, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.0625 = fieldNorm(doc=3825)
         0.08128867 = weight(abstract_txt:actual in 3825) [ClassicSimilarity], result of:
           0.08128867 = score(doc=3825,freq=2.0), product of:
             0.15080455 = queryWeight, product of:
               1.4581462 = boost
               6.0984654 = idf(docFreq=269, maxDocs=44218)
               0.01695871 = queryNorm
             0.5390333 = fieldWeight in 3825, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.0984654 = idf(docFreq=269, maxDocs=44218)
               0.0625 = fieldNorm(doc=3825)
         0.050499476 = weight(abstract_txt:result in 3825) [ClassicSimilarity], result of:
           0.050499476 = score(doc=3825,freq=1.0), product of:
             0.15835293 = queryWeight, product of:
               1.830006 = boost
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.01695871 = queryNorm
             0.3189046 = fieldWeight in 3825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.0625 = fieldNorm(doc=3825)
         0.026757011 = weight(abstract_txt:results in 3825) [ClassicSimilarity], result of:
           0.026757011 = score(doc=3825,freq=1.0), product of:
             0.122935176 = queryWeight, product of:
               2.0816224 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.01695871 = queryNorm
             0.21765138 = fieldWeight in 3825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=3825)
         0.09924144 = weight(abstract_txt:search in 3825) [ClassicSimilarity], result of:
           0.09924144 = score(doc=3825,freq=4.0), product of:
             0.21703668 = queryWeight, product of:
               3.4985688 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.01695871 = queryNorm
             0.45725656 = fieldWeight in 3825, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=3825)
         0.14089505 = weight(abstract_txt:usefulness in 3825) [ClassicSimilarity], result of:
           0.14089505 = score(doc=3825,freq=1.0), product of:
             0.37209022 = queryWeight, product of:
               3.6214957 = boost
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.01695871 = queryNorm
             0.3786583 = fieldWeight in 3825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.0625 = fieldNorm(doc=3825)
       0.36 = coord(9/25)
   

4. Tombros, A.; Ruthven, I.; Jose, J.M.: How users assess Web pages for information seeking (2005) 0.19

   0.19356962 = sum of:
     0.19356962 = product of:
       0.69132006 = sum of:
         0.012713461 = weight(abstract_txt:information in 5255) [ClassicSimilarity], result of:
           0.012713461 = score(doc=5255,freq=2.0), product of:
             0.047530636 = queryWeight, product of:
               1.157699 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.01695871 = queryNorm
             0.2674793 = fieldWeight in 5255, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=5255)
         0.09749438 = weight(abstract_txt:tasks in 5255) [ClassicSimilarity], result of:
           0.09749438 = score(doc=5255,freq=5.0), product of:
             0.108092144 = queryWeight, product of:
               1.2344995 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.01695871 = queryNorm
             0.9019562 = fieldWeight in 5255, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.078125 = fieldNorm(doc=5255)
         0.0796084 = weight(abstract_txt:task in 5255) [ClassicSimilarity], result of:
           0.0796084 = score(doc=5255,freq=2.0), product of:
             0.14670923 = queryWeight, product of:
               1.7614413 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.01695871 = queryNorm
             0.5426271 = fieldWeight in 5255, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.078125 = fieldNorm(doc=5255)
         0.033446264 = weight(abstract_txt:results in 5255) [ClassicSimilarity], result of:
           0.033446264 = score(doc=5255,freq=1.0), product of:
             0.122935176 = queryWeight, product of:
               2.0816224 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.01695871 = queryNorm
             0.27206424 = fieldWeight in 5255, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.078125 = fieldNorm(doc=5255)
         0.22991286 = weight(abstract_txt:utility in 5255) [ClassicSimilarity], result of:
           0.22991286 = score(doc=5255,freq=2.0), product of:
             0.32747132 = queryWeight, product of:
               3.0387535 = boost
               6.3545527 = idf(docFreq=208, maxDocs=44218)
               0.01695871 = queryNorm
             0.7020855 = fieldWeight in 5255, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.3545527 = idf(docFreq=208, maxDocs=44218)
               0.078125 = fieldNorm(doc=5255)
         0.0620259 = weight(abstract_txt:search in 5255) [ClassicSimilarity], result of:
           0.0620259 = score(doc=5255,freq=1.0), product of:
             0.21703668 = queryWeight, product of:
               3.4985688 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.01695871 = queryNorm
             0.28578535 = fieldWeight in 5255, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=5255)
         0.1761188 = weight(abstract_txt:usefulness in 5255) [ClassicSimilarity], result of:
           0.1761188 = score(doc=5255,freq=1.0), product of:
             0.37209022 = queryWeight, product of:
               3.6214957 = boost
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.01695871 = queryNorm
             0.47332287 = fieldWeight in 5255, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.078125 = fieldNorm(doc=5255)
       0.28 = coord(7/25)
   

5. Vakkari, P.; Völske, M.; Potthast, M.; Hagen, M.; Stein, B.: Predicting essay quality from search and writing behavior (2021) 0.19

   0.18920343 = sum of:
     0.18920343 = product of:
       0.7883476 = sum of:
         0.09416636 = weight(abstract_txt:clicking in 260) [ClassicSimilarity], result of:
           0.09416636 = score(doc=260,freq=1.0), product of:
             0.16633806 = queryWeight, product of:
               1.0828658 = boost
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.01695871 = queryNorm
             0.56611437 = fieldWeight in 260, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.0625 = fieldNorm(doc=260)
         0.049328685 = weight(abstract_txt:tasks in 260) [ClassicSimilarity], result of:
           0.049328685 = score(doc=260,freq=2.0), product of:
             0.108092144 = queryWeight, product of:
               1.2344995 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.01695871 = queryNorm
             0.45635772 = fieldWeight in 260, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.0625 = fieldNorm(doc=260)
         0.034052417 = weight(abstract_txt:model in 260) [ClassicSimilarity], result of:
           0.034052417 = score(doc=260,freq=2.0), product of:
             0.0966474 = queryWeight, product of:
               1.4296659 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.01695871 = queryNorm
             0.35233662 = fieldWeight in 260, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.0625 = fieldNorm(doc=260)
         0.050499476 = weight(abstract_txt:result in 260) [ClassicSimilarity], result of:
           0.050499476 = score(doc=260,freq=1.0), product of:
             0.15835293 = queryWeight, product of:
               1.830006 = boost
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.01695871 = queryNorm
             0.3189046 = fieldWeight in 260, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.0625 = fieldNorm(doc=260)
         0.4290166 = weight(abstract_txt:writing in 260) [ClassicSimilarity], result of:
           0.4290166 = score(doc=260,freq=10.0), product of:
             0.33681944 = queryWeight, product of:
               3.081821 = boost
               6.444614 = idf(docFreq=190, maxDocs=44218)
               0.01695871 = queryNorm
             1.2737287 = fieldWeight in 260, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               6.444614 = idf(docFreq=190, maxDocs=44218)
               0.0625 = fieldNorm(doc=260)
         0.13128409 = weight(abstract_txt:search in 260) [ClassicSimilarity], result of:
           0.13128409 = score(doc=260,freq=7.0), product of:
             0.21703668 = queryWeight, product of:
               3.4985688 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.01695871 = queryNorm
             0.60489357 = fieldWeight in 260, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=260)
       0.24 = coord(6/25)