Document (#30171)

Author
Ruthven, T.
Lalmas, M.
Rijsbergen, K.van
Title
Incorporating user research behavior into relevance feedback
Source
Journal of the American Society for Information Science and technology. 54(2003) no.6, S.528-548
Year
2003
Abstract
Ruthven, Mounia, and van Rijsbergen rank and select terms for query expansion using information gathered on searcher evaluation behavior. Using the TREC Financial Times and Los Angeles Times collections and search topics from TREC-6 placed in simulated work situations, six student subjects each preformed three searches on an experimental system and three on a control system with instructions to search by natural language expression in any way they found comfortable. Searching was analyzed for behavior differences between experimental and control situations, and for effectiveness and perceptions. In three experiments paired t-tests were the analysis tool with controls being a no relevance feedback system, a standard ranking for automatic expansion system, and a standard ranking for interactive expansion while the experimental systems based ranking upon user information on temporal relevance and partial relevance. Two further experiments compare using user behavior (number assessed relevant and similarity of relevant documents) to choose a query expansion technique against a non-selective technique and finally the effect of providing the user with knowledge of the process. When partial relevance data and time of assessment data are incorporated in term ranking more relevant documents were recovered in fewer iterations, however retrieval effectiveness overall was not improved. The subjects, none-the-less, rated the suggested terms as more useful and used them more heavily. Explanations of what the feedback techniques were doing led to higher use of the techniques.
Theme
Retrievalalgorithmen

Similar documents (author)

  1. Ruthven, I.; Lalmas, M.; Rijsbergen, K. van: Combining and selecting characteristics of information use (2002) 5.44
    5.4367194 = sum of:
      5.4367194 = sum of:
        1.7798518 = weight(author_txt:ruthven in 209) [ClassicSimilarity], result of:
          1.7798518 = score(doc=209,freq=1.0), product of:
            0.5704325 = queryWeight, product of:
              8.320479 = idf(docFreq=27, maxDocs=42306)
              0.06855765 = queryNorm
            3.1201797 = fieldWeight in 209, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.320479 = idf(docFreq=27, maxDocs=42306)
              0.375 = fieldNorm(doc=209)
        1.8032931 = weight(author_txt:rijsbergen in 209) [ClassicSimilarity], result of:
          1.8032931 = score(doc=209,freq=1.0), product of:
            0.5754301 = queryWeight, product of:
              1.0043709 = boost
              8.356848 = idf(docFreq=26, maxDocs=42306)
              0.06855765 = queryNorm
            3.133818 = fieldWeight in 209, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.356848 = idf(docFreq=26, maxDocs=42306)
              0.375 = fieldNorm(doc=209)
        1.8535746 = weight(author_txt:lalmas in 209) [ClassicSimilarity], result of:
          1.8535746 = score(doc=209,freq=1.0), product of:
            0.5860775 = queryWeight, product of:
              1.0136205 = boost
              8.433808 = idf(docFreq=24, maxDocs=42306)
              0.06855765 = queryNorm
            3.1626782 = fieldWeight in 209, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.433808 = idf(docFreq=24, maxDocs=42306)
              0.375 = fieldNorm(doc=209)
    
  2. Lalmas, M.; Ruthven, I.: ¬A model for structured document retrieval : empirical investigations (1997) 3.23
    3.2297122 = sum of:
      3.2297122 = product of:
        4.8445683 = sum of:
          2.3731358 = weight(author_txt:ruthven in 1728) [ClassicSimilarity], result of:
            2.3731358 = score(doc=1728,freq=1.0), product of:
              0.5704325 = queryWeight, product of:
                8.320479 = idf(docFreq=27, maxDocs=42306)
                0.06855765 = queryNorm
              4.1602397 = fieldWeight in 1728, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.320479 = idf(docFreq=27, maxDocs=42306)
                0.5 = fieldNorm(doc=1728)
          2.4714327 = weight(author_txt:lalmas in 1728) [ClassicSimilarity], result of:
            2.4714327 = score(doc=1728,freq=1.0), product of:
              0.5860775 = queryWeight, product of:
                1.0136205 = boost
                8.433808 = idf(docFreq=24, maxDocs=42306)
                0.06855765 = queryNorm
              4.216904 = fieldWeight in 1728, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.433808 = idf(docFreq=24, maxDocs=42306)
                0.5 = fieldNorm(doc=1728)
        0.6666667 = coord(2/3)
    
  3. Lalmas, M.; Ruthven, I.: Representing and retrieving structured documents using the Dempster-Shafer theory of evidence : modelling and evaluation (1998) 3.23
    3.2297122 = sum of:
      3.2297122 = product of:
        4.8445683 = sum of:
          2.3731358 = weight(author_txt:ruthven in 2077) [ClassicSimilarity], result of:
            2.3731358 = score(doc=2077,freq=1.0), product of:
              0.5704325 = queryWeight, product of:
                8.320479 = idf(docFreq=27, maxDocs=42306)
                0.06855765 = queryNorm
              4.1602397 = fieldWeight in 2077, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.320479 = idf(docFreq=27, maxDocs=42306)
                0.5 = fieldNorm(doc=2077)
          2.4714327 = weight(author_txt:lalmas in 2077) [ClassicSimilarity], result of:
            2.4714327 = score(doc=2077,freq=1.0), product of:
              0.5860775 = queryWeight, product of:
                1.0136205 = boost
                8.433808 = idf(docFreq=24, maxDocs=42306)
                0.06855765 = queryNorm
              4.216904 = fieldWeight in 2077, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.433808 = idf(docFreq=24, maxDocs=42306)
                0.5 = fieldNorm(doc=2077)
        0.6666667 = coord(2/3)
    
  4. Ruthven, I.; Lalmas, M.: Selective relevance feedback using term characteristics (1999) 3.23
    3.2297122 = sum of:
      3.2297122 = product of:
        4.8445683 = sum of:
          2.3731358 = weight(author_txt:ruthven in 4825) [ClassicSimilarity], result of:
            2.3731358 = score(doc=4825,freq=1.0), product of:
              0.5704325 = queryWeight, product of:
                8.320479 = idf(docFreq=27, maxDocs=42306)
                0.06855765 = queryNorm
              4.1602397 = fieldWeight in 4825, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.320479 = idf(docFreq=27, maxDocs=42306)
                0.5 = fieldNorm(doc=4825)
          2.4714327 = weight(author_txt:lalmas in 4825) [ClassicSimilarity], result of:
            2.4714327 = score(doc=4825,freq=1.0), product of:
              0.5860775 = queryWeight, product of:
                1.0136205 = boost
                8.433808 = idf(docFreq=24, maxDocs=42306)
                0.06855765 = queryNorm
              4.216904 = fieldWeight in 4825, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.433808 = idf(docFreq=24, maxDocs=42306)
                0.5 = fieldNorm(doc=4825)
        0.6666667 = coord(2/3)
    
  5. Rijsbergen, C.J. van; Lalmas, M.: Information calculus for information retrieval (1996) 2.84
    2.8442307 = sum of:
      2.8442307 = product of:
        4.266346 = sum of:
          2.103842 = weight(author_txt:rijsbergen in 4270) [ClassicSimilarity], result of:
            2.103842 = score(doc=4270,freq=1.0), product of:
              0.5754301 = queryWeight, product of:
                1.0043709 = boost
                8.356848 = idf(docFreq=26, maxDocs=42306)
                0.06855765 = queryNorm
              3.6561208 = fieldWeight in 4270, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.356848 = idf(docFreq=26, maxDocs=42306)
                0.4375 = fieldNorm(doc=4270)
          2.1625037 = weight(author_txt:lalmas in 4270) [ClassicSimilarity], result of:
            2.1625037 = score(doc=4270,freq=1.0), product of:
              0.5860775 = queryWeight, product of:
                1.0136205 = boost
                8.433808 = idf(docFreq=24, maxDocs=42306)
                0.06855765 = queryNorm
              3.6897912 = fieldWeight in 4270, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.433808 = idf(docFreq=24, maxDocs=42306)
                0.4375 = fieldNorm(doc=4270)
        0.6666667 = coord(2/3)
    

Similar documents (content)

  1. Vakkari, P.; Sormunen, E.: ¬The influence of relevance levels an the effectiveness of interactive information retrieval (2004) 0.65
    0.64878637 = sum of:
      0.64878637 = product of:
        1.3516383 = sum of:
          0.071782365 = weight(abstract_txt:query in 3885) [ClassicSimilarity], result of:
            0.071782365 = score(doc=3885,freq=3.0), product of:
              0.11205723 = queryWeight, product of:
                1.0027062 = boost
                4.733989 = idf(docFreq=1010, maxDocs=42306)
                0.0236069 = queryNorm
              0.6405866 = fieldWeight in 3885, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.733989 = idf(docFreq=1010, maxDocs=42306)
                0.078125 = fieldNorm(doc=3885)
          0.052441414 = weight(abstract_txt:effectiveness in 3885) [ClassicSimilarity], result of:
            0.052441414 = score(doc=3885,freq=1.0), product of:
              0.13109457 = queryWeight, product of:
                1.0845413 = boost
                5.12035 = idf(docFreq=686, maxDocs=42306)
                0.0236069 = queryNorm
              0.40002733 = fieldWeight in 3885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.12035 = idf(docFreq=686, maxDocs=42306)
                0.078125 = fieldNorm(doc=3885)
          0.024838759 = weight(abstract_txt:using in 3885) [ClassicSimilarity], result of:
            0.024838759 = score(doc=3885,freq=1.0), product of:
              0.091184035 = queryWeight, product of:
                1.1077935 = boost
                3.486752 = idf(docFreq=3518, maxDocs=42306)
                0.0236069 = queryNorm
              0.2724025 = fieldWeight in 3885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.486752 = idf(docFreq=3518, maxDocs=42306)
                0.078125 = fieldNorm(doc=3885)
          0.08565809 = weight(abstract_txt:experiments in 3885) [ClassicSimilarity], result of:
            0.08565809 = score(doc=3885,freq=2.0), product of:
              0.14431253 = queryWeight, product of:
                1.1379044 = boost
                5.372288 = idf(docFreq=533, maxDocs=42306)
                0.0236069 = queryNorm
              0.5935596 = fieldWeight in 3885, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.372288 = idf(docFreq=533, maxDocs=42306)
                0.078125 = fieldNorm(doc=3885)
          0.062409427 = weight(abstract_txt:subjects in 3885) [ClassicSimilarity], result of:
            0.062409427 = score(doc=3885,freq=1.0), product of:
              0.1472206 = queryWeight, product of:
                1.1493123 = boost
                5.4261475 = idf(docFreq=505, maxDocs=42306)
                0.0236069 = queryNorm
              0.42391777 = fieldWeight in 3885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4261475 = idf(docFreq=505, maxDocs=42306)
                0.078125 = fieldNorm(doc=3885)
          0.029724592 = weight(abstract_txt:were in 3885) [ClassicSimilarity], result of:
            0.029724592 = score(doc=3885,freq=1.0), product of:
              0.1027802 = queryWeight, product of:
                1.1761267 = boost
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.0236069 = queryNorm
              0.28920543 = fieldWeight in 3885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.078125 = fieldNorm(doc=3885)
          0.16437273 = weight(abstract_txt:trec in 3885) [ClassicSimilarity], result of:
            0.16437273 = score(doc=3885,freq=2.0), product of:
              0.22284949 = queryWeight, product of:
                1.414033 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.0236069 = queryNorm
              0.73759526 = fieldWeight in 3885, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.078125 = fieldNorm(doc=3885)
          0.10286407 = weight(abstract_txt:relevant in 3885) [ClassicSimilarity], result of:
            0.10286407 = score(doc=3885,freq=3.0), product of:
              0.16304255 = queryWeight, product of:
                1.4813232 = boost
                4.662428 = idf(docFreq=1085, maxDocs=42306)
                0.0236069 = queryNorm
              0.63090324 = fieldWeight in 3885, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.662428 = idf(docFreq=1085, maxDocs=42306)
                0.078125 = fieldNorm(doc=3885)
          0.038898975 = weight(abstract_txt:user in 3885) [ClassicSimilarity], result of:
            0.038898975 = score(doc=3885,freq=1.0), product of:
              0.13534345 = queryWeight, product of:
                1.5584302 = boost
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.0236069 = queryNorm
              0.28740937 = fieldWeight in 3885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.078125 = fieldNorm(doc=3885)
          0.17416586 = weight(abstract_txt:feedback in 3885) [ClassicSimilarity], result of:
            0.17416586 = score(doc=3885,freq=2.0), product of:
              0.2651333 = queryWeight, product of:
                1.888998 = boost
                5.945574 = idf(docFreq=300, maxDocs=42306)
                0.0236069 = queryNorm
              0.6568993 = fieldWeight in 3885, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.945574 = idf(docFreq=300, maxDocs=42306)
                0.078125 = fieldNorm(doc=3885)
          0.308882 = weight(abstract_txt:expansion in 3885) [ClassicSimilarity], result of:
            0.308882 = score(doc=3885,freq=3.0), product of:
              0.3735079 = queryWeight, product of:
                2.58892 = boost
                6.1114206 = idf(docFreq=254, maxDocs=42306)
                0.0236069 = queryNorm
              0.8269758 = fieldWeight in 3885, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.1114206 = idf(docFreq=254, maxDocs=42306)
                0.078125 = fieldNorm(doc=3885)
          0.23559996 = weight(abstract_txt:relevance in 3885) [ClassicSimilarity], result of:
            0.23559996 = score(doc=3885,freq=4.0), product of:
              0.3051724 = queryWeight, product of:
                2.6163533 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0236069 = queryNorm
              0.7720225 = fieldWeight in 3885, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.078125 = fieldNorm(doc=3885)
        0.48 = coord(12/25)
    
  2. Efthimiadis, E.N.: Interactive query expansion : a user-based evaluation in a relevance feedback environment (2000) 0.52
    0.5212697 = sum of:
      0.5212697 = product of:
        1.0859785 = sum of:
          0.11961335 = weight(abstract_txt:query in 702) [ClassicSimilarity], result of:
            0.11961335 = score(doc=702,freq=17.0), product of:
              0.11205723 = queryWeight, product of:
                1.0027062 = boost
                4.733989 = idf(docFreq=1010, maxDocs=42306)
                0.0236069 = queryNorm
              1.0674309 = fieldWeight in 702, product of:
                4.1231055 = tf(freq=17.0), with freq of:
                  17.0 = termFreq=17.0
                4.733989 = idf(docFreq=1010, maxDocs=42306)
                0.0546875 = fieldNorm(doc=702)
          0.05191435 = weight(abstract_txt:effectiveness in 702) [ClassicSimilarity], result of:
            0.05191435 = score(doc=702,freq=2.0), product of:
              0.13109457 = queryWeight, product of:
                1.0845413 = boost
                5.12035 = idf(docFreq=686, maxDocs=42306)
                0.0236069 = queryNorm
              0.39600685 = fieldWeight in 702, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.12035 = idf(docFreq=686, maxDocs=42306)
                0.0546875 = fieldNorm(doc=702)
          0.016671143 = weight(abstract_txt:more in 702) [ClassicSimilarity], result of:
            0.016671143 = score(doc=702,freq=1.0), product of:
              0.08866327 = queryWeight, product of:
                1.0923737 = boost
                3.438219 = idf(docFreq=3693, maxDocs=42306)
                0.0236069 = queryNorm
              0.1880276 = fieldWeight in 702, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.438219 = idf(docFreq=3693, maxDocs=42306)
                0.0546875 = fieldNorm(doc=702)
          0.017387131 = weight(abstract_txt:using in 702) [ClassicSimilarity], result of:
            0.017387131 = score(doc=702,freq=1.0), product of:
              0.091184035 = queryWeight, product of:
                1.1077935 = boost
                3.486752 = idf(docFreq=3518, maxDocs=42306)
                0.0236069 = queryNorm
              0.19068176 = fieldWeight in 702, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.486752 = idf(docFreq=3518, maxDocs=42306)
                0.0546875 = fieldNorm(doc=702)
          0.046526343 = weight(abstract_txt:were in 702) [ClassicSimilarity], result of:
            0.046526343 = score(doc=702,freq=5.0), product of:
              0.1027802 = queryWeight, product of:
                1.1761267 = boost
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.0236069 = queryNorm
              0.45267808 = fieldWeight in 702, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.0546875 = fieldNorm(doc=702)
          0.036605086 = weight(abstract_txt:three in 702) [ClassicSimilarity], result of:
            0.036605086 = score(doc=702,freq=1.0), product of:
              0.14978252 = queryWeight, product of:
                1.4198091 = boost
                4.4688134 = idf(docFreq=1317, maxDocs=42306)
                0.0236069 = queryNorm
              0.24438824 = fieldWeight in 702, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4688134 = idf(docFreq=1317, maxDocs=42306)
                0.0546875 = fieldNorm(doc=702)
          0.020836346 = weight(abstract_txt:system in 702) [ClassicSimilarity], result of:
            0.020836346 = score(doc=702,freq=1.0), product of:
              0.11322981 = queryWeight, product of:
                1.4254407 = boost
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.0236069 = queryNorm
              0.1840182 = fieldWeight in 702, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.0546875 = fieldNorm(doc=702)
          0.058791712 = weight(abstract_txt:relevant in 702) [ClassicSimilarity], result of:
            0.058791712 = score(doc=702,freq=2.0), product of:
              0.16304255 = queryWeight, product of:
                1.4813232 = boost
                4.662428 = idf(docFreq=1085, maxDocs=42306)
                0.0236069 = queryNorm
              0.36059123 = fieldWeight in 702, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.662428 = idf(docFreq=1085, maxDocs=42306)
                0.0546875 = fieldNorm(doc=702)
          0.03850802 = weight(abstract_txt:user in 702) [ClassicSimilarity], result of:
            0.03850802 = score(doc=702,freq=2.0), product of:
              0.13534345 = queryWeight, product of:
                1.5584302 = boost
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.0236069 = queryNorm
              0.28452075 = fieldWeight in 702, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.0546875 = fieldNorm(doc=702)
          0.08620771 = weight(abstract_txt:feedback in 702) [ClassicSimilarity], result of:
            0.08620771 = score(doc=702,freq=1.0), product of:
              0.2651333 = queryWeight, product of:
                1.888998 = boost
                5.945574 = idf(docFreq=300, maxDocs=42306)
                0.0236069 = queryNorm
              0.32514858 = fieldWeight in 702, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.945574 = idf(docFreq=300, maxDocs=42306)
                0.0546875 = fieldNorm(doc=702)
          0.45009243 = weight(abstract_txt:expansion in 702) [ClassicSimilarity], result of:
            0.45009243 = score(doc=702,freq=13.0), product of:
              0.3735079 = queryWeight, product of:
                2.58892 = boost
                6.1114206 = idf(docFreq=254, maxDocs=42306)
                0.0236069 = queryNorm
              1.2050413 = fieldWeight in 702, product of:
                3.6055512 = tf(freq=13.0), with freq of:
                  13.0 = termFreq=13.0
                6.1114206 = idf(docFreq=254, maxDocs=42306)
                0.0546875 = fieldNorm(doc=702)
          0.14282487 = weight(abstract_txt:relevance in 702) [ClassicSimilarity], result of:
            0.14282487 = score(doc=702,freq=3.0), product of:
              0.3051724 = queryWeight, product of:
                2.6163533 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0236069 = queryNorm
              0.46801373 = fieldWeight in 702, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0546875 = fieldNorm(doc=702)
        0.48 = coord(12/25)
    
  3. Robertson, S.E.: OKAPI at TREC-3 (1995) 0.49
    0.49307284 = sum of:
      0.49307284 = product of:
        1.2326821 = sum of:
          0.049732283 = weight(abstract_txt:query in 695) [ClassicSimilarity], result of:
            0.049732283 = score(doc=695,freq=1.0), product of:
              0.11205723 = queryWeight, product of:
                1.0027062 = boost
                4.733989 = idf(docFreq=1010, maxDocs=42306)
                0.0236069 = queryNorm
              0.44381145 = fieldWeight in 695, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.733989 = idf(docFreq=1010, maxDocs=42306)
                0.09375 = fieldNorm(doc=695)
          0.029806513 = weight(abstract_txt:using in 695) [ClassicSimilarity], result of:
            0.029806513 = score(doc=695,freq=1.0), product of:
              0.091184035 = queryWeight, product of:
                1.1077935 = boost
                3.486752 = idf(docFreq=3518, maxDocs=42306)
                0.0236069 = queryNorm
              0.32688302 = fieldWeight in 695, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.486752 = idf(docFreq=3518, maxDocs=42306)
                0.09375 = fieldNorm(doc=695)
          0.0726833 = weight(abstract_txt:experiments in 695) [ClassicSimilarity], result of:
            0.0726833 = score(doc=695,freq=1.0), product of:
              0.14431253 = queryWeight, product of:
                1.1379044 = boost
                5.372288 = idf(docFreq=533, maxDocs=42306)
                0.0236069 = queryNorm
              0.50365204 = fieldWeight in 695, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.372288 = idf(docFreq=533, maxDocs=42306)
                0.09375 = fieldNorm(doc=695)
          0.24157758 = weight(abstract_txt:trec in 695) [ClassicSimilarity], result of:
            0.24157758 = score(doc=695,freq=3.0), product of:
              0.22284949 = queryWeight, product of:
                1.414033 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.0236069 = queryNorm
              1.0840392 = fieldWeight in 695, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.09375 = fieldNorm(doc=695)
          0.03571945 = weight(abstract_txt:system in 695) [ClassicSimilarity], result of:
            0.03571945 = score(doc=695,freq=1.0), product of:
              0.11322981 = queryWeight, product of:
                1.4254407 = boost
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.0236069 = queryNorm
              0.31545976 = fieldWeight in 695, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.09375 = fieldNorm(doc=695)
          0.04667877 = weight(abstract_txt:user in 695) [ClassicSimilarity], result of:
            0.04667877 = score(doc=695,freq=1.0), product of:
              0.13534345 = queryWeight, product of:
                1.5584302 = boost
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.0236069 = queryNorm
              0.34489125 = fieldWeight in 695, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.09375 = fieldNorm(doc=695)
          0.14778465 = weight(abstract_txt:feedback in 695) [ClassicSimilarity], result of:
            0.14778465 = score(doc=695,freq=1.0), product of:
              0.2651333 = queryWeight, product of:
                1.888998 = boost
                5.945574 = idf(docFreq=300, maxDocs=42306)
                0.0236069 = queryNorm
              0.55739754 = fieldWeight in 695, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.945574 = idf(docFreq=300, maxDocs=42306)
                0.09375 = fieldNorm(doc=695)
          0.16469833 = weight(abstract_txt:ranking in 695) [ClassicSimilarity], result of:
            0.16469833 = score(doc=695,freq=1.0), product of:
              0.3136778 = queryWeight, product of:
                2.372524 = boost
                5.600595 = idf(docFreq=424, maxDocs=42306)
                0.0236069 = queryNorm
              0.52505577 = fieldWeight in 695, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.600595 = idf(docFreq=424, maxDocs=42306)
                0.09375 = fieldNorm(doc=695)
          0.30264133 = weight(abstract_txt:expansion in 695) [ClassicSimilarity], result of:
            0.30264133 = score(doc=695,freq=2.0), product of:
              0.3735079 = queryWeight, product of:
                2.58892 = boost
                6.1114206 = idf(docFreq=254, maxDocs=42306)
                0.0236069 = queryNorm
              0.81026757 = fieldWeight in 695, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.1114206 = idf(docFreq=254, maxDocs=42306)
                0.09375 = fieldNorm(doc=695)
          0.14135997 = weight(abstract_txt:relevance in 695) [ClassicSimilarity], result of:
            0.14135997 = score(doc=695,freq=1.0), product of:
              0.3051724 = queryWeight, product of:
                2.6163533 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0236069 = queryNorm
              0.46321347 = fieldWeight in 695, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.09375 = fieldNorm(doc=695)
        0.4 = coord(10/25)
    
  4. Xu, B.; Lin, H.; Lin, Y.: Assessment of learning to rank methods for query expansion (2016) 0.44
    0.43932128 = sum of:
      0.43932128 = product of:
        1.0983032 = sum of:
          0.046888042 = weight(abstract_txt:query in 4930) [ClassicSimilarity], result of:
            0.046888042 = score(doc=4930,freq=2.0), product of:
              0.11205723 = queryWeight, product of:
                1.0027062 = boost
                4.733989 = idf(docFreq=1010, maxDocs=42306)
                0.0236069 = queryNorm
              0.41842943 = fieldWeight in 4930, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.733989 = idf(docFreq=1010, maxDocs=42306)
                0.0625 = fieldNorm(doc=4930)
          0.019871008 = weight(abstract_txt:using in 4930) [ClassicSimilarity], result of:
            0.019871008 = score(doc=4930,freq=1.0), product of:
              0.091184035 = queryWeight, product of:
                1.1077935 = boost
                3.486752 = idf(docFreq=3518, maxDocs=42306)
                0.0236069 = queryNorm
              0.217922 = fieldWeight in 4930, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.486752 = idf(docFreq=3518, maxDocs=42306)
                0.0625 = fieldNorm(doc=4930)
          0.09298326 = weight(abstract_txt:trec in 4930) [ClassicSimilarity], result of:
            0.09298326 = score(doc=4930,freq=1.0), product of:
              0.22284949 = queryWeight, product of:
                1.414033 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.0236069 = queryNorm
              0.4172469 = fieldWeight in 4930, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.0625 = fieldNorm(doc=4930)
          0.041834384 = weight(abstract_txt:three in 4930) [ClassicSimilarity], result of:
            0.041834384 = score(doc=4930,freq=1.0), product of:
              0.14978252 = queryWeight, product of:
                1.4198091 = boost
                4.4688134 = idf(docFreq=1317, maxDocs=42306)
                0.0236069 = queryNorm
              0.27930084 = fieldWeight in 4930, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4688134 = idf(docFreq=1317, maxDocs=42306)
                0.0625 = fieldNorm(doc=4930)
          0.04751088 = weight(abstract_txt:relevant in 4930) [ClassicSimilarity], result of:
            0.04751088 = score(doc=4930,freq=1.0), product of:
              0.16304255 = queryWeight, product of:
                1.4813232 = boost
                4.662428 = idf(docFreq=1085, maxDocs=42306)
                0.0236069 = queryNorm
              0.29140174 = fieldWeight in 4930, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.662428 = idf(docFreq=1085, maxDocs=42306)
                0.0625 = fieldNorm(doc=4930)
          0.074728094 = weight(abstract_txt:experimental in 4930) [ClassicSimilarity], result of:
            0.074728094 = score(doc=4930,freq=1.0), product of:
              0.22050993 = queryWeight, product of:
                1.722715 = boost
                5.4222026 = idf(docFreq=507, maxDocs=42306)
                0.0236069 = queryNorm
              0.33888766 = fieldWeight in 4930, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4222026 = idf(docFreq=507, maxDocs=42306)
                0.0625 = fieldNorm(doc=4930)
          0.17064701 = weight(abstract_txt:feedback in 4930) [ClassicSimilarity], result of:
            0.17064701 = score(doc=4930,freq=3.0), product of:
              0.2651333 = queryWeight, product of:
                1.888998 = boost
                5.945574 = idf(docFreq=300, maxDocs=42306)
                0.0236069 = queryNorm
              0.6436272 = fieldWeight in 4930, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.945574 = idf(docFreq=300, maxDocs=42306)
                0.0625 = fieldNorm(doc=4930)
          0.15527909 = weight(abstract_txt:ranking in 4930) [ClassicSimilarity], result of:
            0.15527909 = score(doc=4930,freq=2.0), product of:
              0.3136778 = queryWeight, product of:
                2.372524 = boost
                5.600595 = idf(docFreq=424, maxDocs=42306)
                0.0236069 = queryNorm
              0.49502733 = fieldWeight in 4930, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.600595 = idf(docFreq=424, maxDocs=42306)
                0.0625 = fieldNorm(doc=4930)
          0.28533298 = weight(abstract_txt:expansion in 4930) [ClassicSimilarity], result of:
            0.28533298 = score(doc=4930,freq=4.0), product of:
              0.3735079 = queryWeight, product of:
                2.58892 = boost
                6.1114206 = idf(docFreq=254, maxDocs=42306)
                0.0236069 = queryNorm
              0.7639276 = fieldWeight in 4930, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.1114206 = idf(docFreq=254, maxDocs=42306)
                0.0625 = fieldNorm(doc=4930)
          0.16322844 = weight(abstract_txt:relevance in 4930) [ClassicSimilarity], result of:
            0.16322844 = score(doc=4930,freq=3.0), product of:
              0.3051724 = queryWeight, product of:
                2.6163533 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0236069 = queryNorm
              0.53487283 = fieldWeight in 4930, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0625 = fieldNorm(doc=4930)
        0.4 = coord(10/25)
    
  5. Robertson, S.E.; Walker, S.; Hancock-Beaulieu, M.M.: Large test collection experiments of an operational, interactive system : OKAPI at TREC (1995) 0.40
    0.39554623 = sum of:
      0.39554623 = product of:
        1.0987395 = sum of:
          0.07033207 = weight(abstract_txt:query in 34) [ClassicSimilarity], result of:
            0.07033207 = score(doc=34,freq=2.0), product of:
              0.11205723 = queryWeight, product of:
                1.0027062 = boost
                4.733989 = idf(docFreq=1010, maxDocs=42306)
                0.0236069 = queryNorm
              0.6276442 = fieldWeight in 34, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.733989 = idf(docFreq=1010, maxDocs=42306)
                0.09375 = fieldNorm(doc=34)
          0.028579103 = weight(abstract_txt:more in 34) [ClassicSimilarity], result of:
            0.028579103 = score(doc=34,freq=1.0), product of:
              0.08866327 = queryWeight, product of:
                1.0923737 = boost
                3.438219 = idf(docFreq=3693, maxDocs=42306)
                0.0236069 = queryNorm
              0.32233304 = fieldWeight in 34, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.438219 = idf(docFreq=3693, maxDocs=42306)
                0.09375 = fieldNorm(doc=34)
          0.0726833 = weight(abstract_txt:experiments in 34) [ClassicSimilarity], result of:
            0.0726833 = score(doc=34,freq=1.0), product of:
              0.14431253 = queryWeight, product of:
                1.1379044 = boost
                5.372288 = idf(docFreq=533, maxDocs=42306)
                0.0236069 = queryNorm
              0.50365204 = fieldWeight in 34, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.372288 = idf(docFreq=533, maxDocs=42306)
                0.09375 = fieldNorm(doc=34)
          0.19724727 = weight(abstract_txt:trec in 34) [ClassicSimilarity], result of:
            0.19724727 = score(doc=34,freq=2.0), product of:
              0.22284949 = queryWeight, product of:
                1.414033 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.0236069 = queryNorm
              0.8851143 = fieldWeight in 34, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.09375 = fieldNorm(doc=34)
          0.03571945 = weight(abstract_txt:system in 34) [ClassicSimilarity], result of:
            0.03571945 = score(doc=34,freq=1.0), product of:
              0.11322981 = queryWeight, product of:
                1.4254407 = boost
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.0236069 = queryNorm
              0.31545976 = fieldWeight in 34, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.09375 = fieldNorm(doc=34)
          0.07126632 = weight(abstract_txt:relevant in 34) [ClassicSimilarity], result of:
            0.07126632 = score(doc=34,freq=1.0), product of:
              0.16304255 = queryWeight, product of:
                1.4813232 = boost
                4.662428 = idf(docFreq=1085, maxDocs=42306)
                0.0236069 = queryNorm
              0.43710262 = fieldWeight in 34, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.662428 = idf(docFreq=1085, maxDocs=42306)
                0.09375 = fieldNorm(doc=34)
          0.20899905 = weight(abstract_txt:feedback in 34) [ClassicSimilarity], result of:
            0.20899905 = score(doc=34,freq=2.0), product of:
              0.2651333 = queryWeight, product of:
                1.888998 = boost
                5.945574 = idf(docFreq=300, maxDocs=42306)
                0.0236069 = queryNorm
              0.7882792 = fieldWeight in 34, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.945574 = idf(docFreq=300, maxDocs=42306)
                0.09375 = fieldNorm(doc=34)
          0.21399975 = weight(abstract_txt:expansion in 34) [ClassicSimilarity], result of:
            0.21399975 = score(doc=34,freq=1.0), product of:
              0.3735079 = queryWeight, product of:
                2.58892 = boost
                6.1114206 = idf(docFreq=254, maxDocs=42306)
                0.0236069 = queryNorm
              0.5729457 = fieldWeight in 34, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.1114206 = idf(docFreq=254, maxDocs=42306)
                0.09375 = fieldNorm(doc=34)
          0.19991319 = weight(abstract_txt:relevance in 34) [ClassicSimilarity], result of:
            0.19991319 = score(doc=34,freq=2.0), product of:
              0.3051724 = queryWeight, product of:
                2.6163533 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0236069 = queryNorm
              0.65508276 = fieldWeight in 34, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.09375 = fieldNorm(doc=34)
        0.36 = coord(9/25)