Document (#30047)

Author

Lin, J.
Katz, B.

Title

Building a reusable test collection for question answering

Source

Journal of the American Society for Information Science and Technology. 57(2006) no.7, S.851-861

Year

2006

Abstract

In contrast to traditional information retrieval systems, which return ranked lists of documents that users must manually browse through, a question answering system attempts to directly answer natural language questions posed by the user. Although such systems possess language-processing capabilities, they still rely on traditional document retrieval techniques to generate an initial candidate set of documents. In this article, the authors argue that document retrieval for question answering represents a task different from retrieving documents in response to more general retrospective information needs. Thus, to guide future system development, specialized question answering test collections must be constructed. They show that the current evaluation resources have major shortcomings; to remedy the situation, they have manually created a small, reusable question answering test collection for research purposes. In this article they describe their methodology for building this test collection and discuss issues they encountered regarding the notion of "answer correctness."

Theme

Retrievalalgorithmen
Sprachretrieval

Similar documents (author)

1. Katz, M.: Multimedia: the future of information delivery to homes and business (1993) 5.52

   5.516439 = sum of:
     5.516439 = weight(author_txt:katz in 6646) [ClassicSimilarity], result of:
       5.516439 = fieldWeight in 6646, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.826303 = idf(docFreq=16, maxDocs=42596)
         0.625 = fieldNorm(doc=6646)
   

2. Katz, B.: Community college reference services : a working guide for and by librarians (1992) 5.52

   5.516439 = sum of:
     5.516439 = weight(author_txt:katz in 730) [ClassicSimilarity], result of:
       5.516439 = fieldWeight in 730, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.826303 = idf(docFreq=16, maxDocs=42596)
         0.625 = fieldNorm(doc=730)
   

3. Katz, J.S.: Bibliometric standards : personal experience and lessons learned (1996) 5.52

   5.516439 = sum of:
     5.516439 = weight(author_txt:katz in 5127) [ClassicSimilarity], result of:
       5.516439 = fieldWeight in 5127, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.826303 = idf(docFreq=16, maxDocs=42596)
         0.625 = fieldNorm(doc=5127)
   

4. Katz, W.A.: Introduction to reference work (1997) 5.52

   5.516439 = sum of:
     5.516439 = weight(author_txt:katz in 2189) [ClassicSimilarity], result of:
       5.516439 = fieldWeight in 2189, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.826303 = idf(docFreq=16, maxDocs=42596)
         0.625 = fieldNorm(doc=2189)
   

5. Katz, W.A.: Introduction to reference work : Vol.1: Basic information sources; vol.2: Reference services and reference processes (1992) 5.52

   5.516439 = sum of:
     5.516439 = weight(author_txt:katz in 4365) [ClassicSimilarity], result of:
       5.516439 = fieldWeight in 4365, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.826303 = idf(docFreq=16, maxDocs=42596)
         0.625 = fieldNorm(doc=4365)
   

Similar documents (content)

1. Radev, D.; Fan, W.; Qu, H.; Wu, H.; Grewal, A.: Probabilistic question answering on the Web (2005) 0.49

   0.4948915 = sum of:
     0.4948915 = product of:
       1.031024 = sum of:
         0.013673315 = weight(abstract_txt:that in 4456) [ClassicSimilarity], result of:
           0.013673315 = score(doc=4456,freq=3.0), product of:
             0.042177945 = queryWeight, product of:
               2.3957293 = idf(docFreq=10548, maxDocs=42596)
               0.017605472 = queryNorm
             0.32418162 = fieldWeight in 4456, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3957293 = idf(docFreq=10548, maxDocs=42596)
               0.078125 = fieldNorm(doc=4456)
         0.07301215 = weight(abstract_txt:return in 4456) [ClassicSimilarity], result of:
           0.07301215 = score(doc=4456,freq=1.0), product of:
             0.12885451 = queryWeight, product of:
               1.0091285 = boost
               7.252796 = idf(docFreq=81, maxDocs=42596)
               0.017605472 = queryNorm
             0.5666247 = fieldWeight in 4456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.252796 = idf(docFreq=81, maxDocs=42596)
               0.078125 = fieldNorm(doc=4456)
         0.008385128 = weight(abstract_txt:this in 4456) [ClassicSimilarity], result of:
           0.008385128 = score(doc=4456,freq=1.0), product of:
             0.04390862 = queryWeight, product of:
               1.02031 = boost
               2.4443867 = idf(docFreq=10047, maxDocs=42596)
               0.017605472 = queryNorm
             0.19096771 = fieldWeight in 4456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4443867 = idf(docFreq=10047, maxDocs=42596)
               0.078125 = fieldNorm(doc=4456)
         0.021690553 = weight(abstract_txt:article in 4456) [ClassicSimilarity], result of:
           0.021690553 = score(doc=4456,freq=1.0), product of:
             0.07228141 = queryWeight, product of:
               1.0688702 = boost
               3.8410854 = idf(docFreq=2485, maxDocs=42596)
               0.017605472 = queryNorm
             0.3000848 = fieldWeight in 4456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8410854 = idf(docFreq=2485, maxDocs=42596)
               0.078125 = fieldNorm(doc=4456)
         0.028255723 = weight(abstract_txt:language in 4456) [ClassicSimilarity], result of:
           0.028255723 = score(doc=4456,freq=1.0), product of:
             0.0862152 = queryWeight, product of:
               1.1673566 = boost
               4.195006 = idf(docFreq=1744, maxDocs=42596)
               0.017605472 = queryNorm
             0.32773483 = fieldWeight in 4456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.195006 = idf(docFreq=1744, maxDocs=42596)
               0.078125 = fieldNorm(doc=4456)
         0.04239746 = weight(abstract_txt:document in 4456) [ClassicSimilarity], result of:
           0.04239746 = score(doc=4456,freq=2.0), product of:
             0.08968699 = queryWeight, product of:
               1.1906288 = boost
               4.2786365 = idf(docFreq=1604, maxDocs=42596)
               0.017605472 = queryNorm
             0.472727 = fieldWeight in 4456, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2786365 = idf(docFreq=1604, maxDocs=42596)
               0.078125 = fieldNorm(doc=4456)
         0.023838745 = weight(abstract_txt:retrieval in 4456) [ClassicSimilarity], result of:
           0.023838745 = score(doc=4456,freq=1.0), product of:
             0.08811819 = queryWeight, product of:
               1.4454067 = boost
               3.4628031 = idf(docFreq=3628, maxDocs=42596)
               0.017605472 = queryNorm
             0.2705315 = fieldWeight in 4456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4628031 = idf(docFreq=3628, maxDocs=42596)
               0.078125 = fieldNorm(doc=4456)
         0.07978926 = weight(abstract_txt:answer in 4456) [ClassicSimilarity], result of:
           0.07978926 = score(doc=4456,freq=1.0), product of:
             0.17224336 = queryWeight, product of:
               1.6499959 = boost
               5.9294157 = idf(docFreq=307, maxDocs=42596)
               0.017605472 = queryNorm
             0.46323562 = fieldWeight in 4456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9294157 = idf(docFreq=307, maxDocs=42596)
               0.078125 = fieldNorm(doc=4456)
         0.039963666 = weight(abstract_txt:documents in 4456) [ClassicSimilarity], result of:
           0.039963666 = score(doc=4456,freq=1.0), product of:
             0.12435221 = queryWeight, product of:
               1.7170542 = boost
               4.1135974 = idf(docFreq=1892, maxDocs=42596)
               0.017605472 = queryNorm
             0.3213748 = fieldWeight in 4456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1135974 = idf(docFreq=1892, maxDocs=42596)
               0.078125 = fieldNorm(doc=4456)
         0.05181389 = weight(abstract_txt:they in 4456) [ClassicSimilarity], result of:
           0.05181389 = score(doc=4456,freq=1.0), product of:
             0.1753034 = queryWeight, product of:
               2.6319451 = boost
               3.7832568 = idf(docFreq=2633, maxDocs=42596)
               0.017605472 = queryNorm
             0.29556695 = fieldWeight in 4456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7832568 = idf(docFreq=2633, maxDocs=42596)
               0.078125 = fieldNorm(doc=4456)
         0.23794413 = weight(abstract_txt:question in 4456) [ClassicSimilarity], result of:
           0.23794413 = score(doc=4456,freq=3.0), product of:
             0.33581683 = queryWeight, product of:
               3.6427796 = boost
               5.2362685 = idf(docFreq=615, maxDocs=42596)
               0.017605472 = queryNorm
             0.7085533 = fieldWeight in 4456, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.2362685 = idf(docFreq=615, maxDocs=42596)
               0.078125 = fieldNorm(doc=4456)
         0.41025993 = weight(abstract_txt:answering in 4456) [ClassicSimilarity], result of:
           0.41025993 = score(doc=4456,freq=2.0), product of:
             0.55274177 = queryWeight, product of:
               4.673506 = boost
               6.717873 = idf(docFreq=139, maxDocs=42596)
               0.017605472 = queryNorm
             0.74222714 = fieldWeight in 4456, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.717873 = idf(docFreq=139, maxDocs=42596)
               0.078125 = fieldNorm(doc=4456)
       0.48 = coord(12/25)
   

2. Belbachir, F.; Boughanem, M.: Using language models to improve opinion detection (2018) 0.31

   0.30805504 = sum of:
     0.30805504 = product of:
       0.7001251 = sum of:
         0.00781495 = weight(abstract_txt:that in 642) [ClassicSimilarity], result of:
           0.00781495 = score(doc=642,freq=2.0), product of:
             0.042177945 = queryWeight, product of:
               2.3957293 = idf(docFreq=10548, maxDocs=42596)
               0.017605472 = queryNorm
             0.18528523 = fieldWeight in 642, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3957293 = idf(docFreq=10548, maxDocs=42596)
               0.0546875 = fieldNorm(doc=642)
         0.008300854 = weight(abstract_txt:this in 642) [ClassicSimilarity], result of:
           0.008300854 = score(doc=642,freq=2.0), product of:
             0.04390862 = queryWeight, product of:
               1.02031 = boost
               2.4443867 = idf(docFreq=10047, maxDocs=42596)
               0.017605472 = queryNorm
             0.1890484 = fieldWeight in 642, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4443867 = idf(docFreq=10047, maxDocs=42596)
               0.0546875 = fieldNorm(doc=642)
         0.044227205 = weight(abstract_txt:language in 642) [ClassicSimilarity], result of:
           0.044227205 = score(doc=642,freq=5.0), product of:
             0.0862152 = queryWeight, product of:
               1.1673566 = boost
               4.195006 = idf(docFreq=1744, maxDocs=42596)
               0.017605472 = queryNorm
             0.5129862 = fieldWeight in 642, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.195006 = idf(docFreq=1744, maxDocs=42596)
               0.0546875 = fieldNorm(doc=642)
         0.046925392 = weight(abstract_txt:document in 642) [ClassicSimilarity], result of:
           0.046925392 = score(doc=642,freq=5.0), product of:
             0.08968699 = queryWeight, product of:
               1.1906288 = boost
               4.2786365 = idf(docFreq=1604, maxDocs=42596)
               0.017605472 = queryNorm
             0.5232129 = fieldWeight in 642, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.2786365 = idf(docFreq=1604, maxDocs=42596)
               0.0546875 = fieldNorm(doc=642)
         0.035042807 = weight(abstract_txt:must in 642) [ClassicSimilarity], result of:
           0.035042807 = score(doc=642,freq=1.0), product of:
             0.1262351 = queryWeight, product of:
               1.412543 = boost
               5.0761065 = idf(docFreq=722, maxDocs=42596)
               0.017605472 = queryNorm
             0.27759957 = fieldWeight in 642, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0761065 = idf(docFreq=722, maxDocs=42596)
               0.0546875 = fieldNorm(doc=642)
         0.040874936 = weight(abstract_txt:retrieval in 642) [ClassicSimilarity], result of:
           0.040874936 = score(doc=642,freq=6.0), product of:
             0.08811819 = queryWeight, product of:
               1.4454067 = boost
               3.4628031 = idf(docFreq=3628, maxDocs=42596)
               0.017605472 = queryNorm
             0.46386492 = fieldWeight in 642, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.4628031 = idf(docFreq=3628, maxDocs=42596)
               0.0546875 = fieldNorm(doc=642)
         0.04845337 = weight(abstract_txt:documents in 642) [ClassicSimilarity], result of:
           0.04845337 = score(doc=642,freq=3.0), product of:
             0.12435221 = queryWeight, product of:
               1.7170542 = boost
               4.1135974 = idf(docFreq=1892, maxDocs=42596)
               0.017605472 = queryNorm
             0.38964623 = fieldWeight in 642, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1135974 = idf(docFreq=1892, maxDocs=42596)
               0.0546875 = fieldNorm(doc=642)
         0.09962252 = weight(abstract_txt:collection in 642) [ClassicSimilarity], result of:
           0.09962252 = score(doc=642,freq=6.0), product of:
             0.1595876 = queryWeight, product of:
               1.9451668 = boost
               4.6600933 = idf(docFreq=1095, maxDocs=42596)
               0.017605472 = queryNorm
             0.6242497 = fieldWeight in 642, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.6600933 = idf(docFreq=1095, maxDocs=42596)
               0.0546875 = fieldNorm(doc=642)
         0.069630794 = weight(abstract_txt:test in 642) [ClassicSimilarity], result of:
           0.069630794 = score(doc=642,freq=1.0), product of:
             0.25137672 = queryWeight, product of:
               2.8189616 = boost
               5.065102 = idf(docFreq=730, maxDocs=42596)
               0.017605472 = queryNorm
             0.27699777 = fieldWeight in 642, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.065102 = idf(docFreq=730, maxDocs=42596)
               0.0546875 = fieldNorm(doc=642)
         0.09616399 = weight(abstract_txt:question in 642) [ClassicSimilarity], result of:
           0.09616399 = score(doc=642,freq=1.0), product of:
             0.33581683 = queryWeight, product of:
               3.6427796 = boost
               5.2362685 = idf(docFreq=615, maxDocs=42596)
               0.017605472 = queryNorm
             0.28635845 = fieldWeight in 642, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2362685 = idf(docFreq=615, maxDocs=42596)
               0.0546875 = fieldNorm(doc=642)
         0.20306832 = weight(abstract_txt:answering in 642) [ClassicSimilarity], result of:
           0.20306832 = score(doc=642,freq=1.0), product of:
             0.55274177 = queryWeight, product of:
               4.673506 = boost
               6.717873 = idf(docFreq=139, maxDocs=42596)
               0.017605472 = queryNorm
             0.3673837 = fieldWeight in 642, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.717873 = idf(docFreq=139, maxDocs=42596)
               0.0546875 = fieldNorm(doc=642)
       0.44 = coord(11/25)
   

3. Saint-Dizier, P.; Moens, M.-F.: Knowledge and reasoning for question answering : research perspectives (2011) 0.30

   0.30088913 = sum of:
     0.30088913 = product of:
       1.2537048 = sum of:
         0.009473151 = weight(abstract_txt:that in 3747) [ClassicSimilarity], result of:
           0.009473151 = score(doc=3747,freq=1.0), product of:
             0.042177945 = queryWeight, product of:
               2.3957293 = idf(docFreq=10548, maxDocs=42596)
               0.017605472 = queryNorm
             0.22459963 = fieldWeight in 3747, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3957293 = idf(docFreq=10548, maxDocs=42596)
               0.09375 = fieldNorm(doc=3747)
         0.010062154 = weight(abstract_txt:this in 3747) [ClassicSimilarity], result of:
           0.010062154 = score(doc=3747,freq=1.0), product of:
             0.04390862 = queryWeight, product of:
               1.02031 = boost
               2.4443867 = idf(docFreq=10047, maxDocs=42596)
               0.017605472 = queryNorm
             0.22916126 = fieldWeight in 3747, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4443867 = idf(docFreq=10047, maxDocs=42596)
               0.09375 = fieldNorm(doc=3747)
         0.03390687 = weight(abstract_txt:language in 3747) [ClassicSimilarity], result of:
           0.03390687 = score(doc=3747,freq=1.0), product of:
             0.0862152 = queryWeight, product of:
               1.1673566 = boost
               4.195006 = idf(docFreq=1744, maxDocs=42596)
               0.017605472 = queryNorm
             0.39328182 = fieldWeight in 3747, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.195006 = idf(docFreq=1744, maxDocs=42596)
               0.09375 = fieldNorm(doc=3747)
         0.13540685 = weight(abstract_txt:answer in 3747) [ClassicSimilarity], result of:
           0.13540685 = score(doc=3747,freq=2.0), product of:
             0.17224336 = queryWeight, product of:
               1.6499959 = boost
               5.9294157 = idf(docFreq=307, maxDocs=42596)
               0.017605472 = queryNorm
             0.78613687 = fieldWeight in 3747, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9294157 = idf(docFreq=307, maxDocs=42596)
               0.09375 = fieldNorm(doc=3747)
         0.3686215 = weight(abstract_txt:question in 3747) [ClassicSimilarity], result of:
           0.3686215 = score(doc=3747,freq=5.0), product of:
             0.33581683 = queryWeight, product of:
               3.6427796 = boost
               5.2362685 = idf(docFreq=615, maxDocs=42596)
               0.017605472 = queryNorm
             1.0976862 = fieldWeight in 3747, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.2362685 = idf(docFreq=615, maxDocs=42596)
               0.09375 = fieldNorm(doc=3747)
         0.6962342 = weight(abstract_txt:answering in 3747) [ClassicSimilarity], result of:
           0.6962342 = score(doc=3747,freq=4.0), product of:
             0.55274177 = queryWeight, product of:
               4.673506 = boost
               6.717873 = idf(docFreq=139, maxDocs=42596)
               0.017605472 = queryNorm
             1.2596012 = fieldWeight in 3747, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.717873 = idf(docFreq=139, maxDocs=42596)
               0.09375 = fieldNorm(doc=3747)
       0.24 = coord(6/25)
   

4. Ferret, O.; Grau, B.; Hurault-Plantet, M.; Illouz, G.; Jacquemin, C.; Monceaux, L.; Robba, I.; Vilnat, A.: How NLP can improve question answering (2002) 0.29

   0.29357916 = sum of:
     0.29357916 = product of:
       0.91743493 = sum of:
         0.007894292 = weight(abstract_txt:that in 2851) [ClassicSimilarity], result of:
           0.007894292 = score(doc=2851,freq=1.0), product of:
             0.042177945 = queryWeight, product of:
               2.3957293 = idf(docFreq=10548, maxDocs=42596)
               0.017605472 = queryNorm
             0.18716635 = fieldWeight in 2851, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3957293 = idf(docFreq=10548, maxDocs=42596)
               0.078125 = fieldNorm(doc=2851)
         0.008385128 = weight(abstract_txt:this in 2851) [ClassicSimilarity], result of:
           0.008385128 = score(doc=2851,freq=1.0), product of:
             0.04390862 = queryWeight, product of:
               1.02031 = boost
               2.4443867 = idf(docFreq=10047, maxDocs=42596)
               0.017605472 = queryNorm
             0.19096771 = fieldWeight in 2851, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4443867 = idf(docFreq=10047, maxDocs=42596)
               0.078125 = fieldNorm(doc=2851)
         0.028255723 = weight(abstract_txt:language in 2851) [ClassicSimilarity], result of:
           0.028255723 = score(doc=2851,freq=1.0), product of:
             0.0862152 = queryWeight, product of:
               1.1673566 = boost
               4.195006 = idf(docFreq=1744, maxDocs=42596)
               0.017605472 = queryNorm
             0.32773483 = fieldWeight in 2851, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.195006 = idf(docFreq=1744, maxDocs=42596)
               0.078125 = fieldNorm(doc=2851)
         0.029979534 = weight(abstract_txt:document in 2851) [ClassicSimilarity], result of:
           0.029979534 = score(doc=2851,freq=1.0), product of:
             0.08968699 = queryWeight, product of:
               1.1906288 = boost
               4.2786365 = idf(docFreq=1604, maxDocs=42596)
               0.017605472 = queryNorm
             0.33426848 = fieldWeight in 2851, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2786365 = idf(docFreq=1604, maxDocs=42596)
               0.078125 = fieldNorm(doc=2851)
         0.13819905 = weight(abstract_txt:answer in 2851) [ClassicSimilarity], result of:
           0.13819905 = score(doc=2851,freq=3.0), product of:
             0.17224336 = queryWeight, product of:
               1.6499959 = boost
               5.9294157 = idf(docFreq=307, maxDocs=42596)
               0.017605472 = queryNorm
             0.8023476 = fieldWeight in 2851, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9294157 = idf(docFreq=307, maxDocs=42596)
               0.078125 = fieldNorm(doc=2851)
         0.056517158 = weight(abstract_txt:documents in 2851) [ClassicSimilarity], result of:
           0.056517158 = score(doc=2851,freq=2.0), product of:
             0.12435221 = queryWeight, product of:
               1.7170542 = boost
               4.1135974 = idf(docFreq=1892, maxDocs=42596)
               0.017605472 = queryNorm
             0.4544926 = fieldWeight in 2851, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1135974 = idf(docFreq=1892, maxDocs=42596)
               0.078125 = fieldNorm(doc=2851)
         0.23794413 = weight(abstract_txt:question in 2851) [ClassicSimilarity], result of:
           0.23794413 = score(doc=2851,freq=3.0), product of:
             0.33581683 = queryWeight, product of:
               3.6427796 = boost
               5.2362685 = idf(docFreq=615, maxDocs=42596)
               0.017605472 = queryNorm
             0.7085533 = fieldWeight in 2851, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.2362685 = idf(docFreq=615, maxDocs=42596)
               0.078125 = fieldNorm(doc=2851)
         0.41025993 = weight(abstract_txt:answering in 2851) [ClassicSimilarity], result of:
           0.41025993 = score(doc=2851,freq=2.0), product of:
             0.55274177 = queryWeight, product of:
               4.673506 = boost
               6.717873 = idf(docFreq=139, maxDocs=42596)
               0.017605472 = queryNorm
             0.74222714 = fieldWeight in 2851, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.717873 = idf(docFreq=139, maxDocs=42596)
               0.078125 = fieldNorm(doc=2851)
       0.32 = coord(8/25)
   

5. Galitsky, B.: Can many agents answer questions better than one? (2005) 0.29

   0.29356623 = sum of:
     0.29356623 = product of:
       1.2231927 = sum of:
         0.011164214 = weight(abstract_txt:that in 4095) [ClassicSimilarity], result of:
           0.011164214 = score(doc=4095,freq=2.0), product of:
             0.042177945 = queryWeight, product of:
               2.3957293 = idf(docFreq=10548, maxDocs=42596)
               0.017605472 = queryNorm
             0.26469317 = fieldWeight in 4095, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3957293 = idf(docFreq=10548, maxDocs=42596)
               0.078125 = fieldNorm(doc=4095)
         0.028255723 = weight(abstract_txt:language in 4095) [ClassicSimilarity], result of:
           0.028255723 = score(doc=4095,freq=1.0), product of:
             0.0862152 = queryWeight, product of:
               1.1673566 = boost
               4.195006 = idf(docFreq=1744, maxDocs=42596)
               0.017605472 = queryNorm
             0.32773483 = fieldWeight in 4095, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.195006 = idf(docFreq=1744, maxDocs=42596)
               0.078125 = fieldNorm(doc=4095)
         0.023838745 = weight(abstract_txt:retrieval in 4095) [ClassicSimilarity], result of:
           0.023838745 = score(doc=4095,freq=1.0), product of:
             0.08811819 = queryWeight, product of:
               1.4454067 = boost
               3.4628031 = idf(docFreq=3628, maxDocs=42596)
               0.017605472 = queryNorm
             0.2705315 = fieldWeight in 4095, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4628031 = idf(docFreq=3628, maxDocs=42596)
               0.078125 = fieldNorm(doc=4095)
         0.11283904 = weight(abstract_txt:answer in 4095) [ClassicSimilarity], result of:
           0.11283904 = score(doc=4095,freq=2.0), product of:
             0.17224336 = queryWeight, product of:
               1.6499959 = boost
               5.9294157 = idf(docFreq=307, maxDocs=42596)
               0.017605472 = queryNorm
             0.65511405 = fieldWeight in 4095, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9294157 = idf(docFreq=307, maxDocs=42596)
               0.078125 = fieldNorm(doc=4095)
         0.33650383 = weight(abstract_txt:question in 4095) [ClassicSimilarity], result of:
           0.33650383 = score(doc=4095,freq=6.0), product of:
             0.33581683 = queryWeight, product of:
               3.6427796 = boost
               5.2362685 = idf(docFreq=615, maxDocs=42596)
               0.017605472 = queryNorm
             1.0020458 = fieldWeight in 4095, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.2362685 = idf(docFreq=615, maxDocs=42596)
               0.078125 = fieldNorm(doc=4095)
         0.7105911 = weight(abstract_txt:answering in 4095) [ClassicSimilarity], result of:
           0.7105911 = score(doc=4095,freq=6.0), product of:
             0.55274177 = queryWeight, product of:
               4.673506 = boost
               6.717873 = idf(docFreq=139, maxDocs=42596)
               0.017605472 = queryNorm
             1.2855752 = fieldWeight in 4095, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.717873 = idf(docFreq=139, maxDocs=42596)
               0.078125 = fieldNorm(doc=4095)
       0.24 = coord(6/25)