Document (#39589)

Author
Ravana, S.D.
Taheri, M.S.
Rajagopal, P.
Title
Document-based approach to improve the accuracy of pairwise comparison in evaluating information retrieval systems
Source
Aslib journal of information management. 67(2015) no.4, S.408-421
Year
2015
Abstract
Purpose The purpose of this paper is to propose a method to have more accurate results in comparing performance of the paired information retrieval (IR) systems with reference to the current method, which is based on the mean effectiveness scores of the systems across a set of identified topics/queries. Design/methodology/approach Based on the proposed approach, instead of the classic method of using a set of topic scores, the documents level scores are considered as the evaluation unit. These document scores are the defined document's weight, which play the role of the mean average precision (MAP) score of the systems as a significance test's statics. The experiments were conducted using the TREC 9 Web track collection. Findings The p-values generated through the two types of significance tests, namely the Student's t-test and Mann-Whitney show that by using the document level scores as an evaluation unit, the difference between IR systems is more significant compared with utilizing topic scores. Originality/value Utilizing a suitable test collection is a primary prerequisite for IR systems comparative evaluation. However, in addition to reusable test collections, having an accurate statistical testing is a necessity for these evaluations. The findings of this study will assist IR researchers to evaluate their retrieval systems and algorithms more accurately.
Content
Vgl.: http://dx.doi.org/10.1108/AJIM-12-2014-0171.
Theme
Retrievalstudien

Similar documents (content)

  1. Ravana, S.D.; Rajagopal, P.; Balakrishnan, V.: Ranking retrieval systems using pseudo relevance judgments (2015) 0.42
    0.415803 = sum of:
      0.415803 = product of:
        0.79962116 = sum of:
          0.02690503 = weight(abstract_txt:purpose in 4056) [ClassicSimilarity], result of:
            0.02690503 = score(doc=4056,freq=1.0), product of:
              0.09608064 = queryWeight, product of:
                1.0597031 = boost
                4.480408 = idf(docFreq=1331, maxDocs=43254)
                0.02023644 = queryNorm
              0.2800255 = fieldWeight in 4056, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.480408 = idf(docFreq=1331, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.014731429 = weight(abstract_txt:based in 4056) [ClassicSimilarity], result of:
            0.014731429 = score(doc=4056,freq=1.0), product of:
              0.07361063 = queryWeight, product of:
                1.13601 = boost
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.02023644 = queryNorm
              0.20012636 = fieldWeight in 4056, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.055609863 = weight(abstract_txt:topic in 4056) [ClassicSimilarity], result of:
            0.055609863 = score(doc=4056,freq=2.0), product of:
              0.12373848 = queryWeight, product of:
                1.202593 = boost
                5.084544 = idf(docFreq=727, maxDocs=43254)
                0.02023644 = queryNorm
              0.44941446 = fieldWeight in 4056, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.084544 = idf(docFreq=727, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.026511716 = weight(abstract_txt:retrieval in 4056) [ClassicSimilarity], result of:
            0.026511716 = score(doc=4056,freq=2.0), product of:
              0.08644222 = queryWeight, product of:
                1.2310475 = boost
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.02023644 = queryNorm
              0.3066987 = fieldWeight in 4056, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.026587086 = weight(abstract_txt:using in 4056) [ClassicSimilarity], result of:
            0.026587086 = score(doc=4056,freq=2.0), product of:
              0.086605966 = queryWeight, product of:
                1.232213 = boost
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.02023644 = queryNorm
              0.30698907 = fieldWeight in 4056, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.03362115 = weight(abstract_txt:approach in 4056) [ClassicSimilarity], result of:
            0.03362115 = score(doc=4056,freq=2.0), product of:
              0.101276584 = queryWeight, product of:
                1.3324975 = boost
                3.7558525 = idf(docFreq=2748, maxDocs=43254)
                0.02023644 = queryNorm
              0.33197358 = fieldWeight in 4056, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.7558525 = idf(docFreq=2748, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.07925153 = weight(abstract_txt:mean in 4056) [ClassicSimilarity], result of:
            0.07925153 = score(doc=4056,freq=1.0), product of:
              0.1974325 = queryWeight, product of:
                1.5190623 = boost
                6.4225717 = idf(docFreq=190, maxDocs=43254)
                0.02023644 = queryNorm
              0.40141073 = fieldWeight in 4056, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.4225717 = idf(docFreq=190, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.07056098 = weight(abstract_txt:document in 4056) [ClassicSimilarity], result of:
            0.07056098 = score(doc=4056,freq=4.0), product of:
              0.1317651 = queryWeight, product of:
                1.5198897 = boost
                4.2840466 = idf(docFreq=1620, maxDocs=43254)
                0.02023644 = queryNorm
              0.53550583 = fieldWeight in 4056, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.2840466 = idf(docFreq=1620, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.04062316 = weight(abstract_txt:evaluation in 4056) [ClassicSimilarity], result of:
            0.04062316 = score(doc=4056,freq=1.0), product of:
              0.14475262 = queryWeight, product of:
                1.5930343 = boost
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.02023644 = queryNorm
              0.2806385 = fieldWeight in 4056, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.058307372 = weight(abstract_txt:method in 4056) [ClassicSimilarity], result of:
            0.058307372 = score(doc=4056,freq=2.0), product of:
              0.14618954 = queryWeight, product of:
                1.6009215 = boost
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.02023644 = queryNorm
              0.39884776 = fieldWeight in 4056, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.058045 = weight(abstract_txt:test in 4056) [ClassicSimilarity], result of:
            0.058045 = score(doc=4056,freq=1.0), product of:
              0.18363433 = queryWeight, product of:
                1.7942742 = boost
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.02023644 = queryNorm
              0.31609014 = fieldWeight in 4056, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.04164644 = weight(abstract_txt:systems in 4056) [ClassicSimilarity], result of:
            0.04164644 = score(doc=4056,freq=1.0), product of:
              0.19520377 = queryWeight, product of:
                2.8258193 = boost
                3.4135768 = idf(docFreq=3870, maxDocs=43254)
                0.02023644 = queryNorm
              0.21334855 = fieldWeight in 4056, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4135768 = idf(docFreq=3870, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.26722038 = weight(abstract_txt:scores in 4056) [ClassicSimilarity], result of:
            0.26722038 = score(doc=4056,freq=1.0), product of:
              0.6402757 = queryWeight, product of:
                4.7381673 = boost
                6.677633 = idf(docFreq=147, maxDocs=43254)
                0.02023644 = queryNorm
              0.41735205 = fieldWeight in 4056, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.677633 = idf(docFreq=147, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
        0.52 = coord(13/25)
    
  2. Keikha, M.; Crestani, F.; Carman, M.J.: Employing document dependency in blog search (2012) 0.28
    0.28095502 = sum of:
      0.28095502 = product of:
        0.8779844 = sum of:
          0.029462857 = weight(abstract_txt:based in 1452) [ClassicSimilarity], result of:
            0.029462857 = score(doc=1452,freq=4.0), product of:
              0.07361063 = queryWeight, product of:
                1.13601 = boost
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.02023644 = queryNorm
              0.40025273 = fieldWeight in 1452, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.0625 = fieldNorm(doc=1452)
          0.03932211 = weight(abstract_txt:topic in 1452) [ClassicSimilarity], result of:
            0.03932211 = score(doc=1452,freq=1.0), product of:
              0.12373848 = queryWeight, product of:
                1.202593 = boost
                5.084544 = idf(docFreq=727, maxDocs=43254)
                0.02023644 = queryNorm
              0.317784 = fieldWeight in 1452, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.084544 = idf(docFreq=727, maxDocs=43254)
                0.0625 = fieldNorm(doc=1452)
          0.018746614 = weight(abstract_txt:retrieval in 1452) [ClassicSimilarity], result of:
            0.018746614 = score(doc=1452,freq=1.0), product of:
              0.08644222 = queryWeight, product of:
                1.2310475 = boost
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.02023644 = queryNorm
              0.21686874 = fieldWeight in 1452, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.0625 = fieldNorm(doc=1452)
          0.018799908 = weight(abstract_txt:using in 1452) [ClassicSimilarity], result of:
            0.018799908 = score(doc=1452,freq=1.0), product of:
              0.086605966 = queryWeight, product of:
                1.232213 = boost
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.02023644 = queryNorm
              0.21707405 = fieldWeight in 1452, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.0625 = fieldNorm(doc=1452)
          0.023773745 = weight(abstract_txt:approach in 1452) [ClassicSimilarity], result of:
            0.023773745 = score(doc=1452,freq=1.0), product of:
              0.101276584 = queryWeight, product of:
                1.3324975 = boost
                3.7558525 = idf(docFreq=2748, maxDocs=43254)
                0.02023644 = queryNorm
              0.23474078 = fieldWeight in 1452, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7558525 = idf(docFreq=2748, maxDocs=43254)
                0.0625 = fieldNorm(doc=1452)
          0.03528049 = weight(abstract_txt:document in 1452) [ClassicSimilarity], result of:
            0.03528049 = score(doc=1452,freq=1.0), product of:
              0.1317651 = queryWeight, product of:
                1.5198897 = boost
                4.2840466 = idf(docFreq=1620, maxDocs=43254)
                0.02023644 = queryNorm
              0.26775292 = fieldWeight in 1452, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.2840466 = idf(docFreq=1620, maxDocs=43254)
                0.0625 = fieldNorm(doc=1452)
          0.058045 = weight(abstract_txt:test in 1452) [ClassicSimilarity], result of:
            0.058045 = score(doc=1452,freq=1.0), product of:
              0.18363433 = queryWeight, product of:
                1.7942742 = boost
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.02023644 = queryNorm
              0.31609014 = fieldWeight in 1452, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.0625 = fieldNorm(doc=1452)
          0.65455365 = weight(abstract_txt:scores in 1452) [ClassicSimilarity], result of:
            0.65455365 = score(doc=1452,freq=6.0), product of:
              0.6402757 = queryWeight, product of:
                4.7381673 = boost
                6.677633 = idf(docFreq=147, maxDocs=43254)
                0.02023644 = queryNorm
              1.0222996 = fieldWeight in 1452, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                6.677633 = idf(docFreq=147, maxDocs=43254)
                0.0625 = fieldNorm(doc=1452)
        0.32 = coord(8/25)
    
  3. Wan, X.; Yang, J.; Xiao, J.: Towards a unified approach to document similarity search using manifold-ranking of blocks (2008) 0.27
    0.27347532 = sum of:
      0.27347532 = product of:
        0.8546104 = sum of:
          0.0904359 = weight(abstract_txt:pairwise in 4082) [ClassicSimilarity], result of:
            0.0904359 = score(doc=4082,freq=1.0), product of:
              0.1711187 = queryWeight, product of:
                8.455969 = idf(docFreq=24, maxDocs=43254)
                0.02023644 = queryNorm
              0.52849805 = fieldWeight in 4082, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.455969 = idf(docFreq=24, maxDocs=43254)
                0.0625 = fieldNorm(doc=4082)
          0.014731429 = weight(abstract_txt:based in 4082) [ClassicSimilarity], result of:
            0.014731429 = score(doc=4082,freq=1.0), product of:
              0.07361063 = queryWeight, product of:
                1.13601 = boost
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.02023644 = queryNorm
              0.20012636 = fieldWeight in 4082, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.0625 = fieldNorm(doc=4082)
          0.03749323 = weight(abstract_txt:retrieval in 4082) [ClassicSimilarity], result of:
            0.03749323 = score(doc=4082,freq=4.0), product of:
              0.08644222 = queryWeight, product of:
                1.2310475 = boost
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.02023644 = queryNorm
              0.4337375 = fieldWeight in 4082, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.0625 = fieldNorm(doc=4082)
          0.018799908 = weight(abstract_txt:using in 4082) [ClassicSimilarity], result of:
            0.018799908 = score(doc=4082,freq=1.0), product of:
              0.086605966 = queryWeight, product of:
                1.232213 = boost
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.02023644 = queryNorm
              0.21707405 = fieldWeight in 4082, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.0625 = fieldNorm(doc=4082)
          0.041177332 = weight(abstract_txt:approach in 4082) [ClassicSimilarity], result of:
            0.041177332 = score(doc=4082,freq=3.0), product of:
              0.101276584 = queryWeight, product of:
                1.3324975 = boost
                3.7558525 = idf(docFreq=2748, maxDocs=43254)
                0.02023644 = queryNorm
              0.40658295 = fieldWeight in 4082, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.7558525 = idf(docFreq=2748, maxDocs=43254)
                0.0625 = fieldNorm(doc=4082)
          0.099788286 = weight(abstract_txt:document in 4082) [ClassicSimilarity], result of:
            0.099788286 = score(doc=4082,freq=8.0), product of:
              0.1317651 = queryWeight, product of:
                1.5198897 = boost
                4.2840466 = idf(docFreq=1620, maxDocs=43254)
                0.02023644 = queryNorm
              0.75731957 = fieldWeight in 4082, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                4.2840466 = idf(docFreq=1620, maxDocs=43254)
                0.0625 = fieldNorm(doc=4082)
          0.089345045 = weight(abstract_txt:unit in 4082) [ClassicSimilarity], result of:
            0.089345045 = score(doc=4082,freq=1.0), product of:
              0.21385884 = queryWeight, product of:
                1.5809927 = boost
                6.6844125 = idf(docFreq=146, maxDocs=43254)
                0.02023644 = queryNorm
              0.41777578 = fieldWeight in 4082, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6844125 = idf(docFreq=146, maxDocs=43254)
                0.0625 = fieldNorm(doc=4082)
          0.46283928 = weight(abstract_txt:scores in 4082) [ClassicSimilarity], result of:
            0.46283928 = score(doc=4082,freq=3.0), product of:
              0.6402757 = queryWeight, product of:
                4.7381673 = boost
                6.677633 = idf(docFreq=147, maxDocs=43254)
                0.02023644 = queryNorm
              0.72287494 = fieldWeight in 4082, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.677633 = idf(docFreq=147, maxDocs=43254)
                0.0625 = fieldNorm(doc=4082)
        0.32 = coord(8/25)
    
  4. Rajagopal, P.; Ravana, S.D.; Koh, Y.S.; Balakrishnan, V.: Evaluating the effectiveness of information retrieval systems using effort-based relevance judgment (2019) 0.27
    0.26648003 = sum of:
      0.26648003 = product of:
        0.66620004 = sum of:
          0.03804946 = weight(abstract_txt:purpose in 288) [ClassicSimilarity], result of:
            0.03804946 = score(doc=288,freq=2.0), product of:
              0.09608064 = queryWeight, product of:
                1.0597031 = boost
                4.480408 = idf(docFreq=1331, maxDocs=43254)
                0.02023644 = queryNorm
              0.39601588 = fieldWeight in 288, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.480408 = idf(docFreq=1331, maxDocs=43254)
                0.0625 = fieldNorm(doc=288)
          0.014731429 = weight(abstract_txt:based in 288) [ClassicSimilarity], result of:
            0.014731429 = score(doc=288,freq=1.0), product of:
              0.07361063 = queryWeight, product of:
                1.13601 = boost
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.02023644 = queryNorm
              0.20012636 = fieldWeight in 288, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.0625 = fieldNorm(doc=288)
          0.03247009 = weight(abstract_txt:retrieval in 288) [ClassicSimilarity], result of:
            0.03247009 = score(doc=288,freq=3.0), product of:
              0.08644222 = queryWeight, product of:
                1.2310475 = boost
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.02023644 = queryNorm
              0.37562767 = fieldWeight in 288, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.0625 = fieldNorm(doc=288)
          0.032562394 = weight(abstract_txt:using in 288) [ClassicSimilarity], result of:
            0.032562394 = score(doc=288,freq=3.0), product of:
              0.086605966 = queryWeight, product of:
                1.232213 = boost
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.02023644 = queryNorm
              0.37598327 = fieldWeight in 288, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.0625 = fieldNorm(doc=288)
          0.04754749 = weight(abstract_txt:approach in 288) [ClassicSimilarity], result of:
            0.04754749 = score(doc=288,freq=4.0), product of:
              0.101276584 = queryWeight, product of:
                1.3324975 = boost
                3.7558525 = idf(docFreq=2748, maxDocs=43254)
                0.02023644 = queryNorm
              0.46948156 = fieldWeight in 288, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.7558525 = idf(docFreq=2748, maxDocs=43254)
                0.0625 = fieldNorm(doc=288)
          0.049894143 = weight(abstract_txt:document in 288) [ClassicSimilarity], result of:
            0.049894143 = score(doc=288,freq=2.0), product of:
              0.1317651 = queryWeight, product of:
                1.5198897 = boost
                4.2840466 = idf(docFreq=1620, maxDocs=43254)
                0.02023644 = queryNorm
              0.37865978 = fieldWeight in 288, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.2840466 = idf(docFreq=1620, maxDocs=43254)
                0.0625 = fieldNorm(doc=288)
          0.07036137 = weight(abstract_txt:evaluation in 288) [ClassicSimilarity], result of:
            0.07036137 = score(doc=288,freq=3.0), product of:
              0.14475262 = queryWeight, product of:
                1.5930343 = boost
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.02023644 = queryNorm
              0.4860801 = fieldWeight in 288, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.0625 = fieldNorm(doc=288)
          0.04122954 = weight(abstract_txt:method in 288) [ClassicSimilarity], result of:
            0.04122954 = score(doc=288,freq=1.0), product of:
              0.14618954 = queryWeight, product of:
                1.6009215 = boost
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.02023644 = queryNorm
              0.28202796 = fieldWeight in 288, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.0625 = fieldNorm(doc=288)
          0.07213375 = weight(abstract_txt:systems in 288) [ClassicSimilarity], result of:
            0.07213375 = score(doc=288,freq=3.0), product of:
              0.19520377 = queryWeight, product of:
                2.8258193 = boost
                3.4135768 = idf(docFreq=3870, maxDocs=43254)
                0.02023644 = queryNorm
              0.36953053 = fieldWeight in 288, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4135768 = idf(docFreq=3870, maxDocs=43254)
                0.0625 = fieldNorm(doc=288)
          0.26722038 = weight(abstract_txt:scores in 288) [ClassicSimilarity], result of:
            0.26722038 = score(doc=288,freq=1.0), product of:
              0.6402757 = queryWeight, product of:
                4.7381673 = boost
                6.677633 = idf(docFreq=147, maxDocs=43254)
                0.02023644 = queryNorm
              0.41735205 = fieldWeight in 288, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.677633 = idf(docFreq=147, maxDocs=43254)
                0.0625 = fieldNorm(doc=288)
        0.4 = coord(10/25)
    
  5. Belbachir, F.; Boughanem, M.: Using language models to improve opinion detection (2018) 0.23
    0.23442627 = sum of:
      0.23442627 = product of:
        0.6511841 = sum of:
          0.06462144 = weight(abstract_txt:collection in 45) [ClassicSimilarity], result of:
            0.06462144 = score(doc=45,freq=6.0), product of:
              0.103659436 = queryWeight, product of:
                1.1007043 = boost
                4.653761 = idf(docFreq=1119, maxDocs=43254)
                0.02023644 = queryNorm
              0.6234014 = fieldWeight in 45, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                4.653761 = idf(docFreq=1119, maxDocs=43254)
                0.0546875 = fieldNorm(doc=45)
          0.022326132 = weight(abstract_txt:based in 45) [ClassicSimilarity], result of:
            0.022326132 = score(doc=45,freq=3.0), product of:
              0.07361063 = queryWeight, product of:
                1.13601 = boost
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.02023644 = queryNorm
              0.30330038 = fieldWeight in 45, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.0546875 = fieldNorm(doc=45)
          0.015660064 = weight(abstract_txt:more in 45) [ClassicSimilarity], result of:
            0.015660064 = score(doc=45,freq=1.0), product of:
              0.08381099 = queryWeight, product of:
                1.2121668 = boost
                3.4166815 = idf(docFreq=3858, maxDocs=43254)
                0.02023644 = queryNorm
              0.18684977 = fieldWeight in 45, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4166815 = idf(docFreq=3858, maxDocs=43254)
                0.0546875 = fieldNorm(doc=45)
          0.040179685 = weight(abstract_txt:retrieval in 45) [ClassicSimilarity], result of:
            0.040179685 = score(doc=45,freq=6.0), product of:
              0.08644222 = queryWeight, product of:
                1.2310475 = boost
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.02023644 = queryNorm
              0.46481553 = fieldWeight in 45, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.0546875 = fieldNorm(doc=45)
          0.028492095 = weight(abstract_txt:using in 45) [ClassicSimilarity], result of:
            0.028492095 = score(doc=45,freq=3.0), product of:
              0.086605966 = queryWeight, product of:
                1.232213 = boost
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.02023644 = queryNorm
              0.32898536 = fieldWeight in 45, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.0546875 = fieldNorm(doc=45)
          0.029418508 = weight(abstract_txt:approach in 45) [ClassicSimilarity], result of:
            0.029418508 = score(doc=45,freq=2.0), product of:
              0.101276584 = queryWeight, product of:
                1.3324975 = boost
                3.7558525 = idf(docFreq=2748, maxDocs=43254)
                0.02023644 = queryNorm
              0.2904769 = fieldWeight in 45, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.7558525 = idf(docFreq=2748, maxDocs=43254)
                0.0546875 = fieldNorm(doc=45)
          0.06902838 = weight(abstract_txt:document in 45) [ClassicSimilarity], result of:
            0.06902838 = score(doc=45,freq=5.0), product of:
              0.1317651 = queryWeight, product of:
                1.5198897 = boost
                4.2840466 = idf(docFreq=1620, maxDocs=43254)
                0.02023644 = queryNorm
              0.5238745 = fieldWeight in 45, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.2840466 = idf(docFreq=1620, maxDocs=43254)
                0.0546875 = fieldNorm(doc=45)
          0.050789375 = weight(abstract_txt:test in 45) [ClassicSimilarity], result of:
            0.050789375 = score(doc=45,freq=1.0), product of:
              0.18363433 = queryWeight, product of:
                1.7942742 = boost
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.02023644 = queryNorm
              0.27657887 = fieldWeight in 45, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.0546875 = fieldNorm(doc=45)
          0.33066836 = weight(abstract_txt:scores in 45) [ClassicSimilarity], result of:
            0.33066836 = score(doc=45,freq=2.0), product of:
              0.6402757 = queryWeight, product of:
                4.7381673 = boost
                6.677633 = idf(docFreq=147, maxDocs=43254)
                0.02023644 = queryNorm
              0.5164468 = fieldWeight in 45, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.677633 = idf(docFreq=147, maxDocs=43254)
                0.0546875 = fieldNorm(doc=45)
        0.36 = coord(9/25)