Document (#39590)

Author
Ravana, S.D.
Rajagopal, P.
Balakrishnan, V.
Title
Ranking retrieval systems using pseudo relevance judgments
Source
Aslib journal of information management. 67(2015) no.6, S.700-714
Year
2015
Abstract
Purpose In a system-based approach, replicating the web would require large test collections, and judging the relevancy of all documents per topic in creating relevance judgment through human assessors is infeasible. Due to the large amount of documents that requires judgment, there are possible errors introduced by human assessors because of disagreements. The paper aims to discuss these issues. Design/methodology/approach This study explores exponential variation and document ranking methods that generate a reliable set of relevance judgments (pseudo relevance judgments) to reduce human efforts. These methods overcome problems with large amounts of documents for judgment while avoiding human disagreement errors during the judgment process. This study utilizes two key factors: number of occurrences of each document per topic from all the system runs; and document rankings to generate the alternate methods. Findings The effectiveness of the proposed method is evaluated using the correlation coefficient of ranked systems using mean average precision scores between the original Text REtrieval Conference (TREC) relevance judgments and pseudo relevance judgments. The results suggest that the proposed document ranking method with a pool depth of 100 could be a reliable alternative to reduce human effort and disagreement errors involved in generating TREC-like relevance judgments. Originality/value Simple methods proposed in this study show improvement in the correlation coefficient in generating alternate relevance judgment without human assessors while contributing to information retrieval evaluation.
Content
Vgl.: http://dx.doi.org/10.1108/AJIM-03-2015-0046.
Theme
Retrievalalgorithmen

Similar documents (author)

  1. Balakrishnan, U.: DFG-Projekt: Coli-conc : das Mapping Tool "Cocoda" (2016) 5.80
    5.8024426 = sum of:
      5.8024426 = weight(author_txt:balakrishnan in 34) [ClassicSimilarity], result of:
        5.8024426 = fieldWeight in 34, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.283908 = idf(docFreq=10, maxDocs=43556)
          0.625 = fieldNorm(doc=34)
    
  2. Balakrishnan, U.; Voß, J.: ¬The Cocoda mapping tool (2015) 4.64
    4.641954 = sum of:
      4.641954 = weight(author_txt:balakrishnan in 491) [ClassicSimilarity], result of:
        4.641954 = fieldWeight in 491, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.283908 = idf(docFreq=10, maxDocs=43556)
          0.5 = fieldNorm(doc=491)
    
  3. Balakrishnan, U.; Krausz, A,; Voss, J.: Cocoda - ein Konkordanztool für bibliothekarische Klassifikationssysteme (2015) 3.48
    3.4814653 = sum of:
      3.4814653 = weight(author_txt:balakrishnan in 4028) [ClassicSimilarity], result of:
        3.4814653 = fieldWeight in 4028, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.283908 = idf(docFreq=10, maxDocs=43556)
          0.375 = fieldNorm(doc=4028)
    
  4. Balakrishnan, V.; Ahmadi, K.; Ravana, S.D.: Improving retrieval relevance using users' explicit feedback (2016) 3.48
    3.4814653 = sum of:
      3.4814653 = weight(author_txt:balakrishnan in 4919) [ClassicSimilarity], result of:
        3.4814653 = fieldWeight in 4919, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.283908 = idf(docFreq=10, maxDocs=43556)
          0.375 = fieldNorm(doc=4919)
    
  5. Balakrishnan, U.; Voß, J.; Soergel, D.: Towards integrated systems for KOS management, mapping, and access : Coli-conc and its collaborative computer-assisted KOS mapping tool Cocoda (2018) 3.48
    3.4814653 = sum of:
      3.4814653 = weight(author_txt:balakrishnan in 1111) [ClassicSimilarity], result of:
        3.4814653 = fieldWeight in 1111, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.283908 = idf(docFreq=10, maxDocs=43556)
          0.375 = fieldNorm(doc=1111)
    

Similar documents (content)

  1. Rajagopal, P.; Ravana, S.D.; Koh, Y.S.; Balakrishnan, V.: Evaluating the effectiveness of information retrieval systems using effort-based relevance judgment (2019) 0.46
    0.45976615 = sum of:
      0.45976615 = product of:
        1.0449231 = sum of:
          0.0113287065 = weight(abstract_txt:study in 1573) [ClassicSimilarity], result of:
            0.0113287065 = score(doc=1573,freq=1.0), product of:
              0.0526538 = queryWeight, product of:
                3.4424734 = idf(docFreq=3786, maxDocs=43556)
                0.01529534 = queryNorm
              0.21515459 = fieldWeight in 1573, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4424734 = idf(docFreq=3786, maxDocs=43556)
                0.0625 = fieldNorm(doc=1573)
          0.020116089 = weight(abstract_txt:using in 1573) [ClassicSimilarity], result of:
            0.020116089 = score(doc=1573,freq=3.0), product of:
              0.053534217 = queryWeight, product of:
                1.0083258 = boost
                3.4711347 = idf(docFreq=3679, maxDocs=43556)
                0.01529534 = queryNorm
              0.37576133 = fieldWeight in 1573, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4711347 = idf(docFreq=3679, maxDocs=43556)
                0.0625 = fieldNorm(doc=1573)
          0.020163432 = weight(abstract_txt:retrieval in 1573) [ClassicSimilarity], result of:
            0.020163432 = score(doc=1573,freq=3.0), product of:
              0.053618178 = queryWeight, product of:
                1.0091162 = boost
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.01529534 = queryNorm
              0.3760559 = fieldWeight in 1573, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.0625 = fieldNorm(doc=1573)
          0.03886025 = weight(abstract_txt:documents in 1573) [ClassicSimilarity], result of:
            0.03886025 = score(doc=1573,freq=4.0), product of:
              0.07544432 = queryWeight, product of:
                1.1970117 = boost
                4.1206813 = idf(docFreq=1921, maxDocs=43556)
                0.01529534 = queryNorm
              0.51508516 = fieldWeight in 1573, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.1206813 = idf(docFreq=1921, maxDocs=43556)
                0.0625 = fieldNorm(doc=1573)
          0.05877743 = weight(abstract_txt:generating in 1573) [ClassicSimilarity], result of:
            0.05877743 = score(doc=1573,freq=1.0), product of:
              0.13785402 = queryWeight, product of:
                1.3211412 = boost
                6.8219905 = idf(docFreq=128, maxDocs=43556)
                0.01529534 = queryNorm
              0.4263744 = fieldWeight in 1573, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.8219905 = idf(docFreq=128, maxDocs=43556)
                0.0625 = fieldNorm(doc=1573)
          0.027468683 = weight(abstract_txt:proposed in 1573) [ClassicSimilarity], result of:
            0.027468683 = score(doc=1573,freq=1.0), product of:
              0.095031604 = queryWeight, product of:
                1.3434428 = boost
                4.624766 = idf(docFreq=1160, maxDocs=43556)
                0.01529534 = queryNorm
              0.28904787 = fieldWeight in 1573, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.624766 = idf(docFreq=1160, maxDocs=43556)
                0.0625 = fieldNorm(doc=1573)
          0.041300055 = weight(abstract_txt:document in 1573) [ClassicSimilarity], result of:
            0.041300055 = score(doc=1573,freq=2.0), product of:
              0.10895474 = queryWeight, product of:
                1.6610304 = boost
                4.28854 = idf(docFreq=1624, maxDocs=43556)
                0.01529534 = queryNorm
              0.37905696 = fieldWeight in 1573, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.28854 = idf(docFreq=1624, maxDocs=43556)
                0.0625 = fieldNorm(doc=1573)
          0.058105573 = weight(abstract_txt:human in 1573) [ClassicSimilarity], result of:
            0.058105573 = score(doc=1573,freq=1.0), product of:
              0.19730194 = queryWeight, product of:
                2.7375736 = boost
                4.7120123 = idf(docFreq=1063, maxDocs=43556)
                0.01529534 = queryNorm
              0.29450077 = fieldWeight in 1573, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.7120123 = idf(docFreq=1063, maxDocs=43556)
                0.0625 = fieldNorm(doc=1573)
          0.18287316 = weight(abstract_txt:judgment in 1573) [ClassicSimilarity], result of:
            0.18287316 = score(doc=1573,freq=1.0), product of:
              0.39874238 = queryWeight, product of:
                3.552677 = boost
                7.3379974 = idf(docFreq=76, maxDocs=43556)
                0.01529534 = queryNorm
              0.45862484 = fieldWeight in 1573, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3379974 = idf(docFreq=76, maxDocs=43556)
                0.0625 = fieldNorm(doc=1573)
          0.2179051 = weight(abstract_txt:relevance in 1573) [ClassicSimilarity], result of:
            0.2179051 = score(doc=1573,freq=6.0), product of:
              0.2884653 = queryWeight, product of:
                3.8222253 = boost
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.01529534 = queryNorm
              0.7553945 = fieldWeight in 1573, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.0625 = fieldNorm(doc=1573)
          0.36802462 = weight(abstract_txt:judgments in 1573) [ClassicSimilarity], result of:
            0.36802462 = score(doc=1573,freq=4.0), product of:
              0.42548484 = queryWeight, product of:
                4.020149 = boost
                6.9196286 = idf(docFreq=116, maxDocs=43556)
                0.01529534 = queryNorm
              0.8649536 = fieldWeight in 1573, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.9196286 = idf(docFreq=116, maxDocs=43556)
                0.0625 = fieldNorm(doc=1573)
        0.44 = coord(11/25)
    
  2. Chu, H.: Factors affecting relevance judgment : a report from TREC Legal track (2011) 0.45
    0.44711894 = sum of:
      0.44711894 = product of:
        1.3972467 = sum of:
          0.022657413 = weight(abstract_txt:study in 1538) [ClassicSimilarity], result of:
            0.022657413 = score(doc=1538,freq=4.0), product of:
              0.0526538 = queryWeight, product of:
                3.4424734 = idf(docFreq=3786, maxDocs=43556)
                0.01529534 = queryNorm
              0.43030918 = fieldWeight in 1538, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.4424734 = idf(docFreq=3786, maxDocs=43556)
                0.0625 = fieldNorm(doc=1538)
          0.01161403 = weight(abstract_txt:using in 1538) [ClassicSimilarity], result of:
            0.01161403 = score(doc=1538,freq=1.0), product of:
              0.053534217 = queryWeight, product of:
                1.0083258 = boost
                3.4711347 = idf(docFreq=3679, maxDocs=43556)
                0.01529534 = queryNorm
              0.21694592 = fieldWeight in 1538, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4711347 = idf(docFreq=3679, maxDocs=43556)
                0.0625 = fieldNorm(doc=1538)
          0.096068956 = weight(abstract_txt:trec in 1538) [ClassicSimilarity], result of:
            0.096068956 = score(doc=1538,freq=3.0), product of:
              0.13262561 = queryWeight, product of:
                1.2958454 = boost
                6.69137 = idf(docFreq=146, maxDocs=43556)
                0.01529534 = queryNorm
              0.724362 = fieldWeight in 1538, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.69137 = idf(docFreq=146, maxDocs=43556)
                0.0625 = fieldNorm(doc=1538)
          0.32082665 = weight(abstract_txt:assessors in 1538) [ClassicSimilarity], result of:
            0.32082665 = score(doc=1538,freq=3.0), product of:
              0.33919495 = queryWeight, product of:
                2.5381064 = boost
                8.737364 = idf(docFreq=18, maxDocs=43556)
                0.01529534 = queryNorm
              0.94584733 = fieldWeight in 1538, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                8.737364 = idf(docFreq=18, maxDocs=43556)
                0.0625 = fieldNorm(doc=1538)
          0.058105573 = weight(abstract_txt:human in 1538) [ClassicSimilarity], result of:
            0.058105573 = score(doc=1538,freq=1.0), product of:
              0.19730194 = queryWeight, product of:
                2.7375736 = boost
                4.7120123 = idf(docFreq=1063, maxDocs=43556)
                0.01529534 = queryNorm
              0.29450077 = fieldWeight in 1538, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.7120123 = idf(docFreq=1063, maxDocs=43556)
                0.0625 = fieldNorm(doc=1538)
          0.40891683 = weight(abstract_txt:judgment in 1538) [ClassicSimilarity], result of:
            0.40891683 = score(doc=1538,freq=5.0), product of:
              0.39874238 = queryWeight, product of:
                3.552677 = boost
                7.3379974 = idf(docFreq=76, maxDocs=43556)
                0.01529534 = queryNorm
              1.0255164 = fieldWeight in 1538, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                7.3379974 = idf(docFreq=76, maxDocs=43556)
                0.0625 = fieldNorm(doc=1538)
          0.2950449 = weight(abstract_txt:relevance in 1538) [ClassicSimilarity], result of:
            0.2950449 = score(doc=1538,freq=11.0), product of:
              0.2884653 = queryWeight, product of:
                3.8222253 = boost
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.01529534 = queryNorm
              1.022809 = fieldWeight in 1538, product of:
                3.3166249 = tf(freq=11.0), with freq of:
                  11.0 = termFreq=11.0
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.0625 = fieldNorm(doc=1538)
          0.18401231 = weight(abstract_txt:judgments in 1538) [ClassicSimilarity], result of:
            0.18401231 = score(doc=1538,freq=1.0), product of:
              0.42548484 = queryWeight, product of:
                4.020149 = boost
                6.9196286 = idf(docFreq=116, maxDocs=43556)
                0.01529534 = queryNorm
              0.4324768 = fieldWeight in 1538, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.9196286 = idf(docFreq=116, maxDocs=43556)
                0.0625 = fieldNorm(doc=1538)
        0.32 = coord(8/25)
    
  3. Losada, D.E.; Parapar, J.; Barreiro, A.: When to stop making relevance judgments? : a study of stopping methods for building information retrieval test collections (2019) 0.37
    0.37091953 = sum of:
      0.37091953 = product of:
        0.9272988 = sum of:
          0.01161403 = weight(abstract_txt:using in 960) [ClassicSimilarity], result of:
            0.01161403 = score(doc=960,freq=1.0), product of:
              0.053534217 = queryWeight, product of:
                1.0083258 = boost
                3.4711347 = idf(docFreq=3679, maxDocs=43556)
                0.01529534 = queryNorm
              0.21694592 = fieldWeight in 960, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4711347 = idf(docFreq=3679, maxDocs=43556)
                0.0625 = fieldNorm(doc=960)
          0.011641364 = weight(abstract_txt:retrieval in 960) [ClassicSimilarity], result of:
            0.011641364 = score(doc=960,freq=1.0), product of:
              0.053618178 = queryWeight, product of:
                1.0091162 = boost
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.01529534 = queryNorm
              0.21711598 = fieldWeight in 960, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.0625 = fieldNorm(doc=960)
          0.033653963 = weight(abstract_txt:documents in 960) [ClassicSimilarity], result of:
            0.033653963 = score(doc=960,freq=3.0), product of:
              0.07544432 = queryWeight, product of:
                1.1970117 = boost
                4.1206813 = idf(docFreq=1921, maxDocs=43556)
                0.01529534 = queryNorm
              0.44607684 = fieldWeight in 960, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.1206813 = idf(docFreq=1921, maxDocs=43556)
                0.0625 = fieldNorm(doc=960)
          0.06552513 = weight(abstract_txt:reduce in 960) [ClassicSimilarity], result of:
            0.06552513 = score(doc=960,freq=2.0), product of:
              0.117636204 = queryWeight, product of:
                1.2204219 = boost
                6.301905 = idf(docFreq=216, maxDocs=43556)
                0.01529534 = queryNorm
              0.557015 = fieldWeight in 960, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.301905 = idf(docFreq=216, maxDocs=43556)
                0.0625 = fieldNorm(doc=960)
          0.056508195 = weight(abstract_txt:reliable in 960) [ClassicSimilarity], result of:
            0.056508195 = score(doc=960,freq=1.0), product of:
              0.1342827 = queryWeight, product of:
                1.3039157 = boost
                6.7330427 = idf(docFreq=140, maxDocs=43556)
                0.01529534 = queryNorm
              0.42081517 = fieldWeight in 960, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.7330427 = idf(docFreq=140, maxDocs=43556)
                0.0625 = fieldNorm(doc=960)
          0.027468683 = weight(abstract_txt:proposed in 960) [ClassicSimilarity], result of:
            0.027468683 = score(doc=960,freq=1.0), product of:
              0.095031604 = queryWeight, product of:
                1.3434428 = boost
                4.624766 = idf(docFreq=1160, maxDocs=43556)
                0.01529534 = queryNorm
              0.28904787 = fieldWeight in 960, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.624766 = idf(docFreq=1160, maxDocs=43556)
                0.0625 = fieldNorm(doc=960)
          0.06521344 = weight(abstract_txt:methods in 960) [ClassicSimilarity], result of:
            0.06521344 = score(doc=960,freq=6.0), product of:
              0.10243854 = queryWeight, product of:
                1.6105944 = boost
                4.1583214 = idf(docFreq=1850, maxDocs=43556)
                0.01529534 = queryNorm
              0.6366104 = fieldWeight in 960, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                4.1583214 = idf(docFreq=1850, maxDocs=43556)
                0.0625 = fieldNorm(doc=960)
          0.18287316 = weight(abstract_txt:judgment in 960) [ClassicSimilarity], result of:
            0.18287316 = score(doc=960,freq=1.0), product of:
              0.39874238 = queryWeight, product of:
                3.552677 = boost
                7.3379974 = idf(docFreq=76, maxDocs=43556)
                0.01529534 = queryNorm
              0.45862484 = fieldWeight in 960, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3379974 = idf(docFreq=76, maxDocs=43556)
                0.0625 = fieldNorm(doc=960)
          0.15408215 = weight(abstract_txt:relevance in 960) [ClassicSimilarity], result of:
            0.15408215 = score(doc=960,freq=3.0), product of:
              0.2884653 = queryWeight, product of:
                3.8222253 = boost
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.01529534 = queryNorm
              0.5341445 = fieldWeight in 960, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.0625 = fieldNorm(doc=960)
          0.31871867 = weight(abstract_txt:judgments in 960) [ClassicSimilarity], result of:
            0.31871867 = score(doc=960,freq=3.0), product of:
              0.42548484 = queryWeight, product of:
                4.020149 = boost
                6.9196286 = idf(docFreq=116, maxDocs=43556)
                0.01529534 = queryNorm
              0.7490718 = fieldWeight in 960, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.9196286 = idf(docFreq=116, maxDocs=43556)
                0.0625 = fieldNorm(doc=960)
        0.4 = coord(10/25)
    
  4. Balatsoukas, P.; Ruthven, I.: ¬An eye-tracking approach to the analysis of relevance judgments on the Web : the case of Google search engine (2012) 0.30
    0.29690504 = sum of:
      0.29690504 = product of:
        0.9278283 = sum of:
          0.0113287065 = weight(abstract_txt:study in 2377) [ClassicSimilarity], result of:
            0.0113287065 = score(doc=2377,freq=1.0), product of:
              0.0526538 = queryWeight, product of:
                3.4424734 = idf(docFreq=3786, maxDocs=43556)
                0.01529534 = queryNorm
              0.21515459 = fieldWeight in 2377, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4424734 = idf(docFreq=3786, maxDocs=43556)
                0.0625 = fieldNorm(doc=2377)
          0.01161403 = weight(abstract_txt:using in 2377) [ClassicSimilarity], result of:
            0.01161403 = score(doc=2377,freq=1.0), product of:
              0.053534217 = queryWeight, product of:
                1.0083258 = boost
                3.4711347 = idf(docFreq=3679, maxDocs=43556)
                0.01529534 = queryNorm
              0.21694592 = fieldWeight in 2377, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4711347 = idf(docFreq=3679, maxDocs=43556)
                0.0625 = fieldNorm(doc=2377)
          0.011641364 = weight(abstract_txt:retrieval in 2377) [ClassicSimilarity], result of:
            0.011641364 = score(doc=2377,freq=1.0), product of:
              0.053618178 = queryWeight, product of:
                1.0091162 = boost
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.01529534 = queryNorm
              0.21711598 = fieldWeight in 2377, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.0625 = fieldNorm(doc=2377)
          0.048876517 = weight(abstract_txt:ranking in 2377) [ClassicSimilarity], result of:
            0.048876517 = score(doc=2377,freq=1.0), product of:
              0.13954352 = queryWeight, product of:
                1.6279459 = boost
                5.6041603 = idf(docFreq=435, maxDocs=43556)
                0.01529534 = queryNorm
              0.35026002 = fieldWeight in 2377, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.6041603 = idf(docFreq=435, maxDocs=43556)
                0.0625 = fieldNorm(doc=2377)
          0.058105573 = weight(abstract_txt:human in 2377) [ClassicSimilarity], result of:
            0.058105573 = score(doc=2377,freq=1.0), product of:
              0.19730194 = queryWeight, product of:
                2.7375736 = boost
                4.7120123 = idf(docFreq=1063, maxDocs=43556)
                0.01529534 = queryNorm
              0.29450077 = fieldWeight in 2377, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.7120123 = idf(docFreq=1063, maxDocs=43556)
                0.0625 = fieldNorm(doc=2377)
          0.18287316 = weight(abstract_txt:judgment in 2377) [ClassicSimilarity], result of:
            0.18287316 = score(doc=2377,freq=1.0), product of:
              0.39874238 = queryWeight, product of:
                3.552677 = boost
                7.3379974 = idf(docFreq=76, maxDocs=43556)
                0.01529534 = queryNorm
              0.45862484 = fieldWeight in 2377, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3379974 = idf(docFreq=76, maxDocs=43556)
                0.0625 = fieldNorm(doc=2377)
          0.23536439 = weight(abstract_txt:relevance in 2377) [ClassicSimilarity], result of:
            0.23536439 = score(doc=2377,freq=7.0), product of:
              0.2884653 = queryWeight, product of:
                3.8222253 = boost
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.01529534 = queryNorm
              0.8159193 = fieldWeight in 2377, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.0625 = fieldNorm(doc=2377)
          0.36802462 = weight(abstract_txt:judgments in 2377) [ClassicSimilarity], result of:
            0.36802462 = score(doc=2377,freq=4.0), product of:
              0.42548484 = queryWeight, product of:
                4.020149 = boost
                6.9196286 = idf(docFreq=116, maxDocs=43556)
                0.01529534 = queryNorm
              0.8649536 = fieldWeight in 2377, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.9196286 = idf(docFreq=116, maxDocs=43556)
                0.0625 = fieldNorm(doc=2377)
        0.32 = coord(8/25)
    
  5. Reichenbacher, T.; Sabbata, S. de; Purves, R.S.; Fabrikant, S.I.: Assessing geographic relevance for mobile search : a computational model and its validation via crowdsourcing (2016) 0.29
    0.2944351 = sum of:
      0.2944351 = product of:
        0.92010975 = sum of:
          0.014160885 = weight(abstract_txt:study in 143) [ClassicSimilarity], result of:
            0.014160885 = score(doc=143,freq=1.0), product of:
              0.0526538 = queryWeight, product of:
                3.4424734 = idf(docFreq=3786, maxDocs=43556)
                0.01529534 = queryNorm
              0.26894325 = fieldWeight in 143, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4424734 = idf(docFreq=3786, maxDocs=43556)
                0.078125 = fieldNorm(doc=143)
          0.020579215 = weight(abstract_txt:retrieval in 143) [ClassicSimilarity], result of:
            0.020579215 = score(doc=143,freq=2.0), product of:
              0.053618178 = queryWeight, product of:
                1.0091162 = boost
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.01529534 = queryNorm
              0.38381043 = fieldWeight in 143, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.078125 = fieldNorm(doc=143)
          0.024287656 = weight(abstract_txt:documents in 143) [ClassicSimilarity], result of:
            0.024287656 = score(doc=143,freq=1.0), product of:
              0.07544432 = queryWeight, product of:
                1.1970117 = boost
                4.1206813 = idf(docFreq=1921, maxDocs=43556)
                0.01529534 = queryNorm
              0.32192823 = fieldWeight in 143, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1206813 = idf(docFreq=1921, maxDocs=43556)
                0.078125 = fieldNorm(doc=143)
          0.07441431 = weight(abstract_txt:methods in 143) [ClassicSimilarity], result of:
            0.07441431 = score(doc=143,freq=5.0), product of:
              0.10243854 = queryWeight, product of:
                1.6105944 = boost
                4.1583214 = idf(docFreq=1850, maxDocs=43556)
                0.01529534 = queryNorm
              0.72642887 = fieldWeight in 143, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.1583214 = idf(docFreq=1850, maxDocs=43556)
                0.078125 = fieldNorm(doc=143)
          0.2315367 = weight(abstract_txt:assessors in 143) [ClassicSimilarity], result of:
            0.2315367 = score(doc=143,freq=1.0), product of:
              0.33919495 = queryWeight, product of:
                2.5381064 = boost
                8.737364 = idf(docFreq=18, maxDocs=43556)
                0.01529534 = queryNorm
              0.6826066 = fieldWeight in 143, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.737364 = idf(docFreq=18, maxDocs=43556)
                0.078125 = fieldNorm(doc=143)
          0.10271711 = weight(abstract_txt:human in 143) [ClassicSimilarity], result of:
            0.10271711 = score(doc=143,freq=2.0), product of:
              0.19730194 = queryWeight, product of:
                2.7375736 = boost
                4.7120123 = idf(docFreq=1063, maxDocs=43556)
                0.01529534 = queryNorm
              0.5206087 = fieldWeight in 143, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.7120123 = idf(docFreq=1063, maxDocs=43556)
                0.078125 = fieldNorm(doc=143)
          0.22239845 = weight(abstract_txt:relevance in 143) [ClassicSimilarity], result of:
            0.22239845 = score(doc=143,freq=4.0), product of:
              0.2884653 = queryWeight, product of:
                3.8222253 = boost
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.01529534 = queryNorm
              0.77097124 = fieldWeight in 143, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.078125 = fieldNorm(doc=143)
          0.2300154 = weight(abstract_txt:judgments in 143) [ClassicSimilarity], result of:
            0.2300154 = score(doc=143,freq=1.0), product of:
              0.42548484 = queryWeight, product of:
                4.020149 = boost
                6.9196286 = idf(docFreq=116, maxDocs=43556)
                0.01529534 = queryNorm
              0.540596 = fieldWeight in 143, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.9196286 = idf(docFreq=116, maxDocs=43556)
                0.078125 = fieldNorm(doc=143)
        0.32 = coord(8/25)