Document (#38654)

Author

Líska, M.

Title

Evaluation of mathematics retrieval

Imprint

Brno : Masaryk University, Brno, Faculty of Informatics

Year

2013

Pages

63 S

Abstract

The thesis deals with the evaluation of mathematics information retrieval (IR). It gives an overview of the history of regular IR evaluation, initiatives that are engaged in this field of research as well as most common methods and measures used for evaluation. The findings are applied to the specifics of mathematics retrieval. This thesis also summarizes the state-of-the-art of MIaS math search system, which is already being used in an international web portal. Latest developments aiming towards the second version of the system are described. In addition to participating in the international evaluation conference and workshop, MIaS is tested for effectiveness and efficiency in this work. Measured performance indicators are evaluated and future work is suggested accordingly.

Content

Master Thesis, Masaryk University, Brno, Faculty of Informatics; Advisor: Petr Sojka.

Field

Mathematik

Similar documents (content)

1. Voorhees, E.M.: Text REtrieval Conference (TREC) (2009) 0.14

   0.1405085 = sum of:
     0.1405085 = product of:
       0.7025425 = sum of:
         0.15578842 = weight(abstract_txt:workshop in 3890) [ClassicSimilarity], result of:
           0.15578842 = score(doc=3890,freq=1.0), product of:
             0.1508552 = queryWeight, product of:
               1.0966126 = boost
               6.609291 = idf(docFreq=161, maxDocs=44218)
               0.020813838 = queryNorm
             1.0327017 = fieldWeight in 3890, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.609291 = idf(docFreq=161, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
         0.16276069 = weight(abstract_txt:summarizes in 3890) [ClassicSimilarity], result of:
           0.16276069 = score(doc=3890,freq=1.0), product of:
             0.15532327 = queryWeight, product of:
               1.112734 = boost
               6.7064548 = idf(docFreq=146, maxDocs=44218)
               0.020813838 = queryNorm
             1.0478835 = fieldWeight in 3890, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7064548 = idf(docFreq=146, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
         0.022744335 = weight(abstract_txt:this in 3890) [ClassicSimilarity], result of:
           0.022744335 = score(doc=3890,freq=1.0), product of:
             0.060324363 = queryWeight, product of:
               1.2011026 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.020813838 = queryNorm
             0.37703398 = fieldWeight in 3890, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
         0.11767091 = weight(abstract_txt:retrieval in 3890) [ClassicSimilarity], result of:
           0.11767091 = score(doc=3890,freq=3.0), product of:
             0.12511697 = queryWeight, product of:
               1.7297839 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020813838 = queryNorm
             0.94048715 = fieldWeight in 3890, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
         0.24357815 = weight(abstract_txt:evaluation in 3890) [ClassicSimilarity], result of:
           0.24357815 = score(doc=3890,freq=1.0), product of:
             0.34749806 = queryWeight, product of:
               3.7216394 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020813838 = queryNorm
             0.70094824 = fieldWeight in 3890, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
       0.2 = coord(5/25)
   

2. Sojka, P.: Exploiting semantic annotations in math information retrieval (2012) 0.14

   0.13752446 = sum of:
     0.13752446 = product of:
       0.57301855 = sum of:
         0.016364645 = weight(abstract_txt:used in 32) [ClassicSimilarity], result of:
           0.016364645 = score(doc=32,freq=1.0), product of:
             0.07794314 = queryWeight, product of:
               1.1147488 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.020813838 = queryNorm
             0.2099562 = fieldWeight in 32, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0625 = fieldNorm(doc=32)
         0.028674977 = weight(abstract_txt:system in 32) [ClassicSimilarity], result of:
           0.028674977 = score(doc=32,freq=3.0), product of:
             0.078548 = queryWeight, product of:
               1.1190659 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.020813838 = queryNorm
             0.3650631 = fieldWeight in 32, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=32)
         0.0090977345 = weight(abstract_txt:this in 32) [ClassicSimilarity], result of:
           0.0090977345 = score(doc=32,freq=1.0), product of:
             0.060324363 = queryWeight, product of:
               1.2011026 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.020813838 = queryNorm
             0.1508136 = fieldWeight in 32, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=32)
         0.21879615 = weight(abstract_txt:math in 32) [ClassicSimilarity], result of:
           0.21879615 = score(doc=32,freq=3.0), product of:
             0.24162927 = queryWeight, product of:
               1.3878671 = boost
               8.364683 = idf(docFreq=27, maxDocs=44218)
               0.020813838 = queryNorm
             0.9055035 = fieldWeight in 32, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.364683 = idf(docFreq=27, maxDocs=44218)
               0.0625 = fieldNorm(doc=32)
         0.027174933 = weight(abstract_txt:retrieval in 32) [ClassicSimilarity], result of:
           0.027174933 = score(doc=32,freq=1.0), product of:
             0.12511697 = queryWeight, product of:
               1.7297839 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020813838 = queryNorm
             0.21719621 = fieldWeight in 32, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=32)
         0.2729101 = weight(abstract_txt:mathematics in 32) [ClassicSimilarity], result of:
           0.2729101 = score(doc=32,freq=2.0), product of:
             0.4622465 = queryWeight, product of:
               3.3248384 = boost
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.020813838 = queryNorm
             0.59039944 = fieldWeight in 32, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.0625 = fieldNorm(doc=32)
       0.24 = coord(6/25)
   

3. Rousseau, R.; Egghe, L.; Guns, R.: Becoming metric-wise : a bibliometric guide for researchers (2018) 0.13

   0.13299482 = sum of:
     0.13299482 = product of:
       0.4749815 = sum of:
         0.13365354 = weight(abstract_txt:indicators in 5226) [ClassicSimilarity], result of:
           0.13365354 = score(doc=5226,freq=8.0), product of:
             0.12544513 = queryWeight, product of:
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.020813838 = queryNorm
             1.0654342 = fieldWeight in 5226, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.0625 = fieldNorm(doc=5226)
         0.05476829 = weight(abstract_txt:initiatives in 5226) [ClassicSimilarity], result of:
           0.05476829 = score(doc=5226,freq=1.0), product of:
             0.13841493 = queryWeight, product of:
               1.0504239 = boost
               6.330911 = idf(docFreq=213, maxDocs=44218)
               0.020813838 = queryNorm
             0.39568195 = fieldWeight in 5226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.330911 = idf(docFreq=213, maxDocs=44218)
               0.0625 = fieldNorm(doc=5226)
         0.016364645 = weight(abstract_txt:used in 5226) [ClassicSimilarity], result of:
           0.016364645 = score(doc=5226,freq=1.0), product of:
             0.07794314 = queryWeight, product of:
               1.1147488 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.020813838 = queryNorm
             0.2099562 = fieldWeight in 5226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0625 = fieldNorm(doc=5226)
         0.0090977345 = weight(abstract_txt:this in 5226) [ClassicSimilarity], result of:
           0.0090977345 = score(doc=5226,freq=1.0), product of:
             0.060324363 = queryWeight, product of:
               1.2011026 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.020813838 = queryNorm
             0.1508136 = fieldWeight in 5226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=5226)
         0.023582498 = weight(abstract_txt:work in 5226) [ClassicSimilarity], result of:
           0.023582498 = score(doc=5226,freq=1.0), product of:
             0.099441275 = queryWeight, product of:
               1.2591325 = boost
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.020813838 = queryNorm
             0.23714998 = fieldWeight in 5226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.0625 = fieldNorm(doc=5226)
         0.04453818 = weight(abstract_txt:international in 5226) [ClassicSimilarity], result of:
           0.04453818 = score(doc=5226,freq=1.0), product of:
             0.1519364 = queryWeight, product of:
               1.5563921 = boost
               4.690192 = idf(docFreq=1103, maxDocs=44218)
               0.020813838 = queryNorm
             0.293137 = fieldWeight in 5226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.690192 = idf(docFreq=1103, maxDocs=44218)
               0.0625 = fieldNorm(doc=5226)
         0.19297658 = weight(abstract_txt:mathematics in 5226) [ClassicSimilarity], result of:
           0.19297658 = score(doc=5226,freq=1.0), product of:
             0.4622465 = queryWeight, product of:
               3.3248384 = boost
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.020813838 = queryNorm
             0.41747546 = fieldWeight in 5226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.0625 = fieldNorm(doc=5226)
       0.28 = coord(7/25)
   

4. Sojka, P.; Liska, M.: ¬The art of mathematics retrieval (2011) 0.13

   0.13093434 = sum of:
     0.13093434 = product of:
       0.81833965 = sum of:
         0.050181206 = weight(abstract_txt:system in 3450) [ClassicSimilarity], result of:
           0.050181206 = score(doc=3450,freq=3.0), product of:
             0.078548 = queryWeight, product of:
               1.1190659 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.020813838 = queryNorm
             0.6388604 = fieldWeight in 3450, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.109375 = fieldNorm(doc=3450)
         0.3828933 = weight(abstract_txt:math in 3450) [ClassicSimilarity], result of:
           0.3828933 = score(doc=3450,freq=3.0), product of:
             0.24162927 = queryWeight, product of:
               1.3878671 = boost
               8.364683 = idf(docFreq=27, maxDocs=44218)
               0.020813838 = queryNorm
             1.5846312 = fieldWeight in 3450, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.364683 = idf(docFreq=27, maxDocs=44218)
               0.109375 = fieldNorm(doc=3450)
         0.047556132 = weight(abstract_txt:retrieval in 3450) [ClassicSimilarity], result of:
           0.047556132 = score(doc=3450,freq=1.0), product of:
             0.12511697 = queryWeight, product of:
               1.7297839 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020813838 = queryNorm
             0.38009337 = fieldWeight in 3450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.109375 = fieldNorm(doc=3450)
         0.337709 = weight(abstract_txt:mathematics in 3450) [ClassicSimilarity], result of:
           0.337709 = score(doc=3450,freq=1.0), product of:
             0.4622465 = queryWeight, product of:
               3.3248384 = boost
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.020813838 = queryNorm
             0.73058206 = fieldWeight in 3450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.109375 = fieldNorm(doc=3450)
       0.16 = coord(4/25)
   

5. Shechtman, N.; Chung, M.; Roschelle, J.: Supporting member collaboration in the Math Tools digital library : a formative user study (2004) 0.13

   0.12777342 = sum of:
     0.12777342 = product of:
       0.6388671 = sum of:
         0.020455806 = weight(abstract_txt:used in 1163) [ClassicSimilarity], result of:
           0.020455806 = score(doc=1163,freq=1.0), product of:
             0.07794314 = queryWeight, product of:
               1.1147488 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.020813838 = queryNorm
             0.26244524 = fieldWeight in 1163, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.078125 = fieldNorm(doc=1163)
         0.01969717 = weight(abstract_txt:this in 1163) [ClassicSimilarity], result of:
           0.01969717 = score(doc=1163,freq=3.0), product of:
             0.060324363 = queryWeight, product of:
               1.2011026 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.020813838 = queryNorm
             0.32652098 = fieldWeight in 1163, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.078125 = fieldNorm(doc=1163)
         0.041688357 = weight(abstract_txt:work in 1163) [ClassicSimilarity], result of:
           0.041688357 = score(doc=1163,freq=2.0), product of:
             0.099441275 = queryWeight, product of:
               1.2591325 = boost
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.020813838 = queryNorm
             0.41922587 = fieldWeight in 1163, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.078125 = fieldNorm(doc=1163)
         0.31580505 = weight(abstract_txt:math in 1163) [ClassicSimilarity], result of:
           0.31580505 = score(doc=1163,freq=4.0), product of:
             0.24162927 = queryWeight, product of:
               1.3878671 = boost
               8.364683 = idf(docFreq=27, maxDocs=44218)
               0.020813838 = queryNorm
             1.3069818 = fieldWeight in 1163, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.364683 = idf(docFreq=27, maxDocs=44218)
               0.078125 = fieldNorm(doc=1163)
         0.24122071 = weight(abstract_txt:mathematics in 1163) [ClassicSimilarity], result of:
           0.24122071 = score(doc=1163,freq=1.0), product of:
             0.4622465 = queryWeight, product of:
               3.3248384 = boost
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.020813838 = queryNorm
             0.5218443 = fieldWeight in 1163, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.078125 = fieldNorm(doc=1163)
       0.2 = coord(5/25)